> For the complete documentation index, see [llms.txt](https://ebs-projects-knowledgebase.gitbook.io/ebs-projects-knowledgebase/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://ebs-projects-knowledgebase.gitbook.io/ebs-projects-knowledgebase/tech-5-project/ebs-de-dup-solution.md).

# EBS De-Dup Solution

The **EBS-TECH 5 Deduplication Solution** is a high-throughput, event-driven system designed to ensure the integrity, uniqueness, and reliability of MTN's subscriber records. It addresses critical challenges arising from historical data capture issues and system limitations.

To tackle this, **EBS** and **TECH5** are collaborating to roll out this innovative system that integrates advanced biometric technology with intelligent data processing. The solution is engineered to process a **100-million-record data warehouse backlog** while simultaneously handling **real-time ingestion** at a rate of 70-100 Records Per Second (RPS).