Design a System for Data De-Duplication

Question Explain

Design an efficient system to identify and merge duplicate records (e.g., duplicate user profiles) in a large database. Discuss hashing and blocking techniques.