Deduplication identifies exact duplicates using cryptographic hash values and suppresses copies so each unique document is reviewed once. Custodian information for suppressed copies is typically retained so the document's distribution is known.
It may operate within a custodian or across the entire collection.
Alternative Names:
Dedupe, Exact Deduplication
Why it Matters?
Deduplication routinely removes a substantial share of a collection, since email is inherently duplicative across senders and recipients. Retaining custodian information for suppressed copies is essential, because who possessed a document is frequently as relevant as the document itself. A deduplication that discards that metadata destroys evidence of distribution and knowledge.
Frequently Confused with
Related terms
Frequently asked questions
How much volume does deduplication remove?
Why retain custodian data for suppressed copies?
