deduplication
Eliminating redundant entries
Deduplication is the process of identifying and removing duplicate copies of data, files, or records.
In computing and data management, deduplication reduces storage requirements by keeping only one instance of repeated information: The backup system uses deduplication to save disk space.
The shortened form dedupe serves as both noun and verb.
One-way data transformation
- checksumError-detecting calculated value
- fingerprintFriction ridge impression
- chunkingDividing into manageable parts
- similarityState of being alike
matching · indexing · lookup · collision · digest · signature · comparison · identification
Stored data or albums
- entriesItems logged or submitted
- databaseOrganized digital information collection
- cleanupRestoration of order
- mergeCombine into unity
matching · linkage · consolidation · normalization · standardization · cleansing · quality · integrity
Maximizing efficiency or performance
- throughputProcessing rate over time
- scalabilityCapacity for growth
- overheadLocated directly above
- performanceCarrying out a task
resource · bandwidth · I/O · processing · speed · ROI · streamlining · automation
Needless duplication
- eliminationAct of removing entirely
- inlineArranged in sequence
- backupStored duplicate for recovery
- snapshotInformal photograph taken quickly
replication · tiering · archival · capacity · footprint · ratio · savings · reclamation
Accuracy of measurement
- recallMemory retrieval act
- confidenceSelf-assurance or trust
- thresholdPoint of beginning
- verificationProving something accurate
validation · reliability · correctness · exactness · consistency · trustworthiness · fidelity · completeness
hashing
One-way data transformation
- checksumError-detecting calculated value
- fingerprintFriction ridge impression
- chunkingDividing into manageable parts
similarity · matching · indexing · lookup · collision · digest · signature · comparison · identification
records
Stored data or albums
- entriesItems logged or submitted
- databaseOrganized digital information collection
- cleanupRestoration of order
merge · matching · linkage · consolidation · normalization · standardization · cleansing · quality · integrity · reconciliation
optimization
Maximizing efficiency or performance
- throughputProcessing rate over time
- scalabilityCapacity for growth
- overheadLocated directly above
performance · resource · bandwidth · I/O · processing · speed · ROI · streamlining · automation · real-time
redundancy
Needless duplication
- eliminationAct of removing entirely
- inlineArranged in sequence
- backupStored duplicate for recovery
snapshot · replication · tiering · archival · capacity · footprint · ratio · savings · reclamation · chunking
precision
Accuracy of measurement
- recallMemory retrieval act
- confidenceSelf-assurance or trust
- thresholdPoint of beginning
verification · validation · reliability · correctness · exactness · consistency · trustworthiness · fidelity · completeness
- data storagehard drive, hard drives, backup, gigabyte, flash drives
- compressioncompress, compression, compressor, compressing, compact
- data processingnormalization, data entry, standardization, encoding, scaling
- data warehousingdata warehouse, star schema, ETL, extract, transform
- e-discoveryESI, production, processing, collection, predictive coding
- ZFSpools, snapshots, datasets, clones, scrubbing
deduplicationduplication
Making an identical copy
replication · copying · redundancy · cloning · reproduction