preprocessing
Before the analysis
Preprocessing is preparation work done on data before the main processing begins.
In computing and data science, raw data often needs cleaning, formatting, or transforming before analysis: The preprocessing step removed duplicate entries and standardized dates.
Image preprocessing might resize photos or adjust contrast before feeding them to an algorithm.
The term appears wherever data must be shaped to fit downstream requirements.
Removing dirt and mess
- normalizationAdjusting to a standard
- wranglingLengthy, contentious disputing
- transformationThorough change in form
- integrationCombining into a whole
extraction · imputation · filtering · validation · parsing · deduplication · formatting · standardization
Climbing or resizing
- normalizationAdjusting to a standard
- encodingConverting data to format
- binarizationConversion to two values
- standardizationImplementing uniform technical specifications
binning · embedding · hashing · bucketing · quantization · centering · whitening
Converting input into discrete units
- stemmingRoot-form reduction process
- lowercasingMaking letters minuscule
- vectorizationLoop-free array computation
- parsingGrammatical structure extraction
segmentation · spell-checking · n-grams · tagging · chunking
Processing in sets
- splittingDividing into parts
- shufflingRandomizing order of items
- samplingExtracting subset for study
- augmentationAct of adding more
partitioning · stratification · balancing · oversampling · bootstrapping · folding · holdout · caching
Reducing irregularities systematically
- filteringSelective passage of elements
- interpolationEstimating between known values
- downsamplingLowering sampling rate
- upsamplingIncreasing data resolution
denoising · bandpass · thresholding · windowing · convolution · sharpening · blurring · clipping
cleaning
Removing dirt and mess
- normalizationAdjusting to a standard
- wranglingLengthy, contentious disputing
- transformationThorough change in form
integration · extraction · imputation · filtering · validation · parsing · deduplication · formatting · standardization · merging
scaling
Climbing or resizing
- normalizationAdjusting to a standard
- encodingConverting data to format
- binarizationConversion to two values
standardization · binning · embedding · hashing · bucketing · quantization · centering · whitening
tokenization
Converting input into discrete units
- stemmingRoot-form reduction process
- lowercasingMaking letters minuscule
- vectorizationLoop-free array computation
parsing · segmentation · spell-checking · n-grams · tagging · chunking
batching
Processing in sets
augmentation · partitioning · stratification · balancing · oversampling · bootstrapping · folding · holdout · caching · streaming
smoothing
Reducing irregularities systematically
- filteringSelective passage of elements
- interpolationEstimating between known values
- downsamplingLowering sampling rate
upsampling · denoising · bandpass · thresholding · windowing · convolution · sharpening · blurring · clipping · truncation
- data sciencealgorithm, data analytics, data, machine learning, dataset
- Simulationscomputer simulation, virtual reality, flight simulator, VR, fluid dynamics
- machine learningneural networks, deep learning, backpropagation, underfitting, CNNs
- NLPtokenization, NLP, parsing, stemming, machine translation
- chemometricsPCA, spectral analysis, calibration, normalization, library search
- corpus linguisticscorpus, word counts, word frequency, concordance, n-grams
preprocessingpostprocessing
Operations after main computation
post-processing · finishing · reporting · visualization · rendering
process, procedure, procession, processed, processing, unprocessed, processor, procedural, processors