regularization
Prevents model overfitting
Regularization is the process of making something regular, standard, or official.
In machine learning and statistics, regularization is a technique that constrains a model to prevent overfitting—penalizing complexity so the model generalizes better to new data: L2 regularization adds a penalty proportional to the squared weights.
In other contexts, regularization means bringing something into conformity with rules or norms: the regularization of informal settlements, regularization of immigration status.
Excess adaptation to samples
- generalizationDeriving principles from examples
- ridgeNarrow raised strip
- lassoLooped rope for catching
- shrinkageDecrease in size
penalty · lambda · hyperparameter · cross-validation · constraint · L1 · dropout · sparsity
Adjusting to a standard
- scalingClimbing or resizing
- z-scoreStandardized deviation measure
- centeringPositioning at midpoint
- standardizationImplementing uniform technical specifications
transformation · preprocessing · mean · variance · distribution · min-max · quantile · whitening
Implementing uniform technical specifications
- consistencyReliable adherence to standards
- homogeneityState of sameness throughout
- conformityAdherence to norms
- evennessUniform, balanced quality
stability · equilibrium · balance · alignment · orderliness · steadiness · invariance · symmetry
Adhering to requirements
- enforcementCompelling compliance with rules
- oversightSupervision or inadvertent omission
- formalizationProcess of making rigorous
- codificationOrganizing rules into system
harmonization · policy · procedure · guideline · framework · mandate · protocol · accountability
Smallest discrete unit
- divergenceSeparation from common origin
- cutoffPoint of termination
- infinityUnlimited extent or quantity
- perturbationState of being unsettled
electrodynamics · subtraction · bare · dimensional · ultraviolet · infrared · loop · Feynman
overfitting
Excess adaptation to samples
- generalizationDeriving principles from examples
- ridgeNarrow raised strip
- lassoLooped rope for catching
shrinkage · penalty · lambda · hyperparameter · cross-validation · constraint · L1 · dropout · sparsity · norm
normalization
Adjusting to a standard
standardization · transformation · preprocessing · mean · variance · distribution · min-max · quantile · whitening · outlier
standardization
Implementing uniform technical specifications
- consistencyReliable adherence to standards
- homogeneityState of sameness throughout
- conformityAdherence to norms
evenness · stability · equilibrium · balance · alignment · orderliness · steadiness · invariance · symmetry · harmony
compliance
Adhering to requirements
- enforcementCompelling compliance with rules
- oversightSupervision or inadvertent omission
- formalizationProcess of making rigorous
codification · harmonization · policy · procedure · guideline · framework · mandate · protocol · accountability · monitoring
quantum
Smallest discrete unit
- divergenceSeparation from common origin
- cutoffPoint of termination
- infinityUnlimited extent or quantity
perturbation · electrodynamics · subtraction · bare · dimensional · ultraviolet · infrared · loop · Feynman · gauge
- data processingnormalization, data entry, standardization, encoding, scaling
- machine learningneural networks, deep learning, backpropagation, underfitting, CNNs
- neural networksneural network, neural networks, hidden layers, backpropagation, layers
- Quantum FieldsQED, quantum fields, electromagnetic field, propagator, propagators
- language changelanguage change, linguistic diffusion, loan words, creolization, Great Vowel Shift
- ML settingshyperparameters, learning rate, epochs, dropout, momentum
regularizationirregularity
Departure from standard
deregulation · deviation · nonconformity · inconsistency · exception
regularizationdeportation
Legal expulsion from country
expulsion · denaturalization · criminalization · illegalization · removal
ruler, regular, regularly, regulate, irregular, regulation, regal, rectangle, irregularity