pretrained

Learned before deployment

Pretrained describes a machine learning model that has already been trained on a large dataset before being applied to a specific task.

Rather than starting from scratch, users can take a pretrained model and fine-tune it for their particular needs: The pretrained language model was adapted for medical text analysis.

This approach saves computational resources and often yields better results than training from zero.

model

fine-tuning

Small precise optimization adjustments

  • transferMove between locations
  • BERTPretrained language representation model
  • GPTPre-trained text generator

embeddings · weights · parameters · checkpoint · backbone · encoder · decoder · transformer · foundation · downstream

expertise

knowledge

Understood facts and skills

mastery · know-how · expertise · skill · aptitude · experience · foundation · baseline · accumulated · encoded

ready

plug-and-play

Requiring no manual configuration

accessible · configurable · adaptable · downloadable · reusable · modular · portable · scalable · operational · implementable

conditioning

Pavlov

Conditioning reflex discoverer

classical · operant · reinforcement · conditioning · associative · habituation · extinction · generalization · discrimination · unconditioned

Opposites
prior learning status

pretraineduntrained

Lacking learned skills

from scratch · naive · blank slate · tabula rasa · unlearned

initialization state

pretrainedfrom scratch

Starting with nothing prepared

uninitialized · baseline · vanilla

learning initialization

pretrainedab initio

From the beginning

de novo

Family

pretraining, pretrains

Familiarity
Top 1,000,000
Profile
Used worldwide · Abstract · Rated G