pre-trained
Educated before deployment
Pre-trained describes a machine learning model that has already been trained on a large dataset before being applied to a specific task.
Rather than starting from scratch, developers take a pre-trained model and fine-tune it for their particular needs, saving enormous amounts of time and computational resources.
The pre-trained language model was adapted for medical text analysis.
The term became widespread with the rise of large AI systems like GPT and BERT.
Small precise optimization adjustments
- adapterDevice enabling equipment compatibility
- unfreezingReturning to liquid form
- multi-taskHandle concurrent activities
- supervisedDirected with oversight
Pretrained language representation model
- GPTPre-trained text generator
- GPT-3AI text generator
- transformersVoltage-altering electrical devices
- DALL-EText-to-image AI system
checkpoint · weights · embeddings · backbone · encoder · decoder
Reducing required duration
- cost-effectiveGiving good return cheaply
- scalableAble to increase capacity
- reusableFit for repeated service
- off-the-shelfPrepackaged and ready-to-use
plug-and-play · inference · optimization · compression · quantization · lightweight · accessible · democratized
Things depicting other things
- featuresDistinctive qualities or aspects
- patternsRecurring arrangements or designs
- semanticsStudy of linguistic meaning
- syntaxRules for arranging words
context · generalization · parameters · attention · commonsense · multilingual · cross-modal · corpus
fine-tuning
Small precise optimization adjustments
- adapterDevice enabling equipment compatibility
- unfreezingReturning to liquid form
- multi-taskHandle concurrent activities
BERT
Pretrained language representation model
- GPTPre-trained text generator
- GPT-3AI text generator
- transformersVoltage-altering electrical devices
DALL-E · checkpoint · weights · embeddings · backbone · encoder · decoder
time-saving
Reducing required duration
- cost-effectiveGiving good return cheaply
- scalableAble to increase capacity
- reusableFit for repeated service
off-the-shelf · plug-and-play · inference · optimization · compression · quantization · lightweight · accessible · democratized · bootstrapping
representations
Things depicting other things
- featuresDistinctive qualities or aspects
- patternsRecurring arrangements or designs
- semanticsStudy of linguistic meaning
syntax · context · generalization · parameters · attention · commonsense · multilingual · cross-modal · corpus