pretrains
Trains before training
Pretrains is the act of training a machine learning model on a large general dataset before fine-tuning it for a specific task.
The prefix captures the sequence: you pretrain on broad data, then specialize.
The team pretrains the model on millions of web pages before adapting it for medical texts.
Most commonly appears as the past participle pretrained.
Voltage-altering electrical devices
- BERTPretrained language representation model
- GPTPre-trained text generator
- fine-tuningSmall precise optimization adjustments
- embeddingsLearned numerical encodings
weights · parameters · corpus · dataset · tokens · language models · neural networks · checkpoints
Pre-activity preparation routine
- preparationArranging things in advance
- conditioningLearned behavioral adaptation
- drillsRepetitive training routines
- stretchingExtending muscles or material
rehearsal · practice runs · readiness · athletes · coaches · routines · exercises · sprints
transformers
Voltage-altering electrical devices
- BERTPretrained language representation model
- GPTPre-trained text generator
- fine-tuningSmall precise optimization adjustments
embeddings · weights · parameters · corpus · dataset · tokens · language models · neural networks · checkpoints · epochs
warm-up
Pre-activity preparation routine
- preparationArranging things in advance
- conditioningLearned behavioral adaptation
- drillsRepetitive training routines
stretching · rehearsal · practice runs · readiness · athletes · coaches · routines · exercises · sprints · track
pretrainsfine-tunes
Adjusts for optimal performance
finetunes · adapts · specializes · deploys · calibrates