encoder-decoder
Signal transformation architecture
An encoder-decoder is a neural network architecture where one component (the encoder) processes input into a compressed internal representation, and another (the decoder) transforms that representation into output.
The structure suits tasks where input and output differ in form or length: machine translation, text summarization, image captioning.
The encoder-decoder model translates English sentences into French.
Voltage-altering electrical device
- attentionFocused mental awareness
- bottleneckConstriction limiting throughput
- representationDepiction or likeness
- embeddingPlacing within surrounding mass
GRU · recurrent · neural network · deep learning · model · framework · variational · generative
Automated cross-lingual text conversion
- source languageLanguage being translated from
- target languageLanguage being acquired
- alignmentCorrect relative positioning
- tokenizationConverting input into discrete units
vocabulary · subword · multilingual · Google Translate · inference
Heavy objects for lifting
- parametersDefined boundaries or constraints
- feedforwardControl anticipating disturbances
- normalizationAdjusting to a standard
- projectionSomething that extends outward
Reverse gradient computation method
- gradientRate of change across space
- optimizationMaximizing efficiency or performance
- fine-tuningSmall precise optimization adjustments
- pretrainingInitial broad model education
convergence · overfitting · regularization · dropout · batch · epoch · learning rate
Condensing into key points
- captioningAdding text to media
- speech recognitionMachines understanding human talk
- text generationProducing language computationally
- chatbotConversational AI program
OCR · TTS · multimodal
transformer
Voltage-altering electrical device
- attentionFocused mental awareness
- bottleneckConstriction limiting throughput
- representationDepiction or likeness
embedding · GRU · recurrent · neural network · deep learning · model · framework · variational · generative
machine translation
Automated cross-lingual text conversion
- source languageLanguage being translated from
- target languageLanguage being acquired
- alignmentCorrect relative positioning
tokenization · vocabulary · subword · multilingual · Google Translate · inference
weights
Heavy objects for lifting
- parametersDefined boundaries or constraints
- feedforwardControl anticipating disturbances
- normalizationAdjusting to a standard
backpropagation
Reverse gradient computation method
- gradientRate of change across space
- optimizationMaximizing efficiency or performance
- fine-tuningSmall precise optimization adjustments
pretraining · convergence · overfitting · regularization · dropout · batch · epoch · learning rate
summarization
Condensing into key points
- captioningAdding text to media
- speech recognitionMachines understanding human talk
- text generationProducing language computationally
chatbot · OCR · TTS · multimodal