2. Transformer model
2.1 Attention, a fundamental mechanism
With these first concepts of probabilistic modeling established, in this section we introduce the Transformer model, which relies on a more general mechanism for encoding the context of each decision.
SCROLL TO TOP2.1.1 Context vector calculation
The central idea of the Transformer model
Exclusive to subscribers. 97% yet to be discovered!
Already subscribed? Log in!
Transformer model
Towards multilingualism
Article included in this offer
"Software technologies and System architectures"
(
230 articles
)
Updated and enriched with articles validated by our scientific committees
A set of exclusive tools to complement the resources
Bibliography
- (1) - AHARONI (R.), JOHNSON (M.), FIRAT (O.) - Massively multilingual neural machine translation. - Proceedings of the 2019 conference of the north American chapter of the association for computational linguistics : Human language technologies, volume 1 (long and short papers), Association for Computational...
Exclusive to subscribers. 97% yet to be discovered!
Already subscribed? Log in!
![Écoutez notre podcast Cogitons Sciences : Intégrer l’IA dans votre entreprise, pour un usage utile et raisonné [L’IA s’invite dans nos métiers #2]](https://www.techniques-ingenieur.fr/actualite/wp-content/uploads/2024/01/CS-IA-ep2.png)
![Écoutez notre podcast Cogitons Sciences : Comment l’IA révolutionne notre façon de travailler ? [L’IA s’invite dans nos métiers #1]](https://www.techniques-ingenieur.fr/actualite/wp-content/uploads/2024/01/IA-ep1.png)
