From “foundational models” to “dialogues”
Transformers: Deep Neural Network Architectures for Natural Language Processing
Article REF: H3735 V1
From “foundational models” to “dialogues”
Transformers: Deep Neural Network Architectures for Natural Language Processing

Author : François YVON

Publication date: April 10, 2026 | Lire en français

Logo Techniques de l'Ingenieur You do not have access to this resource.
Request your free trial access! Free trial

Already subscribed?

4. From “foundational models” to “dialogues”

A language model pre-trained using masking/unmasking can spontaneously perform various linguistic tasks—such as summarizing a text provided as input or generating a response to a question—simply by completing a textual prefix (§ 2.2...

You do not have access to this resource.
Logo Techniques de l'Ingenieur

Exclusive to subscribers. 97% yet to be discovered!

You do not have access to this resource. Click here to request your free trial access!

Already subscribed?

Ongoing reading
From “foundational models” to “dialogues”

Article included in this offer

"Technological innovations"

( 189 articles )

Complete knowledge base

Updated and enriched with articles validated by our scientific committees

Services

A set of exclusive tools to complement the resources

View offer details
Contact us
Contact our team FAQ