Aiodic

Back to the table

7 Beginner Tf Transformer Core Concepts

Transformer

The architecture behind almost every modern language model.

Introduced in 2017, the transformer uses attention to weigh how every word relates to every other word, which made large-scale language models practical.