Plate VI. The Loom of Attention, 2017–2022

11 Oct 2018— Model release

BERT

Google releases BERT, a bidirectional transformer pre-trained on masked words, which sets new records across language-understanding benchmarks.

Date confidence: high

Sources

• BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding, arXiv primary

See it in the chronicle