Dmitry Bahdanau from the University of Montreal developed the attention mechanism in 2014, which became the foundation for modern language models and transformers.

Dmitry Bahdanau from the University of Montreal developed the attention mechanism in 2014, which became the foundation for modern language models and transformers.