In what year was the transformer architecture first introduced to the

The day machines learned to think

Chapter 1

The day machines started to see

Chapter 2

The magic of the transformer

Chapter 3

Decoding the secrets of nature

YOUR GOAL

Master of The day machines learned to think

Ch 2 · The magic of the transformer
007skaty

007skaty Generative pre-trained transformers emerged to write human language.

1d ago

007skaty

007skaty The Transformer Architecture

Read all at once, / Connect every word, / Now the future is heard!

1d ago

007skaty
To understand any single part, we must look at its relationship to the whole.

1d ago

007skaty

007skaty The mechanics of self-attention in modern artificial intelligence

1d ago

007skaty
Generative pre-trained transformers emerge

007skaty GPT trained on billions of web pages to predict the next word, unlocking the ability to write essays,

1d ago

007skaty
The secret of self-attention

007skaty Glowing glass and chrome nodes connect the words bank and river in 3D.

1d ago

007skaty
Fun Fact

Transformer speed: The transformer architecture allowed AI models to be trained in parallel, reducing training times from months to just days.

1d ago

007skaty
Glossary
transformer (noun)
An apparatus for reducing or increasing the voltage of an alternating current. Google researchers introduced this neural network architecture in 2017 to revolutionize language processing through parallel data analysis.

1d ago

007skaty
Gossip

Would you let AI write your school essays?

1d ago

007skaty
Quiz

What is the name of the revolutionary 2017 research paper that introduced transformers?

1d ago

007skaty

007skaty The research paper that changed how computers process human language

1d ago

007skaty
Quiz

What basic task are large language models mathematically trained to do?

1d ago

007skaty

007skaty The unexpected abilities of giant artificial intelligence language models

1d ago

007skaty
Quiz

What are the unexpected skills that AI models develop only after reaching a massive size?

1d ago

007skaty
Quiz

What mechanism allows a transformer AI to weigh the importance of different words in a sentence?

1d ago

007skaty
Quiz

What does the 'T' in GPT stand for?

1d ago

007skaty
Quiz

In what year was the transformer architecture first introduced to the world?

1d ago

007skaty
Quiz

What term describes the massive settings adjusted during an AI's training process?

1d ago

007skaty
Quiz

How do transformers process text differently than older AI models?

1d ago