Skip to content

Saturday, October 10, 2026

Live
Loading the latest AI news…

Glossary · How models work

Transformer

Also called Transformer architecture

The transformer is the neural-network design behind most modern language and image models. Introduced by Google researchers in 2017, it uses a mechanism called attention to weigh how every word in a passage relates to every other word, all at once.

In one line, for a 12-year-old

A transformer is the clever design that lets an AI look at all the words in a sentence together to figure out what they mean.

An example

In "The trophy didn't fit in the suitcase because it was too big", attention helps the model link "it" to the trophy.

Why it matters to people

The "T" in GPT stands for transformer. Understanding that one design powers so many products explains why they share strengths and weaknesses.