AI 101 — What does GPT stand for?

GPT stands for Generative Pre-trained Transformer — the three-word recipe behind OpenAI's language models, from GPT-2 to today's GPT-6. It is also the most-abbreviated phrase in AI: most people who type "GPT" into a search box are really asking what the letters mean and why they keep appearing in the news.

Why it matters right now

Every model name in the headlines is a small riddle. When OpenAI moved ChatGPT onto GPT-6 for everyone on October 7, the coverage was dense with version numbers — GPT-6, GPT-6.1, the older GPT-5 line — and each one is a variation on the same three words. Understanding the acronym is the cheapest on-ramp to reading model announcements at all: it tells you who made the model, roughly how it was built, and what kind of system it is. Ten minutes here and the naming convention in every AI headline stops being noise.

The three words, one at a time

Generative. The model produces text rather than only classifying it. Underneath, it is doing one humble thing: guessing the next chunk of text (a token) and then the one after that, over and over, until a full answer exists.

Pre-trained. Before anyone tailored it for a job, it did a long, generic apprenticeship: reading an enormous pile of text and practicing the guess-the-next-word game until it had absorbed grammar, facts, and style. The "pre" matters — training for the specific job comes after the general education. When that later adaptation is done deliberately, we call it fine-tuning.

Transformer. The "T" is the architecture itself — the design published by eight Google researchers in the 2017 paper "Attention Is All You Need", which lets a model weigh every word in a passage against every other word at once, instead of reading in a line. What is a transformer? has the full story; for now, just know that almost every modern AI system runs on it.

The one-paragraph mental model

Think of GPT as a recipe card with three instructions: take text, generate it by predicting what comes next (Generative); learn general language by reading a huge unlabeled library first (Pre-trained); do all of that inside a network that reads whole passages in parallel (Transformer). OpenAI's researchers laid out this exact combination in a June 11, 2018 post, "Improving language understanding with unsupervised learning" — pairing a transformer with unsupervised pre-training. The letters stuck to the product line and never left.

An analogy: the student who did all the reading before day one

Picture a junior reporter who spent years reading the newspaper's entire archive — every story, every correction, every style rule — never taking notes, just practicing by covering up the next word of each article and guessing it until she could do it in her sleep. On day one on the job, you hand her a blank page: she already knows how language works, she just needs to learn the beat. That first long, generic apprenticeship is the pre-training. Her training on this newsroom's house style is the fine-tuning. And the way she reads — the whole page at once, noticing which earlier paragraphs matter to the sentence she's on — is the transformer.

Common misconceptions

"GPT" means ChatGPT. It doesn't. GPT is the model family; ChatGPT is an app built on top of it — the chat interface most people use. What is ChatGPT? covers the product itself.
GPT is one model. It is a line of models — GPT-2, GPT-3, GPT-4, up through the current GPT-6 generation. Each number is a bigger, later edition of the same recipe.
GPT means "AI." GPT is OpenAI's brand for its versions. Claude, Gemini, Llama, and DeepSeek models are also transformers doing generative pre-training — they just didn't inherit the name. The recipe is everywhere; the letters belong to one lab.
"Pre-trained" means it arrives pre-informed. It means the model arrives with command of language, not a current-events feed. Its general education happened at training time; anything that happened afterward has to come from a prompt, retrieval, or an update — which is why a fresh model can sound fluent and still be out of date.

Where to learn more

Related reading: What is a transformer? on the architecture in the T · What is a large language model? on the broader family GPT belongs to · What is ChatGPT? on the app most people meet these letters through.

Have you ever used "GPT" to mean any AI at all? Write to us via our contact page.

AI 101 — What is AGI?

AGI — short for artificial general intelligence — is a hypothetical AI system that could do any intellectual job a person can do, instead of being good at one narrow task. Every AI you can actually use today is narrow: it writes, translates, spots patterns in scans, plays games — each system built for its lane. AGI names the destination where one system covers all the lanes.

AI 101 — What is reinforcement learning?

Reinforcement learning is how a machine learns by trial and error: it tries things, notices which attempts earned a reward, and drifts toward the behaviour that earns more of it. There is no answer key involved. In the supervised learning most people picture, someone hands the model millions of labelled examples and it learns to copy them. In reinforcement learning, nobody says what the right move is — the machine acts, gets a number back telling it how well that went, and adjusts.

AI 101 — What is LLM-as-a-judge?

If you read a week of AI news, you'll notice almost nobody grades models by hand any more. When a lab says its new model is better at writing, summarising or handling customers, the number usually came from another AI. An LLM judge is a language model used to grade the work of another model — or of your own AI feature — when no piece of code can decide whether the answer was good.

AI 101 — What is multimodal AI?

Multimodal AI is a model that handles more than one kind of input — text, images, audio, video — inside the same system, rather than one model per sense stitched together. "Modality" is just the academic word for a channel of information. Text is a modality. A photograph is a modality. A voice recording is a modality. Multimodal AI reads more than one of them at once and reasons across them. That last part is the whole trick.

AI 101 — AI vs machine learning: what's the difference?

Artificial intelligence is the goal — getting a machine to do things we would call intelligent — and machine learning is the technique the field now overwhelmingly uses to get there: instead of a programmer writing the rules, the system is handed examples and adjusts itself until its answers get better. The two terms get swapped for each other in almost every story you read, including ours. That is mostly harmless, and occasionally it hides the interesting part.

AI 101 — What is continual learning?

Continual learning — also called lifelong learning — is the ability of an AI model to keep learning new information over time without losing the skills it already has. Instead of being frozen after training, or wiped and rebuilt whenever the world changes, a continually learning model gets smarter as it goes, accumulating knowledge the way a person does. Most AI models today do the opposite.

AI 101 — What is an AI hallucination?

An AI hallucination is a statement a chatbot or model produces with total confidence that simply isn't true. The model isn't lying, glitching, or behaving maliciously — it is doing exactly what it was trained to do, which is to generate the next most plausible string of words. Sometimes the most plausible thing is wrong, and the result is a confident falsehood you can't always spot without checking. Familiarity should not breed contempt for the term: hallucinations are still the single most…

AI 101 — What is fine-tuning?

Fine-tuning is the step where an AI model that was already trained on a huge, general dataset gets trained a little more on a smaller, specific dataset — so it becomes an expert at one particular job instead of a jack-of-all-trades. It is the most common word in AI product development, and it is the difference between a model that knows everything and a model that knows your business.