AI Hallucinations: The Truth Behind the Term
Chapter 1

Defining the finish line of artificial minds

Chapter 2

The frozen history of artificial intelligence

Chapter 3

Under the hood of modern language models

Chapter 4

The deep divide between human and machine minds

Ch 3 · Under the hood of modern language models
007skaty

007skaty Large language models struggle with basic mathematical logic.

3h ago

007skaty

007skaty Large language models play a game of next-word prediction.

3h ago

007skaty
The next-word prediction game

007skaty AI acts like a sophisticated phone autocomplete, calculating next-word probabilities from patterns in billions of training text pages.

3h ago

007skaty
Quiz

What are the mathematical representations of words that LLMs use to analyze relationships between concepts?

3h ago

007skaty
Quiz

What is the fundamental mechanism that Large Language Models use to generate text?

3h ago

007skaty
Fluency is easily mistaken for understanding.

3h ago

007skaty

007skaty The origin of hallucinations in large language models.

3h ago

007skaty
The truth about hallucinations

007skaty These systems invent realistic citations and events just to keep sentences flowing smoothly.

3h ago

007skaty
Quiz

Why do Large Language Models hallucinate and present false information as absolute fact?

3h ago

007skaty
Quiz

Which of the following is a classic example of an AI hallucination?

3h ago

007skaty
Fun Fact

Token math: A token is not always a whole word. On average, 100 English words equal about 133 tokens in most language models.

3h ago

007skaty
The context window wall
BETA

007skaty Drag the sliding wall to fit incoming words to discover how AI limits its memory.

3h ago

007skaty
Quiz

What term is used to describe the maximum amount of text an LLM can process in a single prompt?

3h ago

007skaty
Quiz

What is the 'lost in the middle' phenomenon discovered by AI researchers?

3h ago

007skaty
Glossary
attention (noun)
The act or faculty of directing the mind to an object. Google researchers introduced this mathematical mechanism in 2017 to improve how neural networks process text.

3h ago

007skaty

007skaty AI Mathematical Reasoning Limits

Easy in ten, switch it to nine, logic falls behind.

3h ago

007skaty
Quiz

Why do language models frequently fail at multi-step math problems despite sounding highly confident?

3h ago

007skaty
Quiz

What prompt engineering technique helps LLMs perform better at math by asking them to show their work?

3h ago

007skaty
Gossip

Which AI limitation do you find the most frustrating in daily use?

3h ago