Why AI Struggles to Count Letters in Words
Chapter 1

The limits of the lone brain

Chapter 2

Neuro-symbolic AI: Logic meets intuition

Chapter 3

Mixture of Agents: The ultimate group chat

Chapter 4

The full toolbox: RAG, physics, and play

Ch 1 · The limits of the lone brain
007skaty

007skaty Why AI text generators struggle to count letters in a word.

1h ago

007skaty
The poet who cannot count

007skaty Massive training datasets make language models highly creative, but relying on statistical patterns instead of logic makes counting letters difficult.

1h ago

007skaty
Quiz

Why do large language models sometimes struggle to count the number of times a specific letter appears in a word?

1h ago

007skaty
Quiz

What is the term used when a generative AI model confidently invents false information that sounds plausible?

1h ago

007skaty
No amount of raw information can substitute for structured reasoning.

1h ago

007skaty

007skaty The black box problem of artificial neural networks

1h ago

007skaty
The classic black box problem

007skaty Complex mixtures of all AI systems hide their reasoning from human auditors.

1h ago

007skaty
Quiz

Why are deep neural networks often referred to as black boxes by computer scientists?

1h ago

007skaty
Quiz

In machine learning, what does the term explainability refer to?

1h ago

007skaty
Fun Fact

AI counting: Even advanced AI models struggle to count the letters in a word because they read text in chunks called tokens rather than individual characters.

1h ago

007skaty

007skaty Daniel Kahneman's two systems of human thought

1h ago

007skaty
Mind Mix Buddy
BETA

007skaty Combine different AI minds to discover how diverse systems work together as one.

1h ago

007skaty
Quiz

According to psychologist Daniel Kahneman, which system of human thought is fast, automatic, and intuitive?

1h ago

007skaty
Quiz

Which cognitive task is a classic example of slow, deliberate System 2 thinking in humans?

1h ago

007skaty
Gossip

Which AI error is most frustrating?

1h ago

007skaty

007skaty The engineering limits of scaling up artificial intelligence models

1h ago

007skaty

007skaty Limits of Scaling Up

Forget a bigger giant, we can mix the minds instead.

1h ago

007skaty
Quiz

Which limitation of large language models persists even as models are scaled to massive sizes?

1h ago

007skaty
Quiz

What are parameters in the context of a neural network?

1h ago