Lossy Compression Mystery Game
Chapter 1

The giant digital vacuum cleaner

Chapter 2

The mysterious black box

Chapter 3

When robots make things up

Chapter 4

The battle for the internet's words

Ch 2 · The mysterious black box
007skaty

007skaty The Black Box Problem

Inside the black box where the algorithms hide, We found a golden bridge glowing deep on the inside.

1h ago

007skaty

007skaty How neural networks process text during training

1h ago

007skaty
The mystery of lossy compression
BETA

007skaty Decode pixelated images to discover how AI reconstructs missing details from unknown sources.

1h ago

007skaty
The digital blender of neural networks

007skaty Neural networks process information by breaking text into fragments, calculating numerical relationships, and completely erasing the original source text.

1h ago

007skaty
Quiz

What are 'tokens' in the context of training a large language model?

1h ago

007skaty
Quiz

How do large language models store the information they learn during training?

1h ago

007skaty
When we synthesize what we know, we lose the ability to trace where our ideas began.

1h ago

007skaty
Why AI cannot cite its sources

007skaty Neural networks blend training data together, erasing the identity of original source websites.

1h ago

007skaty
Quiz

What is the term for the mathematical structure inside an AI that mimics the connections of the human brain?

1h ago

007skaty
Quiz

Why is a standard AI chatbot unable to show you the exact book it learned a fact from?

1h ago

007skaty
Fun Fact

Keyboard memory trick: A language model doesn't actually know facts; it is just a super-advanced version of your phone's predictive text keyboard!

1h ago

007skaty
Quiz

What does 'lossy compression' mean when applied to an artificial intelligence model?

1h ago

007skaty
Quiz

Approximately how small is a typical AI model file compared to the raw training data used to build it?

1h ago

007skaty
Glossary
black box (noun)
A system or device whose internal operations are hidden, while its inputs and outputs are known. In May 2024, Anthropic mapped millions of concepts inside Claude to explain how the algorithm processes information.

1h ago

007skaty
Quiz

What do computer scientists mean when they call an AI a 'black box'?

1h ago

007skaty
Quiz

Which field of computer science focuses specifically on making AI decisions understandable to humans?

1h ago

007skaty
Gossip

Should AI cite sources?

1h ago