How Thumbs Up Feedback Trains AI
Chapter 1

The math of robot joy

Chapter 2

Training with human high-fives

Chapter 3

The magic of saying please

YOUR GOAL

Master of How to make a robot smile

Ch 2 · Training with human high-fives
007skaty

007skaty Developers adapt artificial intelligence models for local laws and cultural customs.

53m ago

007skaty

007skaty AI Values and Rules

Global views, local rules Global views, local rules That's how we keep the system cool

53m ago

007skaty
Without active guidance, raw imitation defaults to our worst habits.

53m ago

007skaty

007skaty The role of human trainers in making artificial intelligence safe

53m ago

007skaty
Why AI needs a human touch

007skaty Developers introduce human trainers to teach large language models how to filter billions of raw internet pages and speak safely.

53m ago

007skaty
How thumbs up trains AI

007skaty Human feedback shapes the reward model that guides modern conversational tools like ChatGPT

53m ago

007skaty
Solving the global alignment problem
BETA

007skaty Balance AI goals with human values to learn how to keep smart technology safe.

53m ago

007skaty
Fun Fact

Polite smart speakers: Google added a 'Pretty Please' feature to its assistant to reward children with polite responses when they say 'please' and 'thank you'.

53m ago

007skaty
Glossary
reinforcement learning (noun)
A machine learning training method based on rewarding desired behaviors and punishing undesired ones. In 2014, researchers Naomi Fitter and Katherine Kuchenbecker utilized physical palm-striking gestures to train social robots.

53m ago

007skaty
Gossip

Should humans apologize to an AI when they make a mistake in a prompt?

53m ago

007skaty
Quiz

Why is raw internet data a risky foundation for training an artificial intelligence?

53m ago

007skaty

007skaty How human thumbs-up clicks train artificial intelligence

53m ago

007skaty
Quiz

What is the main goal of introducing human guidance during the training of an AI model?

53m ago

007skaty

007skaty Computer scientists work to solve the global artificial intelligence alignment problem.

53m ago

007skaty
Quiz

How do human trainers provide feedback to the AI during the RLHF process?

53m ago

007skaty
Quiz

What does the acronym RLHF stand for in the context of training artificial intelligence?

53m ago

007skaty
Quiz

Which mathematician famously warned about the dangers of unaligned machines back in 1960?

53m ago

007skaty
Quiz

What is the scientific challenge of ensuring artificial intelligence goals match human values called?

53m ago

007skaty
Quiz

What Japanese linguistic feature must artificial intelligence models be specifically trained to respect?

53m ago

007skaty
Quiz

Which European Union regulation forces AI developers to respect strict user privacy laws?

53m ago