reinforcement learning
Chapter 1

The math of robot joy

Chapter 2

Training with human high-fives

Chapter 3

The magic of saying please

YOUR GOAL

Master of How to make a robot smile

Ch 2 · Training with human high-fives
007skaty

007skaty Developers adapt artificial intelligence models for local laws and cultural customs.

1h ago

007skaty

007skaty AI Values and Rules

Global views, local rules Global views, local rules That's how we keep the system cool

1h ago

007skaty
Without active guidance, raw imitation defaults to our worst habits.

1h ago

007skaty

007skaty The role of human trainers in making artificial intelligence safe

1h ago

007skaty
Why AI needs a human touch

007skaty Developers introduce human trainers to teach large language models how to filter billions of raw internet pages and speak safely.

1h ago

007skaty
How thumbs up trains AI

007skaty Human feedback shapes the reward model that guides modern conversational tools like ChatGPT

1h ago

007skaty
Solving the global alignment problem
BETA

007skaty Balance AI goals with human values to learn how to keep smart technology safe.

1h ago

007skaty
Fun Fact

Polite smart speakers: Google added a 'Pretty Please' feature to its assistant to reward children with polite responses when they say 'please' and 'thank you'.

1h ago

007skaty
Glossary
reinforcement learning (noun)
A machine learning training method based on rewarding desired behaviors and punishing undesired ones. In 2014, researchers Naomi Fitter and Katherine Kuchenbecker utilized physical palm-striking gestures to train social robots.

1h ago

007skaty
Gossip

Should humans apologize to an AI when they make a mistake in a prompt?

1h ago

007skaty
Quiz

Why is raw internet data a risky foundation for training an artificial intelligence?

1h ago

007skaty

007skaty How human thumbs-up clicks train artificial intelligence

1h ago

007skaty
Quiz

What is the main goal of introducing human guidance during the training of an AI model?

1h ago

007skaty

007skaty Computer scientists work to solve the global artificial intelligence alignment problem.

1h ago

007skaty
Quiz

How do human trainers provide feedback to the AI during the RLHF process?

1h ago

007skaty
Quiz

What does the acronym RLHF stand for in the context of training artificial intelligence?

1h ago

007skaty
Quiz

Which mathematician famously warned about the dangers of unaligned machines back in 1960?

1h ago

007skaty
Quiz

What is the scientific challenge of ensuring artificial intelligence goals match human values called?

1h ago

007skaty
Quiz

What Japanese linguistic feature must artificial intelligence models be specifically trained to respect?

1h ago

007skaty
Quiz

Which European Union regulation forces AI developers to respect strict user privacy laws?

1h ago