Chapter 1
Breaking free from the cloud
Chapter 2
The silicon inside your machine
Chapter 3
The open source brain trust
Chapter 4
Living with a local assistant
YOUR GOAL
Master of Your private home AI
Ch 3 · The open source brain trust
007skaty A desktop computer screen displays secure code running a private local AI model.
007skaty Open-source groups worldwide are building diverse AI models to ensure local technology represents different languages, cultures, and values.
BETA
007skaty Sort incoming data into local drives to learn how offline computers run private AI.
Fun Fact
Model squeezing: Quantization can compress an AI model to the point where a high-school level digital tutor can easily fit onto a standard 8-gigabyte USB thumb drive.
Glossary
hugging face (noun)
An emoji depicting a smiling face with open hands, typically used to express warmth, support, or a hug. Founded in 2016, this collaborative platform hosts thousands of open-source models available for local offline processing.
An emoji depicting a smiling face with open hands, typically used to express warmth, support, or a hug. Founded in 2016, this collaborative platform hosts thousands of open-source models available for local offline processing.
Quiz
What unit of measurement is used to describe the size of an AI model's brain, such as 7B or 70B?
007skaty Model Quantization
Squeeze those sixteen bits down to four, now we can run it all on our own!
007skaty The anonymous 4chan post by llamanon containing the leaked LLaMA model torrent link.
Quiz
Which company's leaked LLaMA model in 2023 accidentally triggered the open-source local AI boom?
Quiz
Which online platform acts as the primary global community hub for sharing open-source AI models?
007skaty Quantization is a clever mathematical trick that compresses giant AI models so they can fit into a computer's standard memory.