Modelmathics
Interactive course that teaches how large language models work by having learners implement one from scratch in Python. Starting from an empty file, students write a tokenizer, a bigram model, attention, and a Transformer themselves, with tests verifying each step before moving on; at the end, published open weights run on the learner's own code. Lessons run in the mm terminal app with code kept in local files on the learner's machine, and Stage 1 (11 lessons) is live as a free private beta.
What it addresses
Understanding how LLMs really work, addressed by having learners build every component of the model themselves rather than just following along.
Shared over time
Each entry reflects what was shared on that date. Details may have changed since then.
Modelmathics
Interactive course that teaches how large language models work by having learners implement one from scratch in Python. Starting from an empty file, students write a tokenizer, a bigram model, attention, and a Transformer themselves, with tests verifying each step before moving on; at the end, published open weights run on the learner's own code. Lessons run in the mm terminal app with code kept in local files on the learner's machine, and Stage 1 (11 lessons) is live as a free private beta.
Problem: Understanding how LLMs really work, addressed by having learners build every component of the model themselves rather than just following along.
Posted by @lucasov · Original comment ↗
“I wanted to understand how LLMs really work, so I’m building Modelmathics (https://modelmathics.com) and doing every lesson myself as I go. You start from an empty Python file and write the model yourself: a tokenizer, a bigram model, attention, a Transformer. At the end, published open weights run on your own code. Tests check each step before you move on.”
ModelMathics
An interactive web tool for teaching yourself how large language models (LLMs) really work under the hood, with a live demo that visitors can try.
Posted by @lucasov · Original comment ↗
“I am teaching myself how LLMs really really work with this tool that I am building https://modelmathics.com you can try it on https://try.modelmathics.com”