Notes on AI research, engineering, and systems.
Transformers
The architecture behind modern sequence models: tokens, attention, and stacked residual blocks.
Entropy in Machine Learning
Entropy measures uncertainty, and many ML losses are built from that idea.
Linear Regression
A practical first model: fit a line, measure error, and learn what optimization is doing.