Blog
Notes and posts on language models, fine-tuning, and running smaller models well.
What fine-tuning actually changes
Fine-tuning doesn't teach a model new facts so much as it reshapes behaviour. Here's a practical way to think about what moves and what doesn't.
Why small models are getting good
Compact models keep closing the gap with the giants on narrow tasks. A short look at what's driving it and where the limits still are.