Libraries not Frameworks & Training vs Agentic loops
March 20, 2025
A couple of conversations I was in last week around agentic system design reminding me of Brandon Smith’s excellent write libraries, not frameworks post
A HBS paper on the PyTorch Foundation
March 19, 2025
Vibe Coding & Code Review
March 19, 2025
Vibe coding is trendy right now, and it’s part of a bigger shift toward AI-generated code. One of the questions I have about this, at scale, is how it will interact with code review.
Ping Pong GEMM from Scratch
March 18, 2025
Post-Training & Elicitation
March 16, 2025
Nathan Lambert of the Allen Institute writes abouttheir (very strong) Olmo 2 32B release, and the just released Gemma 3 model from Google. One of the many interesting points:
Quantization in PyTorch
March 14, 2025
Jerry Zhang recently posted a coupleof updates on the evolution of the quantization APIs in PyTorch, and the unification around TorchAO.
Performance of the tail-call interpreter in Python 3.14
March 10, 2025
Horace He’s thoughts on PyTorch
March 4, 2025
Write more kernels
February 26, 2025
The GPU Mode discord has emerged as the preeminent hub for current and aspiring GPU kernel hackers, and several of the folks there have kicked off a project to help make it easier for folks to write and benchmark them. https://gpu-mode.github.io/discord-cluster-manager/docs/intro/ goes over the idea, but it’s a series of leaderboards and runners for different kernel types so you can easily find (and beat!) the state of the art:
DeepSeek’s Flash MLA Kernel
February 25, 2025