Functionalization in PyTorch
January 16, 2025
Idle Speculation on GPU Capacity Management
January 12, 2025
Training large models today is tightly coupled to specific hardware. This makes moving workloads across systems or abstracting the hardware almost impossible without losing efficiency, and hence why you don’t tend to see a lot of uptake of the kind of cloud-like abstractions we see elsewhere.
TIL: weights-only model loading will be the default in PyTorch 2.6
January 8, 2025
I had missed this, but weights-only is going to be the default for torch.load in Pytorch 2.6:
Deepseek V3
January 6, 2025
TIL: torchdbg
January 2, 2025
HuatuoGPT-o1, domain specific reasoning
January 1, 2025
Thunderkittens /GPUs go brr
December 31, 2024
Just got round to reading the intro post to the (now improved) thunderkittens kernel DSL.
Generalization progress in RLHF
December 29, 2024
Ways to use torch.export
December 23, 2024
TLParse
December 22, 2024
https://github.com/ezyang/tlparse – or pip install tlparse