Free-Threaded Python community
April 17, 2025
As Thomas posted on the Python Discuss board there is a discord for discussing Free-Threaded/NoGil Python: https://discord.gg/rqgHCDqdRr
Colfax on Blackwell GEMMs
April 17, 2025
MegaScale-infer: disagg MoE inference
April 12, 2025
Pydantic Evals
April 11, 2025
Bonanza Build System
April 10, 2025
Improving Recommendation Systems with LLMs
April 5, 2025
Dynamic Shapes in PyTorch
April 4, 2025
Dynamic shapes are one of the more distinctive parts of torch.compile. Rather than specializing a graph to static shapes (which works in many cases!), PyTorch’s approach allows a single graph to work for a variety of sizes, so things like sequence length or batch size can vary. It does this by reasoning about shapes symbolically: instead of using fixed shape values, it uses placeholders and infers rules that constrain those shapes.
PyTorch and Python Free Threading
April 3, 2025
Understanding R1-Zero-Like training
April 1, 2025
Bank Conflicts in Shared Memory
March 29, 2025
When data is in the global memory on a GPU it’s usually in row-major or column-major order. Loading from global memory is quite slow though, so for performance we want to move the data to shared memory for the threads in a warp to work on.