This post is a long form essay version of a talk about PyTorch internals, that he gave at the PyTorch NYC meetup on May 14, 2019.
blog.ezyang.com/2019/05/pyto...
This post is a long form essay version of a talk about PyTorch internals, that he gave at the PyTorch NYC meetup on May 14, 2019.
blog.ezyang.com/2019/05/pyto...
Given any pytorch model, it profiles it, ranks bottlenecks by amdahl's law, writes triton or CUDA C++ replacements, and runs 300+ experiments overnight with no human in the loop.
- 5.29x over pytorch eager on rmsnorm
- 2.82x on softmax
Given any pytorch model, it profiles it, ranks bottlenecks by amdahl's law, writes triton or CUDA C++ replacements, and runs 300+ experiments overnight with no human in the loop.
- 5.29x over pytorch eager on rmsnorm
- 2.82x on softmax
A full PyTorch course (25 hours) for beginners covers the foundation of PyTorch, from processing tensor data to neural network applications such as classification, computer vision, and more.
📽️ www.youtube.com/watch?v=LyJt...
#python #datascience #MachineLearning #DeepLearning
A full PyTorch course (25 hours) for beginners covers the foundation of PyTorch, from processing tensor data to neural network applications such as classification, computer vision, and more.
📽️ www.youtube.com/watch?v=LyJt...
#python #datascience #MachineLearning #DeepLearning
fleuret.org/dlc/
And my "Little Book of Deep Learning" is available as a phone-formatted pdf (nearing 700k downloads!)
fleuret.org/lbdl/
fleuret.org/dlc/
And my "Little Book of Deep Learning" is available as a phone-formatted pdf (nearing 700k downloads!)
fleuret.org/lbdl/
1. The Ultimate Guide to PyTorch Contributions github.com/pytorch/pyto...
For pytorch core that should be the n1 item on your list.
1. The Ultimate Guide to PyTorch Contributions github.com/pytorch/pyto...
For pytorch core that should be the n1 item on your list.
pytorch 2.6 launches without conda support
pytorch.org/blog/pytorch...
pytorch 2.6 launches without conda support
pytorch.org/blog/pytorch...
"PyTorch Deprecation of Conda Nightly Builds"
dev-discuss.pytorch.org/t/pytorch-de...
"PyTorch Deprecation of Conda Nightly Builds"
dev-discuss.pytorch.org/t/pytorch-de...
soumith.ch/blog/2025-11...
soumith.ch/blog/2025-11...
elanapearl.github.io/blog/2025/th...
elanapearl.github.io/blog/2025/th...
A possible source of disagreements when porting models to pytorch! @numpy_team
A possible source of disagreements when porting models to pytorch! @numpy_team
The Hugging Face folks had some nice things to say about it as they integrated it into LeRobot.
Check it out here: github.com/pytorch/torc...
The Hugging Face folks had some nice things to say about it as they integrated it into LeRobot.
Check it out here: github.com/pytorch/torc...