| 1 | Nov 15, '24 | We are announcing that PyTorch will stop publishing Anaconda packages on PyTorch’s official anaconda channels. For more information, please refer to the following post on dev-discu | 12.8× | 681k | 1.4k | 295 | 318 |
| 2 | Dec 31, '22 | If you installed PyTorch-nightly on Linux between Dec. 25 and Dec. 30, uninstall it and torchtriton immediately and use the latest nightly binaries. Read the security advisory here | 9.9× | 524k | 745 | 476 | 64 |
| 3 | Mar 15, '23 | We’re excited to announce the release of PyTorch 2.0! This version includes: ⚙️ 100% backward compatible 📦 Out of the box performance 📶 Significant speed improvements Learn more | 9.1× | 485k | 2k | 580 | 106 |
| 4 | May 18, '22 | We’re excited to announce support for GPU-accelerated PyTorch training on Mac! Now you can take advantage of Apple silicon GPUs to perform ML workflows like prototyping and fine-tu | 6.5× | 0 | 3.1k | 646 | 148 |
| 5 | Nov 21, '19 | To help developers get started with PyTorch, we’re making the 'Deep Learning with PyTorch' book, written by Luca Antiga and Eli Stevens, available for free to the community: | 6.2× | 0 | 2.5k | 864 | 315 |
| 6 | Sep 25, '23 | Inside the Matrix: Use 3D to visualize matrix multiplication expressions, attention heads with real weights, and more. ⚡ Read our latest post on visualizing matrix multiplication, | 6.2× | 327k | 1.9k | 377 | 757 |
| 7 | Jul 6, '20 | The full version of the Deep Learning with PyTorch book from Luca Antiga, Eli Stevens, and Thomas Viehmann is now available! New chapters include in-depth real-world examples and p | 5.9× | 0 | 2.3k | 678 | 459 |
| 8 | Oct 17, '23 | Announcing ExecuTorch 🚀 ExecuTorch offers a compact runtime with a lightweight operator registry to cover the PyTorch ecosystem of models, and a streamlined path to execute PyTorc | 5.7× | 302k | 572 | 117 | 121 |
| 9 | Jan 19, '22 | Today marks 5 years since the public release of PyTorch! We didn't expect to come this far, but here we're🙂- 2K Contributors, 90K Projects, 3.9M lines of "import torch" on GitHub. | 5.6× | 0 | 3.2k | 424 | 60 |
| 10 | Sep 14, '21 | Want to make your inference code in PyTorch run faster? Here’s a quick thread on doing exactly that. 1. Replace _grad() with the ✨torch.inference_mode()✨ context manager. | 4.0× | 0 | 1.7k | 352 | 396 |
| 11 | Dec 2, '22 | We just introduced PyTorch 2.0 at the #PyTorchConference, introducing torch.compile! Available in the nightlies today, stable release Early March 2023. Read the full post: 🧵below! | 3.9× | 0 | 1.7k | 491 | 131 |
| 12 | Nov 30, '23 | 10x performance on LLaMa 7B, all in native PyTorch. No C++ needed. Check out our second blog post in a series on Accelerating Generative AI using Native PyTorch. 🔥 | 3.7× | 199k | 1.5k | 249 | 649 |
| 13 | Jan 25, '19 | PyTorch is now installed by default on Google Colaboratory. Go ahead and `import torch`, `import torchvision`, `import torchtext` | 3.2× | 0 | 1.5k | 434 | 31 |
| 14 | Dec 14, '23 | Understanding GPU Memory 1: Visualizing All Allocations over Time 👀 In part 1 of this series, we show how to use Memory Snapshot, the Memory Profiler, and the Reference Cycle Dete | 3.1× | 165k | 1k | 181 | 701 |
| 15 | Nov 26, '18 | Microsoft VSCode integrates deeply with PyTorch out of the box. As @aerinykim highlights: 1. It shows values inside tensors. (Left panel) 2. By simply mousing over, you can see the | 3.1× | 0 | 1.4k | 410 | 62 |
| 16 | Jul 30, '24 | Introducing torchchat 🔥 A lightweight library to run LLMs locally across mobile, desktop and laptops powered by PyTorch. Learn more: #llms #mobilellms #localai #pytorchllm #edge # | 3.0× | 160k | 856 | 178 | 343 |
| 17 | Apr 16, '24 | Announcing the alpha release of torchtune! torchtune is a PyTorch-native library for fine-tuning LLMs. It combines hackable memory-efficient fine-tuning recipes with integrations i | 2.9× | 156k | 1.4k | 288 | 436 |
| 18 | Mar 10, '21 | We're excited to release the torch.fft module in PyTorch 1.8. This module implements the same functions as NumPy’s np.fft module, but with support for accelerators, like GPUs, and | 2.8× | 0 | 1.5k | 256 | 97 |
| 19 | Mar 25, '21 | Introducing torch.profiler! New PyTorch Profiler collects both GPU and framework related info, correlates them, performs automatic detection of bottlenecks in the model, generates | 2.8× | 0 | 1.3k | 318 | 130 |
| 20 | Jan 29, '25 | PyTorch 2.6 is here! This release brings key improvements, including: 🔥 torch.compile support for Python 3.13 🔥 A new performance tuning knob: torch.compiler.set_stance 🔥 Enhanc | 2.5× | 135k | 736 | 135 | 102 |
| 21 | Jan 18, '17 | GPU Tensors, Dynamic Neural Networks and deep Python integration. Hello world! | 2.5× | 0 | 890 | 483 | 14 |
| 22 | Oct 15, '25 | PyTorch 2.9 is now available, introducing key updates to performance, portability, and the developer experience. This release includes a stable libtorch ABI for C++/CUDA extensions | 2.3× | 124k | 1.4k | 178 | 227 |
| 23 | May 17, '19 | A walkthrough of the PyTorch Internals by core developer @ezyang . It's a great resource if you want to contribute to PyTorch. | 2.3× | 0 | 953 | 290 | 154 |
| 24 | Mar 9, '21 | Introducing VISSL () - a library for reproducible, SOTA self-supervised learning for computer vision! Over 10 methods implemented, 60 pre-trained models, 15 benchmarks, and countin | 2.3× | 0 | 1k | 249 | 157 |
| 25 | Oct 16, '23 | Announcing Flash-Decoding 🚀 Flash-Decoding makes LLM decoding much faster, and in particular allows to scale to very long sequence lengths (64k+) without slowdown! Read more on ou | 2.3× | 121k | 676 | 120 | 207 |
| 26 | Jan 3, '24 | 3x faster text-to-image diffusion models, all in pure PyTorch. No C++ needed. Check out our third blog post in the series on Accelerating Generative AI using Native PyTorch. 🔥 | 2.2× | 117k | 645 | 111 | 220 |
| 27 | Mar 4, '21 | PyTorch 1.8 is here! Highlights include updates for compiler, code optimization, frontend APIs for scientific computing, large scale training for pipeline and model parallelism, an | 2.2× | 0 | 1.1k | 252 | 37 |
| 28 | Mar 28, '19 | Learn PyTorch on GPUs for free via Google Colaboratory each PyTorch tutorial now has a link to open it on Colab, where you can interactively execute and play with code. #thanksgoog | 2.2× | 0 | 1k | 272 | 78 |
| 29 | Sep 10, '20 | The full hands-on tutorials, "Building Recommender Systems with PyTorch", are now available. We show how to build deep learning recommendation system and resolve the associated int | 2.1× | 0 | 808 | 188 | 228 |
| 30 | Jan 30, '24 | PyTorch 2.2 is here 🎉 Featuring: - SDPA support of FlashAttention-2 - New ahead-of-time extension of TorchInductor - device_mesh, a new abstraction for initializing and representi | 2.0× | 108k | 974 | 179 | 108 |
| 31 | Dec 7, '18 | [v1.0] : JIT Compiler, Faster Distributed, C++ Frontend, CUDA10 Read more about the changes at As always, get the install commands on | 2.0× | 0 | 874 | 312 | 23 |
| 32 | May 1, '19 | [v1.1.0] Official TensorBoard Support, Attributes, Dicts, Lists and User-defined types in JIT / TorchScript, Improved Distributed Read more about the changes at As always, get the | 2.0× | 0 | 886 | 300 | 24 |
| 33 | Jun 15, '21 | PyTorch 1.9 is here! Highlights include improvements for: - torch.linalg, torch.special, and Complex Autograd - Mobile Interpreter - TorchElastic - The PyTorch RPC framework - APIs | 2.0× | 0 | 968 | 248 | 30 |
| 34 | May 23, '19 | torchvision 0.3.0: segmentation, detection models, new datasets, C++/CUDA operators Blog with link to tutorial, release notes: Install commands have changed, use the selector on | 1.9× | 0 | 838 | 266 | 55 |
| 35 | Aug 18, '20 | Stochastic Weight Averaging (SWA) is a simple procedure that improves generalization in deep learning over Stochastic Gradient Descent (SGD). PyTorch 1.6 now includes SWA natively. | 1.9× | 0 | 830 | 194 | 126 |
| 36 | Dec 19, '23 | Part 2️⃣: Understanding GPU Memory 🤔 In our latest post, we will use the Memory Snapshot to visualize a GPU memory leak caused by reference cycles, and then locate and remove them | 1.8× | 94k | 680 | 134 | 389 |
| 37 | Dec 12, '18 | DGL (Deep Graph Library) - Clean and efficient library to build graph neural networks including GCN, TreeLSTM and graph generative models. Includes auto-batching and other tricks f | 1.7× | 0 | 730 | 262 | 64 |
| 38 | May 2, '18 | Dear PyTorch users, We're sharing the roadmap for PyTorch 1.0: production ready PyTorch. Coming later this summer. | 1.7× | 0 | 739 | 274 | 11 |
| 39 | Nov 3, '17 | Pyro, a probabilistic programming language on top of @PyTorch from Uber AI Labs | 1.7× | 0 | 690 | 318 | 1 |
| 40 | May 3, '21 | Together with @msdev, we’ve created a PyTorch “Learn the Basics” tutorial. Familiarize yourself with PyTorch concepts and modules. Learn how to load data, build deep neural network | 1.7× | 0 | 629 | 152 | 193 |
| 41 | Jul 28, '20 | v1.6: native mixed-precision support from NVIDIA (~2x perf improvement), distributed perf improvements, new profiling tool for memory consumption, Microsoft commits to developing a | 1.6× | 0 | 754 | 226 | 32 |
| 42 | Oct 4, '23 | Announcing PyTorch 2.1 Stable Release ⚡✨ PyTorch 2.1 offers automatic dynamic shape and NumPy compilation support in torch.compile, as well as torch.distributed.checkpoint for savi | 1.6× | 86k | 569 | 127 | 41 |
| 43 | Oct 22, '20 | The team @WadhwaniAI has built a multi-task network that detects pest infestations in cotton crops. This technology is being put directly in the hands of more than 18,000 farmers a | 1.6× | 0 | 729 | 163 | 82 |
| 44 | Jul 16, '20 | Disney uses PyTorch for animated character recognition and to speed up its video processing pipeline. @DTCITechnology engineers also contributed new features to the Torchvision dom | 1.6× | 0 | 772 | 176 | 82 |
| 45 | Jan 18, '18 | Tensorboard-PyTorch plugin now includes graph visualization of your model. Live demo here: Github page: | 1.6× | 0 | 719 | 263 | 3 |
| 46 | Oct 21, '20 | PyTorch Lightning 1.0.0 is now available. This is the final stable API to train and deploy models at scale, without the boilerplate. Read more about this release below: | 1.6× | 0 | 772 | 155 | 75 |
| 47 | May 5, '20 | Today, we made usability and content improvements to PyTorch Tutorials including additional categories, a new recipe format for quickly referencing common topics, sorting using tag | 1.6× | 0 | 736 | 184 | 61 |
| 48 | Sep 10, '20 | Bolts is a new Deep Learning research and production toolbox from PyTorch Lightning. Iterate faster with pre-trained models, components, callbacks, and data sets, all modular, test | 1.5× | 0 | 662 | 186 | 99 |
| 49 | Sep 27, '24 | We’re happy to officially launch torchao, a PyTorch native library that makes models faster and smaller by leveraging low bit dtypes, quantization & sparsity. Our techniques ar | 1.5× | 80k | 638 | 115 | 208 |
| 50 | Apr 24, '24 | PyTorch 2.3 is here 😎🔥 PyTorch 2.3 offers support for user-defined Triton kernels in torch.compile, allowing for users to migrate their own Triton kernels from eager without expe | 1.5× | 80k | 719 | 121 | 93 |
| 51 | Oct 24, '18 | MaskRCNN-Benchmark: - A fast, modular reference of {Mask,Faster}RCNN - by @fvsmassa (PyTorch), optimized by Nvidia - reusable components, pre-trained models - optimized inference, | 1.5× | 0 | 648 | 222 | 46 |
| 52 | Apr 21, '20 | v1.5: autograd API for Hessians/Jacobians, C++ frontend stable and 100% parity with Python, Better performance on GPU and CPU with Tensor Format ‘channels last’, distributed.rpc st | 1.5× | 0 | 688 | 210 | 26 |
| 53 | Oct 19, '21 | ✨ Low Numerical Precision in PyTorch ✨ Most DL models are single-precision floats by default. Lower numerical precision - while reasonably maintaining accuracy - reduces: a) model | 1.5× | 0 | 662 | 129 | 128 |
| 54 | Jun 22, '20 | The Global PyTorch Summer Hackathon is back! This year, teams can compete in 3 categories: 1. Developer Tools 2. Web/Mobile applications 3. Responsible AI Development Tools Read mo | 1.4× | 0 | 611 | 190 | 69 |
| 55 | Oct 27, '20 | v1.7: CUDA 11 supported with binaries on , updated profiling/performance for RPC, TorchScript and Stack traces in the autograd profiler, support for NumPy compatible FFT via torch. | 1.4× | 0 | 724 | 174 | 17 |
| 56 | Jan 19, '18 | We are a year old :) A post looking back at our journey, the lovely community, the engineering and love. | 1.4× | 0 | 707 | 196 | 2 |
| 57 | Aug 6, '17 | PyTorch v0.2 is out: Higher order gradients, Distributed PyTorch, Broadcasting, Advanced Indexing, New Layers, more! | 1.4× | 0 | 559 | 275 | 0 |
| 58 | Apr 2, '19 | PyTorch BigGraph: a distributed system for learning large graph embeddings - up to billions of entities and trillions of edges - Sharding and Negative Sampling - WikiData embedding | 1.4× | 0 | 623 | 192 | 59 |
| 59 | May 23, '22 | Today we’d like to highlight features from functorch, a beta PyTorch library that provides JAX-inspired function transformations like vmap. () If you’re not sure what sort of cool | 1.4× | 0 | 672 | 125 | 105 |
| 60 | Oct 6, '20 | NeMo, @NVIDIA’s open-source toolkit based on #PyTorch, allows you to quickly build, train, and fine-tune conversational AI models. See how speech recognition, natural language proc | 1.4× | 0 | 568 | 173 | 113 |
| 61 | Jun 28, '20 | The Computer Vision Recipes repository by researchers at Microsoft provides examples and best practice guidelines for building CV systems. It supports classification, retrieval, tr | 1.4× | 0 | 491 | 170 | 152 |
| 62 | Feb 12, '24 | The PyTorch team is excited to share that our paper on PyTorch 2 has been accepted for presentation at ASPLOS 2024! The paper delves into the implementation of torch.compile and hi | 1.4× | 74k | 509 | 79 | 104 |
| 63 | Nov 9, '18 | Happy 3rd Birthday TensorFlow! Looking forward to competing with and complementing you over the years. #HappyBirthdayTF | 1.4× | 0 | 845 | 111 | 2 |
| 64 | Sep 29, '20 | @rstudio introduces Torch for R, an R package that allows researchers to use PyTorch functionality natively from R. No Python installation is required since torch is built directly | 1.4× | 0 | 581 | 176 | 52 |
| 65 | Apr 24, '18 | v0.4: Trade-off memory for compute, Windows support, 24 distributions with cdf, variance etc., dtypes, zero-dimensional Tensors, Tensor-Variable merge, , faster distributed, perf a | 1.3× | 0 | 523 | 210 | 4 |
| 66 | Apr 29, '19 | Stochastic Weight Averaging: a simple procedure that improves generalization over SGD at no additional cost. Can be used as a drop-in replacement for any other optimizer in PyTorch | 1.3× | 0 | 586 | 175 | 62 |
| 67 | Aug 7, '24 | Introducing FlexAttention: a new API that lets you implement diverse attention variants in just a few lines of idiomatic PyTorch code. 🔥 Check out the blog post for more details: | 1.3× | 70k | 468 | 86 | 164 |
| 68 | Jan 30, '20 | Welcome OpenAI to the PyTorch community! | 1.3× | 0 | 740 | 137 | 14 |
| 69 | Jun 10, '19 | PyTorch Hub: reducing the friction in reproducing and building-upon research - Pull models with 1 line of code, and a few more to use - Curated models. Open with Google Colab and @ | 1.3× | 0 | 541 | 216 | 31 |
| 70 | Jan 10, '24 | Do you want to adapt an LLM on your own data and domain? 🤔 Learn how to finetune a 7B parameter model on a typical consumer GPU (NVIDIA T4 16GB) with LoRA and tools from the PyTor | 1.3× | 68k | 701 | 159 | 542 |
| 71 | Oct 21, '21 | PyTorch 1.10 is here! Highlights include updates for: - CUDA Graphs APIs updates - Several frontend APIs moved to Stable - Automatic fusion in JIT Compiler support for CPU/GPUs - A | 1.3× | 0 | 614 | 153 | 30 |
| 72 | Sep 12, '22 | Today, Mark Zuckerberg announced the launch of the #PyTorchFoundation under the @LinuxFoundation & a board of @Meta @AMD @awscloud @googlecloud @Azure & @NVIDIAAI. With the | 1.3× | 0 | 599 | 151 | 25 |
| 73 | Feb 5, '20 | Hydra provides an ability to compose and override configuration from the command line and config files, helping PyTorch developers to more easily manage complex ML projects. | 1.3× | 0 | 545 | 133 | 81 |
| 74 | Dec 1, '21 | Introducing @PyTorchLive, an easy to use library of tools for creating on-device ML demos on Android and iOS. With Live, you can build a working mobile app ML demo in minutes. Lear | 1.3× | 0 | 515 | 145 | 70 |
| 75 | May 7, '19 | Universal Music Translation Network: translating music across musical instruments and styles using unsupervised training | 1.2× | 0 | 539 | 166 | 56 |
| 76 | Jun 28, '21 | This tutorial will introduce compute and data-efficient transformers and provide a step-by-step to create your own Vision Transformers. Through this guide, you'll be able to train | 1.2× | 0 | 475 | 119 | 118 |
| 77 | Apr 23, '25 | Update from the PyTorch maintainers: 2.7 is out now. 🔹 Support for NVIDIA Blackwell (CUDA 12.8) 🔹 Mega Cache 🔹 torch.compile for Function Modes 🔹 FlexAttention updates 🔹 Intel | 1.2× | 63k | 499 | 86 | 78 |
| 78 | Feb 21, '20 | Torchmeta is a collection of extensions and data loaders for few-shot learning and meta-learning. It won first place at the Global PyTorch Summer Hackathon last year. Learn more in | 1.2× | 0 | 536 | 139 | 64 |
| 79 | Mar 9, '21 | Introducing “Learn the Basics" - a guide to a complete ML workflow with detailed explanations on concepts like Tensors, DataLoaders, Transforms, and more. Thanks @sethjuarez, @subr | 1.2× | 0 | 464 | 120 | 114 |
| 80 | Oct 10, '19 | [v1.3.0] Named Tensors, iOS / Android support, Quantization, Type Promotion and more. Also available: TPU device, Detectron2, Captum for model interpretability, CrypTen for PPML re | 1.2× | 0 | 535 | 174 | 13 |
| 81 | Jan 25, '24 | RoMa: an easy-to-to-use, stable and efficient library to deal with rotations and spatial transformations in PyTorch. Read all about this PyTorch Ecosystem Tool in our latest Medium | 1.1× | 61k | 607 | 106 | 233 |
| 82 | Mar 23, '20 | Captum is a library for model interpretability. Its algorithms include integrated gradients, conductance, SmoothGrad and VarGrad, and DeepLift. Learn more: | 1.1× | 0 | 476 | 155 | 64 |
| 83 | Jun 11, '20 | Catalyst is a PyTorch framework designed for reproducibility, faster experimentation and code/ideas reusing. This blog walks through MINST classifier tutorial and compare PyTorch a | 1.1× | 0 | 517 | 104 | 96 |
| 84 | Jul 26, '18 | [v0.4.1] Spectral Norm, Adaptive Softmax, faster CPU ops, anomaly detection (NaNs, etc.), Lots of bug fixes, Python 3.7 and CUDA 9.2 support and more. Full release notes at As alwa | 1.1× | 0 | 538 | 167 | 12 |
| 85 | Nov 2, '20 | We're excited to announce our first PyTorch Developer Day starting 8 AM on November 12, 2020 PST. Learn more: #PTD2 | 1.1× | 0 | 551 | 118 | 39 |
| 86 | Jun 10, '20 | TorchServe v0.1.1 is available with new features and support for HuggingFace BERT, Waveglow, Model Zoo, SnakeViz Profiler, AWS CloudFormation Template, and Automated Integration re | 1.1× | 0 | 543 | 130 | 42 |
| 87 | Sep 29, '20 | PyTorch/XLA, a package that lets PyTorch connect to @GCPcloud TPUs and use TPU cores as devices, is now generally available. Highlights: - Support for Intra-Layer Model Parallelism | 1.1× | 0 | 502 | 136 | 31 |
| 88 | Oct 29, '21 | FX-based feature extraction is a new TorchVision utility that allows access to intermediate transformations of an input during the forward pass of a PyTorch Module. Read more below | 1.1× | 0 | 450 | 89 | 108 |
| 89 | Apr 3, '18 | PyTorch now available on @pypi $ pip install torch thanks to all the devs who worked on Warehouse -- the new PyPI infrastructure | 1.1× | 0 | 541 | 149 | 5 |
| 90 | Sep 26, '18 | Github Engineering experiments with Semantic Code Search: search for code snippets using natural language. Built on top of fastai + PyTorch, it's fully open-source Read about their | 1.1× | 0 | 467 | 155 | 30 |
| 91 | Jan 29, '24 | Happy to share an early version of float8_experimental, a library to accelerate training with float8 + torch.compile written in native PyTorch 🔥 | 1.0× | 55k | 487 | 96 | 107 |
| 92 | Sep 15, '22 | Two creators of passion projects that transformed the landscape of how we code today — Linus Torvalds and @soumithchintala meet for the first time, sharing a smile and a love for t | 1.0× | 0 | 632 | 66 | 11 |
| 93 | Jun 16, '22 | Torch-TensorRT is now an official part of the PyTorch ecosystem and now available on PyTorch GitHub and Documentation. Torch-TensorRT is a TensorRT integration for PyTorch that acc | 1.0× | 0 | 486 | 96 | 59 |
| 94 | Dec 9, '24 | vLLM Joins PyTorch Ecosystem 🎉 @vllm_project has always had a strong connection with the PyTorch project. Tight coupling with PyTorch ensures seamless compatibility and performanc | 1.0× | 53k | 705 | 102 | 153 |
| 95 | Mar 10, '22 | Announcing PyTorch 1.11, TorchData, and functorch! Highlights: - TorchData, a new library for common modular data loading primitives - functorch adds composable function transforms | 1.0× | 0 | 517 | 95 | 34 |
| 96 | Dec 14, '18 | PyTorch BERT models are now 4x faster, thanks to @nvidia | 1.0× | 0 | 512 | 116 | 22 |
| 97 | Aug 23, '20 | PyTorch Lightning V0.9 is available now featuring the final API with better data decoupling, shorter logging syntax, synchronized batchnorm, and more. Learn more: | 1.0× | 0 | 486 | 114 | 29 |
| 98 | Oct 17, '24 | PyTorch 2.5 is here 🔥 We are excited to announce the release of #PyTorch 2.5, featuring a new CuDNN backend for SDPA, regional compilation of torch.compile, & TorchInductor CP | 1.0× | 51k | 653 | 145 | 72 |
| 99 | Jun 23, '21 | PyTorch 1.9 extends PyTorch’s support for linear algebra operations with the torch.linalg module. The module has 26 operators, including every function from NumPy’s linear algebra | 0.9× | 0 | 466 | 97 | 30 |