r/pytorch • • Oct 04 '25

WhyTorch: visual explainer for PyTorch Functions

Thumbnail
gallery
153 Upvotes

WhyTorch is an open source website I built to explain PyTorch functions. It makes tricky functions like torch.gather and torch.scatter more intuitive by showing element-level relationships between inputs and outputs.

For any function, you can click elements in the result to see where they came from, or elements in the inputs to see how they contribute to the result to see exactly how it contributes to the result. Visually tracing tensor operations clarifies indexing, slicing, and broadcasting in ways reading that the docs can't.

Would love feedback on which PyTorch functions people most want visualized next.


r/pytorch • • Jul 22 '25

The deeper you go the worse it gets

82 Upvotes

Just a rant, been doing AI as a hobby over 3 years, switched to pytorch probably over 2 years ago. Doing alot of research type training on time series.

Im the last couple months: Had a new layer that ate Vram in the python implementation. Got a custom op going to run my own cuda which was a huge pain in the ass, but uses 1/4 the vram Bashed my head against the wall for weeks trying to get the cuda function properly fast. Like 3.5x speedup in training Got that working but then I can't run my model uncompiled on my 30 series gpu. Fight the code to get autocast to work. Then fight it to also let me turn off autocast. Run into bugs in the triton library having incorrect links and have to manually link it.

The deeper I get the more insane all the interactions get. I feel like the whole thing is ducted taped together, but maybe thats just all large code bases.


r/pytorch • • May 17 '25

Interactive Pytorch visualization package that works in notebooks with 1 line of code

Thumbnail
gallery
82 Upvotes

I have been working on an open source package "torchvista" that helps you visualize the forward pass of your Pytorch model as an interactive graph in web-based notebooks like Jupyter and Colab.

Some of the key features I wanted to add that were missing in other tools I researched were

  1. interactive visualization: including modular exploration of nested modules (by collapsing and expanding modules to hide/reveal details), dragging and zooming

  2. error tolerance: produce a partial graph even if there are failures like tensor shape mismatches, thereby making it easier to debug problems while you build models

  3. notebook support: ability to run within web-based notebooks like Jupyter and Colab

Here is the Github repo with simple instructions to use it.

And here are some interactive demos I made that you can view in the browser:

It’s still in early stages and I’d love to get your feedback!

Thank you!


r/pytorch • • Jul 07 '20

Pytorch released free book - "Deep Learning with Pytorch"

Thumbnail
pytorch.org
75 Upvotes

r/pytorch • • Apr 25 '25

LeetCode but for PyTorch & ML Challenges

65 Upvotes

Hi, I'm building LeetGPU.com, the GPU Programming Platform.

If you want to practice your PyTorch skills, manipulating tensors, optimizing operations, and just get better at practical ML, then I think you will find solving LeetGPU challenges rewarding!

We support:

  • PyTorch

  • Triton

  • CUDA

  • Free access to T4, A100, H100 GPUs

We're working on adding more ML-based challenges fast. I'm really looking forward to when we have multi-GPU problems! Just imagine training a model on a node of H100s and getting immediate feedback with a click of a button :)

You can join our discord for updates: https://discord.gg/BSd3A6VqTK


r/pytorch • • May 10 '21

I'm publishing a free course that teaches PyTorch for audio/music processing.

65 Upvotes

I’ve received numerous requests from The Sound of AI community to cover PyTorch in my tutorials.

For this reason, I’m starting a new series which will teach you PyTorch with an eye on audio and music processing!

Among other aspects of PyTorch, I’ll be covering torchaudio, the GPU-accelerated audio processing library for PyTorch.

Ready to start this cool journey with me?

Check out the course overview:

https://www.youtube.com/watch?v=gp2wZqDoJ1Y


r/pytorch • • Jun 01 '23

I Created an Advanced AI Basketball Referee

56 Upvotes

r/pytorch • • Mar 21 '25

Anyone interested in contributing to PyTorch Edge?

51 Upvotes

I can help you get started if you're interested


r/pytorch • • May 18 '22

Pytorch now available on M1 with GPU acceleration

Thumbnail
pytorch.org
49 Upvotes

r/pytorch • • Dec 02 '22

PyTorch 2.0 Announced

48 Upvotes

PyTorch 2.0 was just announced at the PyTorch Conference:

https://pytorch.org/get-started/pytorch-2.0/

See also the accompanying twitter thread: https://twitter.com/PyTorch/status/1598708792598069249


r/pytorch • • Aug 02 '24

[Library] TensorHue: a tensor visualization library (info in comments)

Thumbnail
gallery
44 Upvotes

r/pytorch • • Oct 19 '25

PyTorch C++ Samples

Post image
43 Upvotes

I’ve ported multiple models to LibTorch (PyTorch C++): YOLOv8, Flow Matching, MAE, ViT. Why C++? Production constraints, low-latency deployment, and better integration with existing C++ stacks. Repo: https://github.com/koba-jon/pytorch_cpp Looking for feedback, perf tips, and requests for additional models.


r/pytorch • • Jul 16 '24

Pytorch is much better than tensorflow.

43 Upvotes

I hate every minute i had to deal with tensorflow. Unsolvable errors, awkward errors. Thanks for anyone contributed for creation of pytorch.


r/pytorch • • Oct 11 '19

PyTorch 1.3 released

Thumbnail
pytorch.org
43 Upvotes

r/pytorch • • Apr 05 '26

I created a 66M Parameter SLM

41 Upvotes

Repo: https://github.com/aidendorian/Marcella-60M-SLM

Hey guys, I've been working on this for a while and I am kind of proud of this. Implemented things like KV Cache, RoPE, Flash Attention (with sdpa_ for prefill and normal for decode. Trained on a custom dataset of 2B Tokens. Trained my own sentencepiece tokenizer too. Used 8bit AdamW from bnb. And best part being all this was trained locally on my RTX 4050 6GB laptop GPU (4.1 GB VRAM usage), uses around 800MB VRAM during inference. /

Finetuned on Alpaca 52K for 4 epochs. The Svelte based frontend and backend is vibe-coded as i dont know anything about web dev.

Its nothing absolutely new but I'm proud of this. Would love to hear some feedback. All weights are uploaded too so you guys can try it out too.


r/pytorch • • Jul 18 '22

[News] TorchStudio 0.9.8 (IDE for PyTorch) now support PyTorch 1.12, Apple Silicon, Metal Acceleration, Fedora and brings many new features

41 Upvotes

Hi, I just released TorchStudio 0.9.8, a free open source IDE for PyTorch with several improvements based on community feedback, looking forward for your comments !

download: https://www.torchstudio.ai/download/
full changelog: https://github.com/TorchStudio/torchstudio/releases/tag/0.9.8

If you're new to TorchStudio, you'll find introductory tutorials and videos here: https://www.torchstudio.ai/tutorials/


r/pytorch • • May 26 '21

Tutorial: Pruning and Quantizing PyTorch YOLOv3 for Real-time Laptop Performance

39 Upvotes

r/pytorch • • May 30 '23

I made a package, TorchLens, that can visualize the structure of any PyTorch model and extract any intermediate activations you want in one line of code.

Thumbnail
gallery
37 Upvotes

r/pytorch • • Sep 13 '22

PyTorch strengthens its governance by joining the Linux Foundation

Thumbnail
pytorch.org
37 Upvotes

r/pytorch • • Mar 27 '21

App that lets you search docs of PyTorch, NumPy, Python, and Stack Overflow at one place

37 Upvotes

r/pytorch • • Jan 16 '20

Pytorch 1.4 released

37 Upvotes

https://pytorch.org/blog/pytorch-1-dot-4-released-and-domain-libraries-updated/

The release contains over 1,500 commits and a significant amount of effort in areas spanning existing areas like JIT, ONNX, Distributed, Performance and Eager Frontend Improvements and improvements to experimental areas like mobile and quantization. It also contains new experimental features including rpc-based model parallel distributed training and language bindings for the Java language (inference only).

PyTorch 1.4 is the last release that supports Python 2. For the C++ API, it is the last release that supports C++11: you should start migrating to Python 3 and building with C++14 to make the future transition from 1.4 to 1.5 easier.


r/pytorch • • Mar 05 '21

PyTorch 1.8 released

Thumbnail
pytorch.org
36 Upvotes

r/pytorch • • Jan 30 '20

OpenAI→PyTorch

Thumbnail
openai.com
35 Upvotes

r/pytorch • • Aug 12 '21

Nvidia Releases CUDA Python

Thumbnail
nvidia.github.io
34 Upvotes