r/deeplearning • u/PainterNo8889 • 7d ago
[Help Wanted] Testing GPU detection & TFLOPS benchmark paths (NVIDIA/AMD) for my from-scratch SLM trainer
Hi guys,
I’m a 15-year-old developer building SLM-CREATOR—an end-to-end, hardware-aware small language model trainer from scratch in Python and Rust (capped at 100M parameters). Instead of using high-level wrappers or fine-tuning existing models, I’m hand-coding the entire pipeline to learn how Transformers work under the hood.
Repo Link: github.com
Tracking Issue (#1): github.com
The catch:
I’m developing this on a CPU-only machine right now, so all of my NVIDIA (nvidia-smi), modern AMD (amd-smi), and legacy AMD (rocm-smi/rocminfo) detection and PyTorch device-mapping paths have only been tested against mock CLI outputs.
If anyone has an NVIDIA or AMD GPU (especially multi-GPU setups, laptops with hybrid graphics, or ROCm configurations) and a couple of minutes to spare, I’d hugely appreciate it if you could run the hardware detection script on real hardware and let me know if it breaks!
What it tests:
GPU Topology & Detection: Parses vendor CLI tools for architecture, VRAM, device index, and GPU name.
PyTorch Index Resolution: Sets
CUDA_DEVICE_ORDER=PCI_BUS_IDand matches vendor GPU names againsttorch.cuda.get_device_name()so multi-GPU setups target the right card.Matmul TFLOPS Benchmark: Runs a 12-second thermal warmup soak followed by timed
4096x4096multiplications (in nativebf16if supported, falling back tofp32).
How to help:
Clone the repo (
git clone https://github.com) and installrequirements.txt(with your GPU's PyTorch build).Build the Rust sizing helper (
cd sizer_core && cargo build --release).Run
pythonarchitecture.pyfrom the project root.Drop your GPU model, OS, and the terminal output (or any tracebacks) in Issue #1 or in the comments here.
1
u/Both_Moment_1274
4d ago
•
FYI, you can try pantheonsim simulator also
1
u/PainterNo8889 3d ago •
![]()
Thank you sir i was completely unaware of the tool even ai didnt tell me id match
1
u/Ok-Solution-7889 7d ago edited 7d ago •
Love seeing people build things from scratch instead of just relying on existing libraries. I genuinely love to help test it.