r/LocalAIServers • u/Fragrant-Mobile-4607 • 21m ago
Small question
Can I pair a 5060ti 8gb with an Intel pro b60? I want to be ready for the 27b version of qwen4
r/LocalAIServers • u/Fragrant-Mobile-4607 • 21m ago
Can I pair a 5060ti 8gb with an Intel pro b60? I want to be ready for the 27b version of qwen4
r/LocalAIServers • u/deebuildsthings • 3h ago
I'm from Autonomous and we’ve been building NVIDIA rigs for clients for a while. Lately, GPU prices have been making these builds harder for clients to justify.
thinking about building a dual Radeon AI PRO R9700 rig to see how it compares with our dual RTX 5090 setup for local AI since they have the same 32GB VRAM.
I know lots of folks here are running on AMD cards. How’s the experience compared with NVIDIA, especially getting both GPUs working and keeping inference stable day to day? What's your advice for starters?
r/LocalAIServers • u/sitytitan • 5h ago
Just looking for some advice on what is possble with my setup and speeds I should be gettingI know it won't be super fast tps but I was more after getting the bigger models to run.
This is my spec:
Epyc 7502p - 32 Core
Gigabyte MZ32-AR0 - 8 channel memory
512GB DDR4
1x 4070 12GB
2x 4060 16GB
quite a few implementations I see which can be confusing.
Is this build even useful now? that we have Project Maya which you can stream from the NVME drive?
Anyone have similar setups and what to expect, what software best to use
r/LocalAIServers • u/Upper-Fortune-8713 • 10h ago
I have a couple of ideas. Would it be possible to use different fingerprints at startup to log into different operating systems? Or during everyday use, could scanning a particular finger quickly launch a different app? As for the Copilot key, does anyone actually use it? Can it be remapped to do something else? This is a nimo laptop, and I couldn't find anything about this in the documentation they provided. Curious to hear what everyone thinks.
r/LocalAIServers • u/sarpino1 • 13h ago
r/LocalAIServers • u/WiseAbalone4021 • 14h ago
r/LocalAIServers • u/sgtnoodle • 17h ago
I've been putting this together the last couple months.
5950x CPU + 128GiB DDR4 3600Mhz + 2TB NVME
3x v620 32GiB running Qwen 3.8 flash next Q4 in strata, EmbeddingGemma2 in extra VRAM
rtx pro 5000 embedded blackwell 24GiB running Qwen 3.8 27B nvfp4 in ninfer
rtx 5000 embedded ada 16GiB running Gemma 4 12B, whisper large
I offset the V620s 40mm to avoid smashing the motherboard IO headers. The blackwell is connected through the chipset m.2 slot. The ada is shamefully crammed into the HDD cavity behind the motherboard, held in place by zip ties.
r/LocalAIServers • u/Outrageous_Fan7685 • 21h ago
r/LocalAIServers • u/Known_Barracuda_3977 • 1d ago
r/LocalAIServers • u/dazzou5ouh • 1d ago
r/LocalAIServers • u/Strict-Elevator9352 • 1d ago
r/LocalAIServers • u/Comfortable_Study_18 • 1d ago
r/LocalAIServers • u/AeiEyeSpry • 1d ago
r/LocalAIServers • u/ZikporxAI • 2d ago
r/LocalAIServers • u/Comfortable_Study_18 • 2d ago
r/LocalAIServers • u/BackUpBiii • 2d ago
Feel free to check it out and leave feedback! Thanks I’ll have benchmark numbers soon!
r/LocalAIServers • u/spukhafteNahewirkung • 2d ago
I’m interested in running local AI models. I have a 1 Tb NVME SSD that I was going to install Linux on. Any recommendations on a distro? I’ve been an Ubuntu guy for about 16 years.
r/LocalAIServers • u/molecular_data • 2d ago
Hi,
I am planning to get a Mac studio 256/512 for hosting LLMs for a scientific product I am building.
I work in synthetic biology and frequently get requests denied by Anthropic / OpenAI frontier. (Due to the nature of my research)
Now I am thinking to get this to be able to run a LLM locally and not send research data to a provider.
Now my question, what sort of models can you run on a 512 vs the 256? I have tried qwen 3.8 flash next on another machine and that was decent but I am kinda trying to figure out if it’s worth paying the premium for larger parameter models.
How much more intelligence/ performance do you actually get ? Is it fine to use SSD for larger than 256gb MOE models or does that make them practically useless in terms of t/s. Also what about future proofing? Any specific model recommendations ?
Would love some recommendations. Looking into strix halo 495 and dgx spark but when I add it up to 256/512gb it kinda is not a big price difference between those and the Mac.
Thanks in advance !
r/LocalAIServers • u/darklordfireape • 2d ago
r/LocalAIServers • u/PreparationLate2824 • 2d ago
I am looking into purchasing a PC for a finical firm company they are small staffed and the tasks they would request to the AI are simple, basically just reading CRMs, summarizing meeting transcripts, helping prep for future meetings based on the given data; so Id be combining their current systems some have APIs not all. Overall its fairly simple.
I am hoping to get guided towards any good prebuilds that you may think would be a suitable fit.
I was thinking 24-32Gb VRAM , 64-128 RAM and i may be using 16B gigs of Qwen.
Any good prebuilds you may know of would be awesome and extremely helpful!