Hey everyone,
I’ve been researching local AI hardware for a while, particularly 128GB Strix Halo mini PCs, but I’m wondering whether it’s actually worth investing several thousand dollars or if hosted models would be better for my use case.
**My main use cases:**
**Cybersecurity:** Penetration testing, red/purple teaming, vulnerability research, malware analysis, bug bounty research and security tool development.
**AI security:** Prompt injection, jailbreak research, adversarial testing and evaluating LLM vulnerabilities.
**Coding:** Building applications, Python tools, debugging and analysing large codebases.
**AI agents:** Autonomous or semi-autonomous workflows, tool calling and multi-step technical tasks.
**General AI:** Research, documentation analysis and everyday assistance.
I’d prefer open-weight models with minimal refusals for legitimate security research. Privacy and keeping sensitive data local are also important.
**Current hardware:** MacBook Pro M4 Pro with 48GB unified memory.
**Hardware I’m considering:**
Bosgame M5, Ryzen AI Max+ 395, 128GB RAM
GMKtec EVO-X2 / MINISFORUM MS-S1 Max, 128GB
NVIDIA DGX Spark / ASUS Ascent GX10
Dedicated NVIDIA or AMD GPU workstations
**Models I’m interested in:** GPT-OSS 120B, Qwen, DeepSeek, GLM and uncensored/abliterated fine-tunes.
**My main questions:**
Is local AI genuinely capable of complex cybersecurity research, coding and agentic workflows, or will hosted frontier models significantly outperform it?
Is 128GB Strix Halo a good investment, especially regarding inference speed, context length and quantisation?
Would an NVIDIA GPU setup be better due to CUDA and software compatibility?
Are local models reliable enough for coding agents, tool calling and autonomous workflows?
Would I be better off sticking with my 48GB MacBook and paying for hosted inference when needed?
—-
I’m based in Australia, where these machines cost roughly A$4,000 to A$6,000+. ($4600 specifically for the bogame m5)
I don’t mind spending the money if it genuinely improves my workflows, but I don’t want expensive hardware that ends up being less useful than a cloud subscription.
**For those running local AI for cybersecurity, coding or agents, what hardware/models are you using, and would you make the same investment again?**
Thanks!