r/devsecops • u/bgbe_ • 17h ago
I got tired of scanners that dump 400 findings and never prove one. So I built one that tries to exploit them live.
I've spent 10+ years in security. The pattern that wore me down is the scanner that hands you a wall of "possible" issues and leaves triage to you.
So I built a tool around one idea: a finding isn't done until it has a verdict.
- Scan: SAST, dependencies, secrets, IaC, container images, licenses. The scanner runs locally. SCA lookups send package and CVE identifiers only, never your code.
- Prove: for the classes that allow it (command injection, XSS, open redirect, boolean-blind SQLi, XXE), it fires a reviewed PoC at your running app in a sandbox. Each class was tested against a real vulnerable sink and a real negative control, to check it doesn't cry wolf.
- Fix: it patches vulnerable dependencies across 8 ecosystems and re-scans or re-exploits to confirm the fix worked.
- Scope gate: anything that sends traffic needs a human-approved scope file. Missing file means it refuses to run, so it never fails open.
Benchmarks. Scored against each app's own answer key, not by counting findings:
- On 10 deliberately vulnerable open-source apps in 5 languages, it found 92 of 167 labelled issues. A leading commercial SAST tool found 72 and GitHub CodeQL found 68.
- On OWASP BenchmarkPython it scored 58.5 against that tool's 27.5. We lose two classes there (command injection and code injection), and we flag more safe cases (15.2% false-positive rate vs 10.3%).
Caveats:
- These are training apps, not your codebase.
- We wrote rules after seeing what these apps exposed, so this is not a blind test.
- Java is our weakest language.
The most useful thing I learned is that testing the tester finds real bugs. One of my own "negative controls" turned out to be a genuine auth bug, so the harness reported a false positive. Another harness read a fully booted target as "not ready" and burned 10 minutes every run. Both are fixed.
I'm looking for people who run AppSec, or an MSP covering clients, to try it on a real repo and tell me where it's wrong. [OFFER: e.g. "free scan of one repo, DM me" or "free tier at verdictruntime.com"]
Happy to answer anything, including where it's weak. And show a demo