r/claudeskills
•
u/wesam_mustafa100
•
8h ago
Skill Share Claude Code + Playwright found 15/18 bugs. The false alarms were the real problem.
Claude Code + Playwright is actually pretty good at finding bugs. In my benchmark, it caught 15/18 seeded bugs.
The catch? It also averaged 3.15 false alarms per run.
Which made me wonder: how much time am I really saving if I still have to manually verify every finding?
So I built Stillhunter, a free, open-source Claude Code plugin that:
Tests your changes in a real browser, exploring edge cases and injecting failures.
Reproduces suspected bugs more than once from scratch, keeping intermittent failures separate.
Turns confirmed bugs into reusable regression tests.
I ran a benchmark against Claude Code + Playwright (27 runs each):
| Metric | Playwright | Stillhunter |
|---|---|---|
| Bugs detected | 15/18 | 17/18 |
| False alarms/run | 3.15 | 0.41 |
| Precision | 64% | 90% |
The detection difference isn't statistically conclusive, but reducing false alarms from 3.15 to 0.41 per run is the result I'm most excited about.
GitHub (MIT): https://github.com/stillhunter/stillhunter
To try it in Claude Code:
/plugin marketplace add stillhunter/stillhunter
/plugin install stillhunter@stillhunterCurious how others deal with this. Do you manually verify bugs reported by AI agents, or have you found a reliable way to automate that too?

