I've been using ChatGPT, Claude, and Codex for some pretty ambitious projects, and I'm starting to notice a pattern that's genuinely frustrating.
AI is incredibly good at explaining how something could theoretically work. But when I actually ask it to build something complicated, troubleshoot an unfamiliar problem, or figure out a solution that doesn't already exist, it feels like everything falls apart.
Here's what keeps happening:
Explaining instead of executing.
I ask AI to accomplish something. Instead of actively working toward it, I get paragraphs explaining how the technology works, why it's difficult, or what I could theoretically do myself.
2. Treating limitations like permanent roadblocks.
This is probably my biggest frustration.
I understand that some things are technically impossible or beyond an AI's available tools. But there's a difference between something being genuinely impossible and something requiring experimentation, research, or a new approach.
I want an AI that investigates the problem before declaring defeat.
3. Endless planning with very little actual progress.
I've worked on projects where AI agents generated documentation, scripts, development plans, and additional infrastructure for hours.
But the actual thing I wanted to accomplish still wasn't working.
It starts feeling like the AI is creating work instead of completing it.
4. Ignoring specific instructions.
I'll establish exactly how I want a project handled, including which AI handles which responsibilities.
Eventually, the agents start changing the workflow, adding unnecessary steps, or forgetting the original objective.
5. Making me do everything manually.
Part of why I use AI agents is to automate tasks.
If I'm constantly copying commands, transferring files, repeating instructions, and coordinating everything myself, what's the point of having multiple agents?
6. Losing context and repeating mistakes.
I want agents that maintain project memory, remember previous failures, understand what's already been accomplished, and continue from where they left off.
Instead, I regularly find myself explaining the same requirements again.
7. Claiming progress without proving anything works.
This one drives me crazy.
An AI can confidently report that something has been implemented, tested, or completed, only for me to discover that the actual result doesn't work.
I'd rather it admit something hasn't been verified than pretend we've made progress.
What I'm actually trying to accomplish
For context, I'm working on projects involving software development, AI coordination, PC automation, and modifying games on a jailbroken PS4.
One of my goals is to have Codex coordinate Claude through computer-use tools, with each handling tasks based on its actual capabilities.
I'm not expecting magic. I understand hardware restrictions, access limitations, and technical constraints exist.
What I want is a system that can investigate, experiment, execute, verify its work, learn from failures, and keep moving toward the original goal without constantly needing me to micromanage it.
My questions
- Are there AI agents or frameworks that are actually designed to work this way?
- How do you prevent agents from endlessly planning instead of executing?
- What's the best way to give multiple AI agents persistent project memory and clearly defined responsibilities?
- Can you make agents automatically verify their work before reporting success?
- What tools or workflows would let Codex and Claude collaborate effectively without me constantly transferring information?
- Has anyone actually built a system where AI handles most of the engineering workflow while the human focuses on objectives and decisions?
I'm looking for real solutions, not just better prompts that tell the AI to "act like an engineer."
I don't need AI to tell me something is difficult. I need it to help me figure out how to accomplish difficult things.
If you've built a reliable setup like this, I'd genuinely appreciate hearing exactly what tools you use and how your workflow operates.