I've been working independently on an experimental AI project, and I'd like to get some feedback on the underlying idea before going further.
The general problem I've been thinking about is that much of modern AI development relies on increasingly large models, substantial computational resources, and expensive training processes. While this approach has produced impressive results, I'm interested in whether there are alternative ways to approach some aspects of intelligence.
My central hypothesis is that certain forms of intelligent behaviour could be achieved through a system built around persistent internal state, recurrent processing, structured representations, and local adaptation, rather than relying primarily on large-scale gradient-based training.
The idea is to explore a system where information isn't simply processed and discarded after each interaction, but can influence an evolving internal state. The system would maintain information, form associations, use those associations in reasoning, and gradually adapt through experience.
I'm particularly interested in exploring whether relatively simple computational mechanisms, working together, could produce useful behaviour without requiring enormous models or computational resources.
I'm not claiming that this would replicate human intelligence, outperform LLMs, or solve general intelligence. At this stage, it's a research hypothesis that needs to be tested.
I'd like to investigate a few questions like what are the limitations of this compared to standard NNs, has anyone researched this before, could local learning mechanisms produce meaningful adaptation without conventional backpropagation and such.
I'm currently working on a small prototype, with the intention of starting with relatively simple, measurable tasks rather than attempting to build a general purpose AI immediately.
I'd particularly appreciate criticism of the central hypothesis. I'm interested in whether the idea is scientifically reasonable, whether I'm overlooking established research, and what experiments would actually provide meaningful evidence for or against it.
I'm not looking for validation. I'd rather discover that something doesn't work now than spend months pursuing a flawed assumption.