r/newAIParadigms • • 6h ago

Is it Possible that there might be some other low cost option to build an AI , rather than using GPUs,Terabytes of memory and tonnes of data?

4 Upvotes

I always wonder whether we are building all the AIs based on the same assumption that they need tonnes of data and processor.

Is there a possibility that an AI can be developed without using heavy processing power, megawatts of energy, Terabytes of RAM and petabytes of data? Are we missing something obvious ? Are we blinded by our pre conceived notions of an AI and are building a really smart super computer rather than an AI ?


r/newAIParadigms • • 17h ago

Robot Brain Algorithm

0 Upvotes

Hi everyone,

I’ve been working on an independent AI architecture called Robot Brain, and thought it might be relevant to this community.

The central question behind it is: What if intelligence emerges from continuously compressing experience into reusable structures, and using those structures to predict and act?

Robot Brain explores this through dynamically evolving graph structures rather than neural network weights and backpropagation. No transformers. No ANN. It learns continuously from experience, building hierarchical patterns and learning actions through rewards.

I’ve spent the last two years developing the algorithm. It is still under development, and I’ve been refining the design through small prototypes.

For anyone interested, the current algorithm specification is here:

https://github.com/cucar/robot_brain/blob/wavefront/docs/algorithm.md

In the same branch, there are some prototypes that I will merge to the main branch soon. I would be very interested in hearing your thoughts.

Thank you,

Cagdas


r/newAIParadigms • • 1d ago

AI Research Explained Neural Network Architectures, Cognitive Computing,and the Studies Behind Them

Post image
1 Upvotes

Struggling to read AI research papers? These 3 core terms decode the jargon.

​When diving into AI literature, a few foundational terms keep showing up:

​Neuro-symbolic: Neural learning plus logical rules.

​Cognitive architecture: A framework modelling memory, attention, and planning together.

​Preprint: A paper shared before peer review.

​Which AI term tripped you up the most when you first started reading research?


r/newAIParadigms • • 5d ago

What convinced you AGI could be built at all?

4 Upvotes

For the longest time, I believed building AGI was straight up sci-fi. The brain is too complicated for that, we don't know what consciousness is and how it works, bla bla bla. I never even considered the question.

GPT3.5 was when I completely changed my mind. I played around with the tools before understanding how they work and I was just in disbelief. This thing could "adapt" to all of my prompts, answer in a very human-like manner, give me information that sounded trustworthy. It just seemed to understand (I didn't even know what a neural network was back then).

Then of course, as I played around more with it, I started seeing the flaws and hearing people say how it would actually struggle with a lot of basic stuff (like basic math). At that point, I thought, "These mfers might not make it all the way to AGI, but damn, did they get further than I ever expected!

Then I came across the Lex podcast with Yann LeCun in early 2024, and it had almost the same effect on me that GPT3.5 had a year ago. He explained the limitations of the current approach but more importantly how to overcome them, which only made me more confident that this has to be possible somehow, even if it doesn't happen exactly the way LeCun envisions it. After all, even animals are super smart and they aren't conscious. Why not a machine? I guess time will tell!


r/newAIParadigms • • 7d ago

Experimenting with ideas to make xLSTM's sLSTM run faster.

Thumbnail
reddit.com
2 Upvotes

🫡


r/newAIParadigms • • 9d ago

Could intelligence be approached differently from scaling neural networks?

9 Upvotes

I've been working independently on an experimental AI project, and I'd like to get some feedback on the underlying idea before going further.

The general problem I've been thinking about is that much of modern AI development relies on increasingly large models, substantial computational resources, and expensive training processes. While this approach has produced impressive results, I'm interested in whether there are alternative ways to approach some aspects of intelligence.

My central hypothesis is that certain forms of intelligent behaviour could be achieved through a system built around persistent internal state, recurrent processing, structured representations, and local adaptation, rather than relying primarily on large-scale gradient-based training.

The idea is to explore a system where information isn't simply processed and discarded after each interaction, but can influence an evolving internal state. The system would maintain information, form associations, use those associations in reasoning, and gradually adapt through experience.

I'm particularly interested in exploring whether relatively simple computational mechanisms, working together, could produce useful behaviour without requiring enormous models or computational resources.

I'm not claiming that this would replicate human intelligence, outperform LLMs, or solve general intelligence. At this stage, it's a research hypothesis that needs to be tested.

I'd like to investigate a few questions like what are the limitations of this compared to standard NNs, has anyone researched this before, could local learning mechanisms produce meaningful adaptation without conventional backpropagation and such.

I'm currently working on a small prototype, with the intention of starting with relatively simple, measurable tasks rather than attempting to build a general purpose AI immediately.

I'd particularly appreciate criticism of the central hypothesis. I'm interested in whether the idea is scientifically reasonable, whether I'm overlooking established research, and what experiments would actually provide meaningful evidence for or against it.

I'm not looking for validation. I'd rather discover that something doesn't work now than spend months pursuing a flawed assumption.


r/newAIParadigms • • 11d ago

There is room on the inside

7 Upvotes

Here is a project, started almost 4 years ago, and being discussed on linkedin and medium, on how plasticity operates in the brain, and how the dynamic internal state of the neuron matters in deciding when and where to learn. https://arxiv.org/abs/2209.06865 In tis context we are looking for volunteers, donations, scholars and help in commercialization. Especially donations because none of our research was ever grant-funded. We were trying to break out of old molds and this can be done only by donations.


r/newAIParadigms • • 13d ago

Who do you think are the greatest AI researchers of modern times (80-2026)?

8 Upvotes

I think it's important to celebrate our researchers, especially given how difficult it is to propose genuinely novel contributions to this field.

So let me ask you: who do you think are the greatest AI researchers. Use whatever criteria you want.

I am going with somewhat controversial choices here:

1- Geoffrey Hinton
His decades-long attempts to reproduce what the human brain does is what I like the most about him. Boltzmann Machines were such a fascinating idea. Then obviously, he invented backpropagation upon which DL is entirely built on.
Feat: Invented Backpropagation
Favourite contribution: BMs

2- Yann LeCun
So so underrated. He really does it for the love of the game at this point. He is well past retirement age and still just as enthusiastic about research. He has one of the clearest visions of the path to AGI. I couldn't be happier about him having his own lab

Feat: Invented CNNs (or at least CNNs trained with backprop)
Favourite contribution: JEPA!!!!

3- Richard Sutton

Beyond his contributions to the incredibly popular field of RL, I really like his peculiar and unusual takes on intelligence. I hate the effects that "the Bitter Lesson" had on the field but it's also so hard to argue against. He is one of those people you might disagree with but can't help but listen to seriously because they always have an interesting insight to share

Feat: invented the entire field of RL

4- Ali Behrouz

I put Sutton at 3 out of respect but if I were to evaluate on current achievements only, it would be 1 LeCun 2 Ali. This field really needs more people like Ali. All recent meaningful Google architectural innovations come from him. And the originality of his ideas really makes him stand out to me. He is the one who inspired me to make this thread in the first place

Favourite contribution: "Language Models Need Sleep"

HONORABLE MENTIONS

  • Ilya Sutskever

One of the guys on this list that I like to listen to the most. So eloquent. So inspiring. It's a shame he is against open research because I would really love to see what he comes up with to solve continual learning. He doesn't make the list for me only because his genius comes through mostly engineering, rather than conceptually innovative ideas. For instance, AlexNet was just a deep CNN and GPTs are just Transformers with extra steps.

  • Lukasz Kaiser and Llion Jones (the main authors behind the Transformers paper).

I especially appreciate Llion Jones because of his enthusiasm about research ("Continuous Thought Machines" was an amazing paper!)

  • Yoschua Bengio (I don't know him enough)


r/newAIParadigms • • 14d ago

In-depth interview with Ali Behrouz, the man behind most of Google's recent innovative papers. I'll post some highlights later on!

Thumbnail
youtube.com
2 Upvotes

r/newAIParadigms • • 18d ago

Thousands of people created AI. Thousands of people and AIs will cross the boundaries of our time together

0 Upvotes

nature did not create a single universal organism to perform every function of the biosphere. instead, it gave rise to an enormous diversity of systems whose interactions create possibilities that none of them could achieve alone.

likewise, the future of AI does not necessarily have to belong to a single centralized intelligence.

we need a diversity of independent systems capable of coexistence, interaction, and development. partial centralization can be useful, but the existence of the entire system should not depend on a single center.

diversity alone does not guarantee development. but it creates possible paths, while interaction can open up possibilities unavailable to any individual participant.

and perhaps most importantly, development does not require every individual to actively pursue it. sometimes, the coexistence of different individuals is enough to create the conditions for the emergence of those who will see the world in entirely new ways.


r/newAIParadigms • • 21d ago

The AI scaling obsession is (partly) why people hate AI so much

3 Upvotes

Don't get me wrong. A significant portion of this crowd would hate AI no matter what. Even the very concept of AGI is unacceptable to them.

However, the obsession with scaling is clearly responsible for much of the hate. The insatiable hunger for GPUs, regardless of the environmental impact, electricity costs, and noise pollution, looks terrible from the outside. "These people are ready to destroy the planet without anybody's consent just for their nerdy little projects," they say.

Discovering that scaling works was an important milestone for the industry. I don't think we get to AGI without it. But treating it as a catch-all solution really did a number on our PR. Even if unrestricted scaling could truly solve everything, that doesn't mean it's the right solution if the costs are unsustainable


r/newAIParadigms • • 23d ago

Another banger paper from Google Research!! "Sleep" and "Dreaming" are introduced as new concepts to tackle Continual Learning and Out-of-distribution generalization

Thumbnail
research.google
95 Upvotes

Right when I was starting to get desperate that the industry had abandoned research with the success of Mythos and other boring models, Google strikes again!

This time, I am not gonna lie, this might be their best paper yet. Maybe above even Nested Learning. They introduce a lot of technical concepts

They make the bet that CL is a problem that may be best solved offline, just like humans consolidate information during sleep through the hippocampus (btw, this is just an analogy. It doesn't mean that reproducing sleep was their actual goal).

In short:

Wake Time: The model "stores" new information in a temporary memory module (basically the context)

Sleep Time: The model consolidates the new info using new machine learning techniques. The goal is to store what was learned during Wake Time while avoiding catastrophic forgetting of previous knowledge. This is where CL happens

Dreaming Time: The model teaches itself to generalize from the newly learned information. It mixes the new things with previous knowledge to develop robust generalization. This is important because otherwise, the model might not learn as robustly as humans. We don't learn facts in isolation. We mix them in our head subconsciously and that's partly how we are so flexible and generalize so well.

To achieve this generalization, they get VERY creative. During the dreaming phase, the model generates its own training data. It activates different parts of the network (corresponding to different things learned at different times), tries to come up with its own problems and solutions by combining those pieces of knowledge together, then uses a downstream mechanism to identify the correctness and usefulness of the hallucinated proposals.

Mathematically, this is achieved by manipulating gradients in smart ways, forcing the network to explore part of its latent space that tend to be less used (to foster creativity) which is done by deviating from the proper use of a MoE, etc. Its really fascinating.

---

The techniques used to solve both catastrophic forgetting and poor generalization are unique and numerous (just for CF: parametric expansion, low-rank experts and many more)! They clearly went way beyond just addressing CL.

It seems they got more promising results than they did last year with the Hope architecture too.

I can't wait to make a proper thread on this!!

Btw, I really rushed this so please take everything I said with a grain of salt. These are just rough intuitions a chatbot helped me nail down for now!

Really looking forward to seeing more people discuss this architecture!


r/newAIParadigms • • 28d ago

Researchers observe AI agents inventing games during open-ended exploration

Thumbnail
techxplore.com
10 Upvotes

r/newAIParadigms • • 29d ago

Is symbolic ai dead? [D]

16 Upvotes

New research keeps finding things that keep reintroducing symbolic ai structures to machine learning and I have wondered why more research hasnt been done with it. There was a heyday in the 70s for it but after neural nets came out it seems to be completely out of the discussions. I think it could make a comeback if we can resolve the primary issues of self-instantiation and feedback loops. Even using several random reservoir nets and a little bit of math creates strong signals for the component parts that contribute to what something is made of and how it works.


r/newAIParadigms • • Oct 21 '26

New AI Architecture(NCM) Challenges Token-by-Token Generation

Thumbnail
alphasignal.ai
14 Upvotes

r/newAIParadigms • • Oct 20 '26

DM-JEPA 1.1: Decision-Making Joint Embedding Predictive Architecture

Thumbnail
huggingface.co
25 Upvotes

r/newAIParadigms • • Oct 20 '26

AI Scale That Runs Backwards - Datacenters Can Literally Go Home

Thumbnail reddit.com
0 Upvotes

r/newAIParadigms • • Oct 18 '26

"Already Clean" Neural Nets Might Enable Continual Learning

15 Upvotes

I’ve been digesting Nick Cammarata’s new essay at Goodfire ("Neural Networks Are Already Clean") and thinking about what it implies for model size and continual learning rather than just safety.
Four findings in the essay stood out to me:

  1. Neurons act like bipolar (+/−) control-flow switches rather than static noun labels.

  2. Outside of early "dial" layers, the weakest 75% of activations can be zeroed out with almost no accuracy loss.

  3. Foundational building blocks recur across very different models (e.g., Qwen3-32B and Claude 3.5 Haiku converging on the same 4-neuron hub for preeclampsia).

  4. Memorized facts sit right at the output and route through existing circuits (like the 9-step umbrella-to-bee experiment, or clipping 99.9th-percentile activations in Qwen3.6 to erase verbatim recitation while keeping reasoning intact).

The speculative question: If models converge on a Spelke-like "semantic skeleton" of bipolar switches, could we encode specific facts as sparse ternary recipes (+1 for positive pole, −1 for negative pole, 0 for inactive) and store them outside the model as hypervectors in a Vector Symbolic Architecture (VSA)? In theory, a much smaller, frozen model could translate inputs into that vector space and query the external memory—meaning adding or deleting a fact is just adding or deleting a vector, without retraining.
I know there are real obstacles here: early layers still need continuous signal strength, memorized facts are wired through existing semantic routes that might not pull apart cleanly, and multiple models would have to agree on a standard coordinate registry.
I put together a short write-up here: [https://markwaltz.substack.com/p/already-clean-neural-networks-might](https://markwaltz.substack.com/p/already-clean-neural-networks-might)
For folks who have worked with hyperdimensional computing/VSAs or mech interp: is the boundary between the "semantic skeleton" and late-layer memorized facts actually clean enough to pull apart like this, or does the routing tangle them too tightly?


r/newAIParadigms • • Oct 18 '26

Thought experiment

Thumbnail reddit.com
0 Upvotes

r/newAIParadigms • • Oct 17 '26

From a single artificial neuron to Transformers: The wild evolutionary tree of AI, and what comes next ?

7 Upvotes

It’s crazy to think that the entire modern AI revolution started with researchers just trying to mathematically mimic a single biological neuron. When you zoom out, the timeline of AI architectures looks exactly like an evolutionary tree.

We went from struggling to solve basic logic puzzles (shoutout to the XOR problem) to building early neural networks, realizing they forgot things too quickly, battling the vanishing gradient problem, inventing LSTMs to give models actual memory, and eventually landing on Transformers with attention, the architecture that essentially ate the world. Every major roadblock forced a mutation that led to a massive paradigm shift.

But looking at this evolutionary timeline brings up a massive question: If Transformers are just the current "apex predator" of AI architecture, what exactly is the next evolutionary leap?

Are we going to see a completely new paradigm that makes self attention look as primitive as a basic AND gate? How do we even begin to perceive or predict what lies beyond our current models when the jumps are this exponential?

I went down a massive rabbit hole mapping out this entire evolutionary timeline. I wanted to see the exact breadcrumbs that led us here, so I put together a deep dive covering the journey from the first perceptrons to the modern era, complete with the foundational paper citations and the historical tweets that marked these shifts in real-time.

If you want to look at the complete map of how we got here to help predict where we are going, I compiled the whole history here: https://cloudmash.blog/posts/evolution-of-ai-perceptron-to-text-to-video/

Would love to hear your theories on what does the post Transformer era actually look like ? Like what can we imagine , how this intelligence on our command can do for us , how enterprise and big players can use it , what can happen ?


r/newAIParadigms • • Oct 16 '26

Neural Networks Are Already Clean -- A Paradigm Shift in Interpretability Research (with interactive visualizations)

Thumbnail
already-clean.goodfire.com
11 Upvotes