r/newAIParadigms • • Jul 17 '26

Richard Sutton launches Oak Lab - "Our holy grail: A trillion-parameter agent that learns and plans in real-time with 20 watts of energy"

Post image
374 Upvotes

TLDR: The father of RL is working on an ambitious architecture, OaK, that would work with only 20 watts of energy. This feat could be accomplished through an event-driven neural net where a small part of the network is active only when a significant event occurred. OaK learns from each incoming signal (batch-size-1), eliminating the need to store large batches and reducing memory costs.

---

Richard Sutton has been talking about a grand architecture for intelligence for the past year or two, which he's labeled "OaK", short for "Options and Knowledge". It's a proposed blueprint for AGI that relies on dynamic RL where an AI learns continuously with essentially zero pretraining.

The AI would build its own concepts, those concepts would become new things to pay attention to while interacting with the world (new "Options"), and it would use those learned options to plan and improve over time.

They have 2 really ambitious goals:

  • Pure in-real time learning without hacks

Our batch-size-one learning algorithms can learn directly from experience without storing or replaying data. These algorithms, when combined with event-driven neural networks, result in systems that learn using multiple orders of magnitude less compute and energy

  • Learns from noisy data with zero curation

By learning to assign credit to parameters that generalize well, instead of assigning credit to all parameters, our methods can learn directly [and efficiently] from noisy data streams

Here is a full talk on the architecture:

Rich Sutton, The OaK Architecture: A Vision of SuperIntelligence from Experience - RLC 2025 - YouTube

Khurram Javed said that a successful prototype of OaK in the next few years would be closer to a baby learning during its first year of life than any current AI system: https://x.com/kjaved_/status/2076663868160459214

Thanks to u/Mindrust for the original thread!

---

SOURCE: https://oaklab.ai/mission


r/newAIParadigms • • Nov 22 '25

The Hope architecture: Google's 1st serious attempt at solving continual learning

277 Upvotes

TLDR: Google invented a convincing implementation of continual learning, the ability to keep learning "forever" (like humans and animals). Their architecture, Hope, is based on the idea that different parts of the brain learn different things at different speeds. This plays a huge role in our brains' neuroplasticity, and they aim to reproduce it through an idea called "nested learning".

-------

This paper has made the rounds and for good reason. It’s an original and ambitious attempt to give AI a form of continuous, adaptive learning ability, clearly inspired by biological brains' neuroplasticity (we love to see that!)

➤The fundamental idea

Biological brains are unbelievably adaptive. We don't forget as easily as AI because our brains aren't as unified as AI's. Instead, think of our memory as the sum of smaller memories. Each neuron learns different things and at different speeds. Some focus on important details, others on more global abstract stuff.

It's the same idea here!

When faced with new data, only a portion of those neurons are affected (the detail-oriented ones). The more abstract neurons take more time to be affected. Thanks to this, the model never forgets repeated global knowledge acquired in the past. It has a smooth, continuous memory ranging from milliseconds to potentially months. It's called a "continuum memory system"

➤Self-improvement over time

Furthermore, higher-level neurons contain the lower-level ones, and thus can control what those learn. They control both their speed of learning and the type of info they focus on. This is called "nested minds" (nested learning).

This gives the model the ability to also self-improve over time, as higher-level neurons influence the others to only learn interesting or surprising things (info that improves performance, for example).

➤The architecture

To test this idea, they implemented it on top of another experimental architecture they published months ago ("Titans") and called the resulting architecture "Hope". Essentially, Hope is an experiment over an experiment. Google is not afraid of experimenting, which is the best quality of an AI research organization in my opinion.

➤Results

Hope outperforms ALL current architectures (Transformers, Mamba…). However, it's still just a first attempt to solve continual Learning as the results aren't particularly earth-shattering. [Please feel free to fact-check this!]

➤Opinion

I don't care all that much about continual learning (I think there are more obvious problems to solve) but I think those guys are onto something so I will be following their efforts with lots of interest!

What I like the most about this is their speed. Instead of brushing problems aside and claiming scaling will solve everything, these guys decided to take on the current most debated flaw of current architectures in a matter of weeks! I think it makes Demis look serious when he says "we are still actively looking for 2 or more breakthroughs for AGI" (paraphrasing here).

-------
➤SOURCES

Paper: https://research.google/blog/introducing-nested-learning-a-new-ml-paradigm-for-continual-learning/

Video 1: https://www.youtube.com/watch?v=40eUFiGVeMo

Video 2: https://www.youtube.com/watch?v=Dl3Olh29_nY


r/newAIParadigms • • Feb 03 '26

Transformer Co-Inventor: "There are already architectures that have been shown in the research to work better than Transformers. But to replace such an established architecture, being better is not enough. They need to be obviously crushingly better"

262 Upvotes

TLDR: Llion Jones, one of the main contributors of the original Transformers paper, and author of the CTM architecture (a big highlight of 2025), went on a surprising rant about the downsides of the success of his former architecture.

He talks about how boring the field has become and how we force models to count fingers without addressing the underlying problem: they don't represent hands the way humans do it.

---

Key points

1- [0:0] When Transformers were introduced to the world, all those endless superficial tweaks on the previous architecture (LSTMs/RNNs) were rendered completely useless overnight

2- [03:55] Pressure of not getting their work accepted forces otherwise really talented researchers to publish safe, boring papers.

3- [04:49] There are already architectures that have been shown in the research to work better than Transformers. But to move the industry away from such an established architecture, being better is not enough. They need to be obviously, crushingly, better

4- [07:33] Transformers are universal approximators. We can always force them to do things they don't "want" to do natively, but their representations are clearly not human-like.

5- [10:04] When a system actually learns the right representation, extrapolation becomes natural. After training, simply allocating a bit more compute allows it to continue the pattern essentially indefinitely.

---

Source: https://www.youtube.com/watch?v=DtePicx_kFY


r/newAIParadigms • • Nov 08 '25

Neuroscientists uncover how the brain builds a unified reality from fragmented predictions

Thumbnail
psypost.org
233 Upvotes

TLDR: Our model of the world isn't one unified module (like one CNN or one big LLM) but different specialized cognitive modules whose outputs are combined to give the illusion of a unique reality. In particular, our World Model is composed of a State model (which focuses on the situation), an Agent model (which focuses on other people) and an Action model (which predicts what might happen next)

-------

Key passages:

A new study provides evidence that the human brain constructs our seamless experience of the world by first breaking it down into separate predictive models. These distinct models, which forecast different aspects of reality like context, people’s intentions, and potential actions, are then unified in a central hub to create our coherent, ongoing subjective experience

and

The scientists behind the new study proposed that our world model is fragmented into at least three core domains. The first is a “State” model, which represents the abstract context or situation we are in. The second is an “Agent” model, which handles our understanding of other people, their beliefs, their goals, and their perspectives. The third is an “Action” model, which predicts the flow of events and possible paths through a situation.

and

The problem with this is non-trivial. If it does have multiple modules, how can we have our experience seemingly unified? [...] In learning theories, there are distinct computations needed to form what is called a world model. We need to infer from sensory observations what state we are in (context). For e.g. if you go to a coffee shop, the state is that you’re about to get a coffee. Similarly, you need to have a frame of reference to put these states in. For instance, you want to go to the next shop but your friend had a bad experience there previously, you need to take their perspective (or frame) into account. You possibly had a plan of getting a coffee and chat, but now you’re willing to adapt a new plan (action transitions) of getting a matcha drink instead. You’re able to do all these things because various modules can coordinate their output, or predictions together


r/newAIParadigms • • Mar 13 '26

A "new" way to train neural networks could massively improve sample efficiency: Backpropagation vs. Prospective Configuration

Post image
151 Upvotes

TLDR: A group of AI researchers studied backpropagation, and their findings revealed a major problem. Backpropagation modifies the connections in networks too aggressively. First, it constantly has to overcorrect its own mistakes and wastes samples from the training set doing so. Second, it leads to catastrophic interference, where learning new information disrupts important previously acquired knowledge. Prospective configuration fixes both of these problems

---

➤The current algorithm: backpropagation

Backpropagation has been THE learning algorithm for deep learning for decades. The network makes a prediction, compares it to the correct answer and the difference is called an "error". Then the network adjusts millions of tiny knobs (the connections/weights) to reduce that error.

➤Drawback of backpropagation (and solution)

But there is a hidden problem that will be best explained through an analogy.

Imagine a robotic arm. Several screws control the wrist, the fingers, and the angle of the hand. We want the arm to reach a specific position. There are two ways to do it.

First approach:

You turn the screws one by one until the arm eventually ends up in the right place. But turning one screw often messes up what the others just did. So you keep correcting again and again (sometimes you overcorrect and make the situation worse) until you get the arm just right.

This is what backprop does. The algorithm explores the space of configurations of weights to find the one that allows the model to make the best predictions. But since the weights are interconnected to each other (more specifically, the layers are interconnected), adjusting one connection might interfere with previous adjustments.

Thus, we end up WASTING SAMPLES due to having to autocorrect on-the-fly.

Second approach:

You simply move the arm by force to the desired position, and THEN tighten the screws so that the arm stays in that position. This eliminates all this trial-and-error work of having to mess with the screws one by one until we get it where we want.

The study observes that this approach, which they call "Prospective Configuration", is implicitly used by energy-based models such as predictive coding networks and Hopfield networks.

Those models first manually adjust their internal activity. That is the output of their internal neurons i.e. what they fire. Doing so allows PConfig to "see" what is needed for the model to make the right prediction. Only then, if necessary, are the weights adjusted to keep the model stable at that state.

➤Advantages of prospective configuration

  • More sample efficient

Fewer training examples are wasted to tweak the connections of the model. The adjustments do what we want them to do on the first try, unlike backprop

  • Promising for continual learning

PConfig reduces the number of tweaks done to the model. The weights are modified only when necessary, and the changes are less pronounced than they are with backprop.

This is a serious plus for continual learning. CL is difficult because each time the weights are modified, the model risks forgetting basic facts. The new knowledge "catastrophically interferes" with existing knowledge.. Prospective configuration keeps the number of changes minimal

  • Biologically plausible

PConfig is compatible with behavior observed in diverse human and rat learning experiments.

➤Why it's still a research problem

Remember. Before modifying the weights, PConfig first has to adjust the internal activity of the network i.e. the output of all its neurons (mainly those in the middle layers). So PConfig is essentially searching for the right configuration of outputs it wants from its internal neurons and THEN figures out the weight updates necessary to make those outputs happen.

But this search is a slow optimization process based on minimizing the error ("energy") of the network. It relies on letting opposing constraints pull on the system until it settles into the correct internal state. Thus, it usually requires a lot of steps, which makes it impractical for modern GPUs.

Ideally, the best hardware for PConfig configuration would be analog hardware, especially those with innate equilibrium dynamics (springs, oscillators, etc.). They allow the model to perform the search almost instantaneously by leveraging laws of physics. Unfortunately, those systems aren't quite ready yet so we are left to get PConfig to fit on current hardware (but maybe the recent TSUs from Extropic could change this?)

---

SOURCES:

Article: https://www.nature.com/articles/s41593-023-01514-1

Video version: https://www.youtube.com/watch?v=6vrLB-G7XZc


r/newAIParadigms • • Mar 31 '26

LeWorldModel, the first breakthrough from Yann LeCun’s new lab aiming to unlock the JEPA architecture

Thumbnail
marktechpost.com
124 Upvotes

TLDR: Yann LeCun has been pushing JEPA as the next big thing in AI for the past 5 years. However, until now, this architecture has always suffered from the famous "collapse" problem where the model lazily ignores the training data completely to make its prediction job easier, thus not learning anything at all. As if to inaugurate the launch of his new research lab, LeCun elegantly addresses this persistent issue using an old mathematical idea: isotropic Gaussian distributions

---

➤Context

For the past 5 years, LeCun has been convinced that the path to AGI will go through World Models. After Deep learning in 2012, Transformers in 2017, he believes World Models will be the 3rd revolution in AI.

However, he has a particular view of WMs. That is:

  • based on deep learning (not manual rules)

  • based on simplification (where pixel-level detail is ignored)

  • learned unsupervised

➤Main hypothesis behind JEPA

The hypothesis goes as follows: to make predictions in the real world, humans make their predictions in a simplified space that is easier to manipulate (because reality is infinitely complex). For instance: to predict the trajectory of a car and successfully avoid an accident, we don't consider the literal atoms constituting the car. We just look at the car as a whole, evaluate its general motion and make a decision based on that. Details such as the color of the car or the wear marks on the door are irrelevant to the situation.

Similarly, JEPA attempts to simplify the real world and make its prediction in this "simplified reality". This is fundamental to intelligence. The field of mathematics itself, for example, is an extreme simplification of reality that has fueled the biggest advancements of our civilization.

➤The collapse problem - JEPA's achilles heel

However, JEPA is hard to train for one major reason: trivial solutions. Since the model is incentivized to simplify as much as possible, it can decide to simplify so much to the point where it ignores the input entirely. Every entity in the world is represented exactly the same way, without any attempt at trying to understand what it is actually looking at. From the pov of the model, a car, a dog and a human are exactly the same entities. This is called a collapse. Mathematically, this happens when the latent points representing cars, dogs, and cats end up "collapsed" into the same location, as if they were actually one and the same point (which they’re not supposed to be). At that point, the prediction task becomes easy but the model hasn't actually captured anything interesting from the real world. So we need to put guardrails to the process or as LeCun calls them, "regularizers".

Regularization methods force the model to limit the number of elements that can be considered the same. It can't just simplify the world to the point of considering everything to be the same entity. However, most regularizers are costly to implement, which is why JEPA architectures (such as Siamese Networks, Barlow Twins, VICReg) have struggled to gain widespread adoption.

This paper introduces a brilliant way to make up for that!

➤The simple fix

The authors force the model to learn a representation of the world that follows an "Isotropic Gaussian" shape.

Gaussian: Thanks to the Gaussian shape, the latent points are forced to have some distance between each other and avoid collapsing/merging together. Think of it as the model being incentivized to find at least some difference between the recurring concepts within its training data (mathematically, Gaussian distributions encourage variance).

Isotropic: The model is forced to evenly use the dimensions of its conceptual space (its "mind") to represent reality as much as possible. It "can't" neglect any of them. Think of it as taking advantage of its mental storage to store important features of the world. It also can't re-use two distinct dimensions to represent the same thing (so the dimensions aren't just "used", they are also pushed to encode distinct information).

This is the most elegant way of controlling how much information JEPA extracts from the real world that has been proposed to date. Only 2 regularizers are used whereas former JEPAs could rely on as many as 7, which would make the training process extremely unstable and non-reproducible.

➤Results

LeWM is much easier to train and way faster at inference compared to previous similar systems. Its planning speed is up to 48x faster than DinoWM, which held the top spot for the better part of 2025. If this is any indication of the future optimizations that will be made on JEPA, then LeCun's departure from Meta was definitely a blessing in disguise for this field.

➤Critique

A fellow Redditor here made a brilliant remark. The problem with unsupervised methods like JEPA, is that you can never be 100% sure that the model has learned meaningful information from its training data. For instance, nothing theoretically prevents LeWM from extracting useless noise to build a beautiful isotropic Gaussian representation. Nothing guarantees that those latent points are truly about cars, dogs and humans as a whole instead of, say, random marks on the car (which is totally useless for any prediction task). The debate on whether supervised learning or unsupervised learning will lead to AGI is still very much unsolved. It'll probably be a mix of both.

➤Final takeaway

JEPA is one of the most promising directions for solving the World Model piece of AGI, and seeing how much LeCun still contributes to the field in that respect while nearing retirement age, is nothing short of inspiring. Long live AMI lab!

---

SOURCES:

Article: https://www.marktechpost.com/2026/03/23/yann-lecuns-new-leworldmodel-lewm-research-targets-jepa-collapse-in-pixel-based-predictive-world-modeling/

Paper: https://arxiv.org/abs/2603.19312


r/newAIParadigms • • Sep 13 '25

New AI architecture SpikingBrain delivers promising results as an alternative to Transformers

Thumbnail
news.cgtn.com
107 Upvotes

Key passages:

Chinese researchers have developed a new AI system, SpikingBrain-1.0, that breaks from the resource-hungry Transformer architecture used by models like ChatGPT. This new model, inspired by the human brain's neural mechanisms, charts a new course for energy-efficient computing.

and

SpikingBrain-1.0 is a large-scale spiking neural network. Unlike mainstream AI that relies on ever-larger networks and data, this model allows intelligence to emerge from "spiking neurons," resulting in highly efficient training.

It achieves performance on par with many free-to-download models using only about 2 percent of the data required by competitors.

The model's efficiency is particularly evident when handling long data sequences. In one variant, SpikingBrain-1.0 showed a 26.5-fold speed-up over Transformer architectures when generating the first token from a one-million-token context.

Note: btw, a spiking neural net is a network where neurons communicate via binary spikes (1 or 0) instead of continuous values
Paper: https://arxiv.org/pdf/2509.05276


r/newAIParadigms • • Mar 26 '26

DeepMind veteran David Silver raises $1B, bets on radically new type of Reinforcement Learning to build superintelligence

Thumbnail
the-decoder.com
103 Upvotes

Key quotes:

David Silver, the British AI researcher who led the creation of AlphaGo at Google DeepMind, is raising $1 billion for his London-based startup Ineffable Intelligence.

and

Silver’s core argument is that large language models — the architecture behind ChatGPT, Claude, Gemini and every major AI system in commercial use today — are fundamentally limited. His alternative approach — reinforcement learning from experience — allows AI to teach itself from first principles through trial, error and self-play, discarding human knowledge entirely

and

Silver led the group that created AlphaGo (which defeated world Go champion Lee Sedol in 2016), AlphaZero (which mastered chess, Go and shogi from scratch without human training data) and MuZero (which learned to play Atari games without being told the rules).

and

Silver is not alone in leaving Big Tech to pursue superintelligence independently. Ilya Sutskever, former chief scientist at OpenAI, founded Safe Superintelligence in 2024 and has raised $3 billion to date. Jerry Tworek, who helped develop OpenAI’s reasoning models, recently left to found Core Automation.

The pattern is consistent: elite researchers who believe the current paradigm has limits are leaving to explore alternatives, and capital is following them at extraordinary speed.

---

OPINION

Beautifully written article but unfortunately, this is still a nothingburger. I've seen a few interviews with the guy and he doesn't seem to have presented any roadmap or fundamentally new idea. For instance, what's the difference between "normal RL" and "RL from experience"?

---

SOURCES:
1- https://europeanbusinessmagazine.com/business/british-scientist-raising-1-billion-to-build-superhuman-intelligence-in-europes-biggest-seed-round/
2- https://the-decoder.com/deepmind-veteran-david-silver-raises-1b-seed-round-to-build-superintelligence-without-llms/#silver-bets-on-reinforcement-learning-from-experience


r/newAIParadigms • • 20d ago

Another banger paper from Google Research!! "Sleep" and "Dreaming" are introduced as new concepts to tackle Continual Learning and Out-of-distribution generalization

Thumbnail
research.google
95 Upvotes

Right when I was starting to get desperate that the industry had abandoned research with the success of Mythos and other boring models, Google strikes again!

This time, I am not gonna lie, this might be their best paper yet. Maybe above even Nested Learning. They introduce a lot of technical concepts

They make the bet that CL is a problem that may be best solved offline, just like humans consolidate information during sleep through the hippocampus (btw, this is just an analogy. It doesn't mean that reproducing sleep was their actual goal).

In short:

Wake Time: The model "stores" new information in a temporary memory module (basically the context)

Sleep Time: The model consolidates the new info using new machine learning techniques. The goal is to store what was learned during Wake Time while avoiding catastrophic forgetting of previous knowledge. This is where CL happens

Dreaming Time: The model teaches itself to generalize from the newly learned information. It mixes the new things with previous knowledge to develop robust generalization. This is important because otherwise, the model might not learn as robustly as humans. We don't learn facts in isolation. We mix them in our head subconsciously and that's partly how we are so flexible and generalize so well.

To achieve this generalization, they get VERY creative. During the dreaming phase, the model generates its own training data. It activates different parts of the network (corresponding to different things learned at different times), tries to come up with its own problems and solutions by combining those pieces of knowledge together, then uses a downstream mechanism to identify the correctness and usefulness of the hallucinated proposals.

Mathematically, this is achieved by manipulating gradients in smart ways, forcing the network to explore part of its latent space that tend to be less used (to foster creativity) which is done by deviating from the proper use of a MoE, etc. Its really fascinating.

---

The techniques used to solve both catastrophic forgetting and poor generalization are unique and numerous (just for CF: parametric expansion, low-rank experts and many more)! They clearly went way beyond just addressing CL.

It seems they got more promising results than they did last year with the Hope architecture too.

I can't wait to make a proper thread on this!!

Btw, I really rushed this so please take everything I said with a grain of salt. These are just rough intuitions a chatbot helped me nail down for now!

Really looking forward to seeing more people discuss this architecture!


r/newAIParadigms • • Feb 28 '26 Bravo

Neuroscientist: The bottleneck to AGI isn’t the architecture. It’s the reward functions: a small set of innate drives that evolution wired to learned features of our world model, and that gives rise to generalization.

88 Upvotes

TLDR: What if the brain's intelligence isn't the result of some general algorithm but a support system that tells it what to learn and when to learn it? These directives ("maximize dopamine harvest", "pay attention to moving things", "avoid shameful situations") are called "reward functions" and force the cortex to generalize by steering its attention to the fundamental elements of reality.

---

The podcast from which I have taken these clips is arguably the best I've listened to, to date, regarding AI research and how neuroscience can push the field towards AGI.

The content featured in the original 2h video could easily be the focus of 3-4 threads here. It made the other podcasts I've shared until now look incredibly shallow in comparison.

If you are interested in AGI research, I absolutely recommend.

➤The components for AGI

The human brain can be divided into 4 components:

  1. The architecture (number of layers, number of hyperparameters, connections, etc.)

  2. The Learning algorithm (backprop? predictive coding?)

  3. Initialization (initial state of the brain, i.e., initial values of its parameters before any learning)

  4. The Reward signals: what the brain is incentivized to learn. Its learning biases (also called "cost functions" or "loss functions").

The point is that AI scientists have partially figured out 1 to 3, but 4 remains incredibly shallow

Note: Initialization = baked-in knowledge whereas Loss functions = learning biases. One directly encodes concepts, while the other encodes how to learn them (or facilitates their learning).

➤1st concept: omnidirectional inference

It's the ability to predict “everything from everything.” It includes:

  • predicting vision from audition, text from vision

  • predicting left from right, right form left, future from past, etc.

  • predicting how other parts of the brain will react at a given moment.

The cortex can literally decide at test time what is worth predicting. This flexibility allows the brain to detect patterns, patterns of patterns and patterns of patterns of patterns.

Proposal for AGI: train LLMs to "fill-in the blanks" instead of just the next token. Or switch to Energy-Based Models!

Note: Omnidirectional inference will be the lone focus of my thread next week.

➤2nd concept: the brain's loss functions

The brain can be divided into 2 parts:

  • The learning subsystem (cortex, amygdala...)

  • The steering subsystem (superior colliculus, hypothalamus, brainstem...)

The learning subsystem (especially cortex) is a general learner. It can learn almost any pattern. But it needs help. So its goal is to learn from the steering subsystem. The latter points out the important parts of reality: what we should learn first or pay attention to.

Without the structure imposed by the steering subsystem, even a supposedly general learning system would be incapable of understanding the world (and definitely not with human efficiency).

These signals ("loss functions") include:

pain signals, threat signals (scary voice tone, image of a lion), dopamine and shame-inducing signals.

We get them from birth and there aren't many of them. However, they act like training objectives.

The cortex builds a world model by predicting what tends to trigger those signals. At first it's pretty basic (spider → bite ). But as the brain starts to notice subtle nuances of reality, the detected causes become more and more abstract (this specific posture → bite). This is where generalization happens. The brain doesn't just literally predict the immediate triggers but even the relatively distant ones.

Proposal for AGI: Study the brain's reward circuits through a connectome

Bonus: The learning and steering subsystem's collaboration reinforces our understanding of reality recursively. As the cortex ties more abstract features of the world to triggers of the steering ss, the latter also starts to be sensitive to these abstract causes. So now, it's not just an actual threatening voice tone that's scary. It's even just the phrase "boss mad". And the cortex will attempt to avoid that situation too.

➤3rd concept: preprocessing biases

This is a continuation of the 2nd concept. Again, the cortex isn't just left on its own to "learn what it can". The other parts of the brain provides it a ton of structure and help.

First through these reward signals we are trained on during lifetime but also through preprocessing made by our eyes and other senses.

  • Our retina filters shapes, contrasts and movements

  • Our auditory system automatically decomposes sounds into frequencies

What reaches the cortex is an already well-formatted data stream. Thus, it makes sense to wonder whether some mechanism should almost be harcoded into our models to help the more general part of the network.

---

OPINION

Again, this video is a must watch and I plan to make at least another thread on it! If you are wondering, they also cover (both in AI and biology): associative memory, continual learning, attention, etc.

Everything robustly backed by science, or at least credible theories.

---

SOURCE: https://www.youtube.com/watch?v=_9V_Hbe-N1A


r/newAIParadigms • • Feb 12 '26

Ilya on the mysterious role of emotions and high-level desires in steering the brain's learning

85 Upvotes

TLDR: Ilya, legendary AI researcher and co-founder of SSI, and Dwarkesh discussed pre-training and how it used to be THE engine for generalization. With pre-training data running out, Ilya is exploring new ideas to maintain that momentum, especially those that would make machines more sample-efficient. Of all his insights, the most fascinating to me was the intuition that emotions, contrary to popular belief, may play an important role in intelligence.

------

➤HIGHLIGHTS

(1:12) 

The amount of pre-training data is very, very staggering. Yet, somehow a human being, after even 15 years with a tiny fraction of the pre-training data, they know much less but whatever they do know they know much more deeply somehow.

---

(1:46) 

I read about this person who had some kind of brain damage. So he stopped feeling any emotion. He still remained very articulate and he could solve little puzzles. But he didn't feel sad, didn't feel anger. He became somehow extremely bad at making any decisions at all. It would take him hours to decide on which socks to wear and make very bad financial decisions. What does it say about the role of our built-in emotions in making us a viable agent?

Explanation: Ilya is arguing that emotions might play a bigger role in intelligence than we previously assumed. Let’s say you face a math problem. In typical RL, solving the problem would be your end goal, i.e. your reward. But humans aren’t motivated by that alone. We can “tire out” of the reward and decide the problem isn’t worth looking into further. Our feelings of either boredom or enthusiasm act as guardrails during reasoning

--- 

(5:05) 

You could actually wonder that one possible explanation for the human sample efficiency that needs to be considered is evolution. For things like vision, hearing, and locomotion, there's a pretty strong case that evolution has given us a lot. But in language and math and coding, probably not. If people exhibit great ability, reliability, robustness, and ability to learn in a domain that really did not exist until recently, then this is more an indication that people might have just better machine learning, period.

--- 

(10:14) 

It's actually really mysterious how evolution encodes high-level desires. Let’s say you care about some social thing. It's not a low-level signal like smell. The brain needs to do a lot of processing to piece together lots of bits of information to understand what's going on socially. Somehow evolution said, "That's what you should care about."

Explanation: This is a follow-up to the emotions discussion. It’s easy to understand how biology can push us to care about low-level features and emotions. We could even reproduce that in AI (as emotions don’t seem too complicated a phenomenon). But for high-level desires like “wanting to be seen positively by society”, it’s already hard to see how that could be encoded in advance in the genome, and even harder to see why the brain would push us to care about it.

--- 

(13:11) 

If you think about the term "AGI", you will realize that a human being is not an AGI. There is definitely a foundation of skills, but a human being lacks a huge amount of knowledge. Instead, we rely on continual learning. The 15-year-olds students who are very eager, they don't know very much at all. But then you tell them: you go and be a programmer, you go and be a doctor, go and learn.

(I definitely paraphrased the last two sentences).

------

➤SOURCE: https://www.youtube.com/watch?v=aR20FWCCjAs


r/newAIParadigms • • Mar 21 '26

OpenAI researcher: "If you have 100 researchers who think the same thing, you have one researcher. Being a researcher means being slightly contrarian all the time. You want to work on something that people don't really believe in"

79 Upvotes

TLDR: OpenAI’s former research VP shares insights into how the difficulties faced while training o1, o3, and GPT-5.2 opened his eyes to the importance of continual learning. The persistent inability of coding models to "unstuck" themselves on unfamiliar problems has updated his view on RL’s sufficiency for achieving AGI. He is now leaving to pursue open-ended research and unexplored ideas for continual learning.

----

Key quotes:

1-

If you want a specific set of skills, you train reinforcement learning models and then you get them really really great at whatever you are training for. What people hesitate sometimes is how do those models generalize? How do those models perform outside of what they've been trained for? Probably not that great

2-

Fundamentally, there isn't a very good mechanism for a model to update its beliefs and its internal knowledge based on failure which is probably the biggest update on me. Unless we get models that can work themselves through difficulties and get unstuck on solving a problem, I don't think I would call it AGI

3-

Intelligence always finds a way. Intelligence works at the problem and probes it until it solves it, which the current models do not really.

4-

At a very core thing, being able to continuously train a model means being able to have the model not collapse and not go into the weird mode. It is about keeping those models on the rails and keeping the training healthy. And it's fundamentally a fragile process. It is it is a process that you have to make effort to go well.

5-

If you want to be a successful researcher, you very necessarily need to have some ability to think independently. I have a saying that if you have 100 researchers who think the same thing, you essentially have one researcher. Being a researcher means being slightly contrarian all the time because you want to work on something that is not working yet and that by default people don't really believe in.

6-

Probably the last thing I meaningfully updated on is that I don't think a static model can ever be AGI. Continual learning is a necessary element of what we are pursuing

---

SOURCE: https://www.youtube.com/watch?v=XtPZGVpbzOE


r/newAIParadigms • • Dec 06 '25 Obsessed

A quick overview of the remaining research challenges on the path to AGI

65 Upvotes

TLDR: "I" discuss what's left to figure out in AI research and the promising paths we have for each of these challenges.

---

➤CHALLENGE #1: Continual Learning

This is the ability to learn continuously and still remember the gist of previously learned information. That doesn't mean to remember EVERYTHING but key ideas (for instance, those that have been encountered over and over again).

Promising path: the "Hope" architecture from Google Research

Comment: In my opinion, this challenge is a bit similar to the problem of hierarchical learning. We want machines to learn what information is useful to remember for the future and what isn't. What detail is significant and what isn't. I feel relatively confident Google will figure this one out soon

➤CHALLENGE #2: (robust) World modeling

This is the ability to understand the physical world at a human level. That includes being able to predict the behaviour of the surrounding environment, people, physics phenomena, etc.

It doesn't have to be perfect predictions (even humans can't do that). Just good enough to allow robots to interact with and navigate the real world with the same flexibility and intelligence as humans.

Promising paths: JEPA (including DINO), Dreamer, Supersensing, PSI, RGM

Comment: This is in my opinion the hardest challenge. To put this into perspective, our world models currently fall fart short of animal-level intelligence, let alone humans (take a look at the benchmarks here and here).

That said, testing world models is very easy: if you need to RL an AI to oblivion on narrow tasks, that AI definitely doesn't possess a robust world model.

➤CHALLENGE #3: Hierarchical planning

This is the ability to learn and make use of different level of abstractions. Intelligence implies the ability to know what's important and ignore details that are irrelevant to a specific situation.

To draw a comic book, an artist doesn't plan out each page one by one in their head in advance. Instead they think abstractly "the theme will be X, the characters will act in this very general way that I havent yet fully planned out etc."

Currently, we know how to train an AI to learn one level of abstraction. We can train it to learn a high level (e.g., training it to tell if a picture's general tone is positive or negative) or a low level (literally listing what's in the image). But we don't know how to get it to:

1- learn the levels on its own (decide for itself how general or specific to be aka the amount of information to keep or discard)

2- autonomously jump from one level to another depending on the task (the same way an artist is constantly thinking about both the general direction of their work and what they are currently drawing)

Promising path: none that I am aware of

➤CHALLENGE #4: Reasoning / System 2 thinking

This challenge has an even bigger problem than the other ones: we don't even agree on its definition. A popular definition is the ability for meta thinking ("thinking about thinking, conscious thinking, etc."). It seems to include elements of consciousness.

I personally prefer the definition from LeCun: the ability to explore a set of action to find a good sequence to fulfill a particular goal. He frames it essentially as a search process and it's quite easy to design such process with deep learning.

For both definitions, it is agreed upon that reasoning is a slow, methodical process to achieve a particular objective

Promising path: none if your definition is mystical, already solved if it's the LLM or LeCun one (look up DINO WM)

Comment: Personally I think reasoning is simply a longer thinking process. Current models struggle even for instantaneous intuition (e.g., making an immediate prediction of what should happen next at a given point in the real world). Reasonning to me is just an extension of that.

CHALLENGE #5: Self-defining goals

This is the ability to come up with arbitrary goals (essentially, decide what problem is worth solving). We can hardcode goals in AI but we can't teach AI to set up its own goals.

You could argue humans may have some hardcoded in them that's hard to see and that we don't truly define what we care about. But even then we don't know the kind of goal we should give AI to display the same level of intelligence

This is often presented as a very mystical concepts, even worse than reasoning/system 2 thinking.

Promising path: none

Comment: I think and hope this won't be needed for AGI. In my opinion, hardcoding goals into AI isn't necessarily an unwanted issue (maybe the opposite!). What matters is whether or not the AI can achieve that goal. The intelligence is in the execution, not the destination

➤CONCLUSION

These are the capabilities we still need to figure out for AGI, at least according to many experts. Among them, continual learning, world modeling, and hierarchical planning are, in my opinion, the most important. I don't think timelines mean much when it's about research but if I had to give one it would be:

  • continual learning - 5 years (2030)

  • hierarchical planning - 10 years (2035)

  • world modeling - 20 years (2045)

(all based on ... vibes !)

---

➤FULL VIDEO: https://www.youtube.com/watch?v=3yEQaHvQxlE


r/newAIParadigms • • May 16 '26

What if neurons are only the surface of intelligence? Joscha Bach thinks neuroscience is still missing where most brain computation happens

63 Upvotes

TLDR: According to Joscha, neuroscience is discovering more and more ways intelligence could be "stored" inside a network, and the electric signals sent between neurons could only be one part of the story. Recent evidence? Glial cells.

---

➤The Current Understanding

In this day and age, the fundamental structure of the brain is very well known. There are neurons, exchanging information through synaptic signals, and the whole system is known as a network.

Each neuron picks up on patterns of reality, and shares them with the other ones in order to allow us to build a complete model of the world, which is then constantly updated in accordance with new information provided by our senses.

As our model of the world changes in real time, the invariants i.e. the knowledge that remains constant get crystallized and baked into the connections between neurons (known as "weights"). This is long-term memory.

➤Are We Too Obsessed With Neurons?

Here is the problem: most contributions to the field have always centered around either the immediate information exchange (the firing patterns) or the more durable long-term neural connections. The other fundamental parts of the brain have largely been ignored.

But what if there was more to intelligence than those electric signals exchanged between neurons? Or if traditional neurons themselves were only one part of the story?

➤The Evidence

Joscha Bach bases his claim on 4 reasons:

1- Neuroscience has recently discovered new roles for glial cells, which unlike what was previously assumed, do play an important part in information processing

2- Recent studies have suggested that RNA could be an overlooked support for memory

3- We essentially recreated a worm brain in a computer and we still don't get anything close to worm-like behaviour

4- While transforming into a butterfly, the caterpillar’s nervous system is almost completely dissolved and totally reorganized in a way that the structure of the network (the neurons, firing patterns, and interconnections) seems largely destroyed. Yet the butterfly still remembers many learned behaviors from its childhood as a caterpillar.

It is hard to see how its memory or intelligence could come entirely from the traditional view of neural nets when such a network has essentially been wiped out.

➤How Big Such a Hypothesis Could Be

Joscha Bach compares the electric signals exchanged between our neurons to the antennas used by our civilization: they help us share information over long distances but intercepting those signals wouldn't allow an alien to understand human civilization. They would be missing the real source of information: nature and actual humans, which is far more significant.

What do you think?

---

OPINION

I think Joscha points out something truly fascinating here: the possibility that we may not have even fully mapped out all the important components of the brain yet. If intelligence is also hidden inside the neural cells, then all bets are off. But I personally remain skeptical that the things happening outside of the traditional network, or even inside (through the RNA) are that essential (Adam Marblestone explains why here)

Btw this would contradict Adam and his connectome project (to map out all the neural circuits of the human brain) so I kinda hope Joscha is wrong lol

SOURCE

https://www.youtube.com/watch?v=CzjWGkXlK8k


r/newAIParadigms • • Nov 02 '25

Probabilistic AI chip claims 10,000x efficiency boost. Quantum-style revolution (with real results this time) or just hype?

63 Upvotes

TLDR: Researchers have built a new kind of chip that uses probabilistic bits (“pbits”) instead of regular fixed ones. These pbits alternate between 0 and 1 depending on chance, which makes them perfect for running chance-based algorithms like neural networks. The efficiency gains seem MASSIVE. Thoughts?

-------

➤Overview

I highly recommend you guys watch the video attached to this post and read the technical deep-dive researchers at Extropic published about their allegedly revolutionary hardware for AI.

Apparently, it's a completely new type of hardware that is inherently probabilistic. Neural networks are probabilistic systems and, from what I understand, forcing them onto deterministic hardware (based on fixed 0s and 1s) leads to a significant loss of efficiency. Another issue is that currently a lot of energy is wasted by computers trying to mathematically simulate the randomness that neural networks need.

Here, they invented chips that use a new type of computational unit called "pbits" (probabilistic bits), which alternate between 0s and 1s based on chance. To do so, their chips make use of actual noise in their surroundings to create true randomness, without having to go through complicated math calculations.

➤Results

According to them, this approach provides such a significant efficiency boost to AI computation (up to 10,000x) that they are betting this is the future of AI hardware. They also mentioned how their AI chip is tailor-made even for known computationally expensive neural networks like "Energy-Based Models", which is very exciting considering how LeCun pushes them as the future of World Models.

I would like to have the opinion of smarter people than me on this because I am pretty sold on their seriousness. They have detailed how everything works and are even planning to open source it! This could also just be sophisticated hype, though, which is why I would love to get a second opinion!

-------

Technical overview: https://extropic.ai/writing/tsu-101-an-entirely-new-type-of-computing-hardware

Video: https://www.youtube.com/watch?v=Y28JQzS6TlE


r/newAIParadigms • • Aug 24 '25

Fascinating debate between deep learning and symbolic AI proponents: LeCun vs Kahneman

61 Upvotes

TLDR: In this clip, LeCun and Kahneman debate the best path to AGI between deep learning vs. symbolic AI. Despite their disagreements, they engage in a nuanced conversation, where they go as far as to reflect on the very nature of symbolic reasoning and use animals as case studies. Spoiler: LeCun believes symbolic representations can naturally emerge from deep learning.

-----

As some of you already know, LeCun is a big proponent of deep learning and famously not a fan of symbolic AI. The late Daniel Kahneman was the opposite of that! (at least based on this interview). He believed in more symbolic approaches, where concepts are explicitly defined by human engineers (the Bayesian approaches they discuss in the video are very similar to symbolic AI, except they also incorporate probabilities)

Both made a lot of fascinating points, though LeCun kinda dominated the conversation for better or worse.

➤HIGHLIGHTS

Here are the quotes that caught my attention (be careful, some quotes are slightly reworded for clarity purposes):

(2:08) Daniel says "Symbols are related to language thus animals don't have symbolic reasoning the way humans do"

Thoughts: His point is that since animals don't really have an elaborate and consistent language system, we should assume they can't manipulate symbols because symbols are tied to language

--

(3:15) LeCun says "If by symbols, we mean the ability to form discrete categories then animals can also manipulate symbols. They can clearly tell categories apart"

Thoughts: Many symbolists are symbolists because they see the importance of being able to manipulate discrete entities or categories. However, tons of experiments show that animals can absolutely tell categories apart. For instance, they can tell their own species apart from the other ones.

Thus, Lecun believes that animals have a notion of discreteness, implying that discreteness can emerge from a neural network

--

(3:44) LeCun says "Discrete representations such as categories, symbols and language are important because they make memory more efficient. They also make communication more effective because they tend to be noise resistant"

Thoughts: The part between 3:44 and 9:13 is really fascinating, although a bit unrelated to the overall discussion! LeCun is saying that discretization is important for humans and potentially animals because it's easier to mentally store discrete entities than continuous ones. It's easier to store the number 3 than the number 3.0000001.

It also makes communication easier for humans because having a finite number of discrete entities helps to avoid confusion. Even when someone mispronounces a word, we are able to retrieve what they meant because the number of possibilities is relatively few.

--

(9:41) LeCun says "Discrete concepts are learned"

Thoughts: between 10:14-11:49, LeCun explains how in bayesian approaches (to simplify, think of them as a kind of symbolic AI), concepts are hardwired by engineers which is a big contrast to real life where even discrete concepts are often learned. He is pointing out the need for AI systems to learn concepts on their own, even the discrete ones

--

(11:55) LeCun says "If a system is to learn and manipulate discrete symbols, and learning requires things to be continuous, how do you make those 2 things compatible with each other?"

Thoughts: It's widely accepted that learning is better done in continuous spaces. It's very hard to design a system that autonomously learns concepts such that the system is explicitly discrete (meaning it uses symbols or categories explicitly provided by humans).

LeCun is saying that if we want systems to learn even discrete concepts on their own, they must have a continuous structure (i.e. they must be based on deep learning). He essentially believes that it's easier to make discreteness (symbols or categories) emerge from a continuous space than it is to make it emerge from a discrete system.

--

(12:19) LeCun says "We are giving too much importance to symbolic reasoning. Most of human reasoning is about simulation. Thinking is about predicting how things will behave or to mentally simulate the result of some manipulations"

Thoughts: In AI we often emphasize the need to build systems capable of reasoning symbolically. Part of it is related to math, as we believe that it is the ultimate feat of human intelligence.

LeCun is arguing that it is a mistake. What allows humans to come up with complicated systems like mathematics is a thought process that is much more about simulation rather than symbols. Symbolic reasoning is a byproduct of our amazing abilities to understand the dynamics of the world and mentally simulate scenarios in our mind.

Even when we are doing math, the kind of reasoning we do isn't just limited to symbols or language. I don't want to say too much on this because I have a personal thread coming about this that I've been working on for more than a month!

---

➤PERSONAL REMARKS

It was a very productive conversation imo. They went through fascinating examples on human and animal cognition and both of them displayed a lot of expertise in intelligence. Even in the segments I kept, I had to cut a lot of interesting fun facts and ramblings so I recommend watching the full thing!

Note: I found out that Kahneman had passed away when I looked him up to check the spelling of his name. RIP to a legend!

Full video: https://www.youtube.com/watch?v=oy9FhisFTmI


r/newAIParadigms • • Apr 24 '26

Another look at "Symbolic Descent", the unusual algorithm at the core of François Chollet’s vision for AGI

59 Upvotes

TLDR: François Chollet has been, to date, the most credible advocate for Neurosymbolic AI, with a lab dedicated to proving its potential for AGI research. Here, he further clarifies his "Symbolic descent" idea (also known as Program Synthesis), and why it could be more sample-efficient than even the human brain!

---

➤Chollet's vision for AGI

Chollet is exploring a completely different path to AGI, based on a reinvented version of Machine Learning. He aims for "optimal AI", which he believes to be fundamentally superior to human intelligence, both in quality and efficiency.

The core of his vision is "program synthesis", a mechanism through which AI could build concise and efficient models of how the world works.

➤Turning a continuous reality into simple pieces

Symbolic descent (also called "program synthesis") works by "cutting" the world into discrete entities in order to best explain a task or observation. For instance, separating a cooking session or recipe into well-defined steps.

Instead of memorizing an infinite number of continuous patterns (the millisecond-by-millisecond muscle movements while cooking), the system looks for the underlying process that generated them. That process is a set of discrete steps, actions or objects like "mixing", "baking" or "ingredients".

➤Why simple representations matter

These discrete elements along with their relationships, form a much simpler model than the true chaotic real-life experience. It also leads to better generalization. According to the Minimum Description Length principle, a simple solution always generalizes better than a messy one.

Chollet's bet is that discretizing the world is a fundamentally more powerful approach to make sense of it than fitting those complicated deep learning curves on data. Said otherwise, he aims to replace the popular "input → complicated curve → output" pipeline with "input → symbolic model → output".

➤The architecture

Chollet's AI features two parts:

  • a "fluid intelligence" module (partly symbolic)

  • a knowledge base (entirely learned)

Analogy: AlphaGo used Monte Carlo Tree Search (symbolic model) to reason but applied to an ever-growing library of game experience.

This is not just naive Symbolic AI: the symbolic model would at least partially be learned, not handcrafted by humans. And being symbolic, it would also be far more sample-efficient than neural network-based systems (including the human brain).

➤A new form of reasoning

The fluid intelligence module's input would be the discrete elements automatically extracted by the system from the problem at hand (e.g. steps, actions, objects...). Then, to reason, it would perform a search over the space of possible combinations of those until it lands on one that accurately describes the situation.

Think of how to predict the position of Jupiter, astrophysicists sifted through a gigantic number of variables (mass, density, temperature, shape, velocity, ...) until they landed on this reduced, simple combination: position = f(initial_position) + f(velocity).

Similarly, this AI would autonomously extract various discrete variables about a given task (like cooking, chess or a math problem), reduce them to the most relevant ones and find the right way to combine them.

➤Handling computational complexity

This search process faces a major challenge: combinatorial explosion. For n variables, the number of possible combinations for a given problem is "n!" (which is worse than exponential!). To drastically reduce the search space, the AI would leverage messy curve fitting (i.e deep learning) to instruct the model on the most promising locations of the problem space to look at.

A chess player for example, doesn't literally try all possible moves in their head. They use their messy intuition built from previous games to guide their attention during reasoning. A cook doesn't take random actions: their choices are conditioned by life experience.

Chollet's AGI architecture is essentially an ambitious attempt to merge the symbolic and deep learning paradigms.

---

OPINION

According to Chollet, his lab has started getting "good results" with this approach 6 months ago. However, I will remain skeptical until an actual paper is available. It's hard for me to see how Symbolic AI plays any role in the future of this field, even though Chollet's enthusiasm for this "revamped version of Machine Learning" is intriguing. On the bright side, this is the only "Neurosymbolic" advocate that I have seen with a somewhat coherent vision

MORE: If you want a more in-depth presentation of his ideas, this clip I posted a few months ago is fantastic: [Analysis] Deep dive into Chollet’s plan for AGI

SOURCE: https://www.youtube.com/watch?v=k2ZLQC8P7dc


r/newAIParadigms • • Oct 04 '25

The PSI World Model, explained by its creators

55 Upvotes

I recently made a post analyzing the PSI World Model based on my understanding of it.

However, of course, nothing beats the point of view of the creators! In particular, I found this video extremely well presented for how abstract the featured concepts are. The visuals and animations alone make this worth a watch!

At the very least, I hope this convinces you to read the paper!

FULL VIDEO: https://www.youtube.com/watch?v=qKwqq8_aHVQ

PAPER: https://arxiv.org/abs/2509.09737


r/newAIParadigms • • Mar 07 '26

[Part 2] The brain's prediction engine is omnidirectional — A case for Energy-Based Models as the future of AI

53 Upvotes

TLDR: The path for AI to understand complex sensory data like video at a human-level may be one that the field is familiar with but underexplored: Energy-Based Models. They extract information in all kinds of directions simultaneously (left pixel → right px, right px → left px..), which makes them perfect for data with chaotic relationships like video. In the brain, this is called “Omnidirectional inference”.

------

As promised, the thread this week will focus on the "omnidirectional inference" concept covered in last week's podcast. Good news: we have a much clearer idea on how we could implement it in AI (compared to reward functions)

➤What is Omnidirectional inference?

The brain receives a lot of input at any given moment: text, vision and auditory stimuli, and signals from all over the body (blood pressure, heart rate, stress hormones, etc.). To understand the world, it has to capture the relationships between all those inputs, in both a deep and flexible way:

  • predict vision from audition (someone shouts "tiger" and I picture what the tiger looks like) / text from vision

  • predict stress from vision ("before seeing her, I already know auntie will raise my stress level")

  • predict cause from consequence, consequence from cause / up from down,  down from up

In contrast, LLMs can only predict in one direction: left to right (previous tokens → next token). In theory, omnidirectional inference is exponential. In practice, the brain is obviously limited and doesn't actually capture everything.

➤Advantages of Omni inference

1- Much better representations (of text and images)

LLMs only know relationships between words going from left to right. Remember that story about how earlier LLMs would learn that x = y but couldn’t infer the obvious reverse (y = x)? This is why!

2- More robust

With LLMs, errors are more costly. Since they can only predict from left to right, one error affects all subsequent predictions. They have tunnel vision.

3- More flexible

Text is mostly sequential and one-directional (left → right). But some information requires reading backward (or another specific order) or comparing words from specific positions. An omnidirectional system can, in parallel: read from left to right (→), right to left (←), compare 2 words in the middle with 3 at the end, and do all that before choosing a single word.

Note: In practice, these advantages don’t matter that much for text. Post-training and CoT mostly make up for them. It becomes a real problem for data that is highly non-local and continuous (like video, where the relationships are a lot more chaotic).

➤How the brain solves problems

We are born with a bunch of priors (z1, z2, z3...) on what the world should be like. When faced with an observation x, the brain tries to "explain" it by matching it to one of its priors. "Is this orange-black stripe (x) from a tiger (z1), a cat (z2) or a shirt (z3)?". This informs us of the best action/reaction to adopt when facing that situation: "I should flee (action 1), get closer (a2) or take a photo (a3)".

However, in practice, the number of possibilities to sift through is virtually infinite. So, there are 2 solutions:

  • Sampling

"Is the cause X? No. Maybe Y then? Not satisfactory. "

We keep going like this until we land on something satisfying enough (even if it's not THE explanation). Many researchers consider this as “reasoning” or “true inference”.

*Drawback: sampling is slow

  • Amortization

When faced with a piece of information, the brain also has instantaneous reactions. It is not always thinking deeply about everything. Perception in particular tends to work instantaneously. This means the brain has learned over time to associate some inputs directly with a likely cause, without any additional thinking.

*Drawback: Amortization is often very approximate. It’s often the equivalent of taking wild guesses which can turn out completely wrong. To do this, the brain (and especially LLMs) has to encode assumptions into the network

➤Why the future could lie in Energy-Based Models

LLMs are based on amortization. The models learn a direct function that maps input (context window) to a specific output. Some techniques, like Chain of Thought ("Test-Time Compute"), allow the model to explore different possibilities but it doesn't really explicitly start with priors and sift through them to determine an appropriate action or reaction.

BERT-style LLMs (those trained to “fill-in-the-blanks” instead of predicting the next token) are more flexible but remain limited. They can’t literally fill all possible blanks, just the ones they were trained to do during training.

This is where EBMs come in [also known as "Probabilistic AI" or "Bayesian networks"]. Given variables x, y, z (which represent the causes we are interested in), they assign a score to each of them depending on their likelihood of being the true cause. They start with an initial crappy guess and use gradient descent to search for the cause with the lowest possible score. This allows the model to explore the space of possible explanations with as much flexibility as desired.

The problem with EBMs is that they don't scale nearly as well as amortization-based architectures, so this is still an ongoing research problem.

➤OPINION

We probably need an architecture that can do both: sometimes converge directly to a solution, sometimes engage in longer searches.

------

SOURCE: https://www.youtube.com/watch?v=_9V_Hbe-N1A


r/newAIParadigms • • Jun 28 '26

Introducing ReSU as a new learning algorithm, and why flies are becoming the new mice of AI research

Post image
50 Upvotes

TLDR: Can local learning rules ever compete with global ones like backpropagation? ReSU shows that with the right algorithm, they can learn equally rich and complex concepts from training data. Here, the secret sauce of ReSU neurons is to extract patterns predictive of the future within their own input!

---

➤Introduction: a few fly anecdotes

Recently, flies have been at the center of major AI feats. A few months ago, some researchers managed to build a credible simulation using real fly neurons. The virtual fly remarkably exhibited many typical fly behavior within the simulated environment.

Now, a few weeks ago, another team introduced a new learning algorithm inspired by the fly's visual system. The limited complexity of the fly's brain explains why it's such a fantastic study object for neuroscience and AI, and why it is essentially the new mouse of AI research.

➤Why do we need a new learning algorithm?

While the backpropagation algorithm has been the biggest driver of progress in AI, it is also a bit of an unsatisfactory solution. To fit in the brain, it requires the presence of a global mechanism that computes an error signal and tells every single one of our neurons how to update themselves to improve the global score. But the brain doesn't work this way. It is a very local, decentralized system that doesn't leave room for a global coordinator like that.

It's not just a matter of being biologically plausible for the sake of it. It is also hypothesized that having the right learning algorithm could make AI more sample efficient. Backprop is so inefficient, that sometimes it "wastes samples" accidentally.

➤Overview of ReSU

As already said, ReSU is a new learning algorithm: a new way to teach things to models using training data. In this architecture, neurons learn by themselves. They tweak their weights on their own, without waiting for the directives of some global loss score.

But what criteria are used to make those tweaks? ReSU neurons are constantly trying to find patterns within their own input. More specifically, they try to find patterns predictive of the future. Instead of optimizing for a global loss (like backprop) or for a local loss (like predictive coding), they are looking for temporal patterns. Taking different signals as input, they try to find the combination of those signals that is the most predictive of future incoming signals. The weight updates decisions are very time-oriented.

➤ReSU in detail

What does it mean to find "a pattern predictive of the future"?

There are two cases:

  • A neuron receives a single signal

In such case, the neuron tries to model how this pixel behaves over time. It looks for temporal behaviors. For instance, "this pixel goes from black to white with this specific rhythm"

  • A neuron receives multiple signals (from different other neurons)

In such case, the neuron tries to capture the right combination of those signals that is the most predictive of the future (in fact, in this paper, the 2nd most predictive combinations is also kept, but let's ignore that). In both cases, the neuron's incoming local signal(s) is the only feedback used to modify its weights on the fly.

➤The math "breakthrough" behind it all

Neurons update themselves thanks to a mathematical operation called "CCA". At each time step, the neuron receives some signal. After an arbitrary number of those steps, the neuron splits them into two subgroups: the "past" and the "future" (in reality, the entire input comes from the past since it's not possible to see the future).

Finally, a comparison is performed between those two groups to find some linear relationships. That comparison is CCA. According to the team behind this paper, CCA will always find the most informative linear relationships possible (no other technique can do better)

However, if it was just that, this architecture would be very limited because CCA can only find linear relationships within the input. So after CCA, non-linearity is introduced by using a variant of ReLU, the most famous mathematical operation used by modern AI. If the relationship found by CCA is positive (meaning that the signals received by the neuron behave similarly), then the neuron outputs a number capturing the strength of that relationship. Otherwise it outputs zero.

In summary, ReSU = CCA + ReLU (roughly).

➤Adding some biological insight

In standard neural networks, each neuron is expected to find a specific pattern within the training data, and by combining billions of them, the model develops complex representations. But, biological neurons, or at least the fly ones, differ a little bit. Many sensory neurons come in pair: one is tasked with detecting a pattern, while the other is specifically designed by nature to detect the opposite pattern (or the absence of the former pattern)! You can think of them as positive vs negative neurons.

ReSU does the same thing! Instead of naively implementing standard ReLU, it implements two versions of it: ON-ReLU and OFF-ReLU. One activates itself when CCA detects a positive relationship, while the other activates itself when CCA detects a negative relationship.

This is particularly useful for binary pieces of information: a pixel can either be present (white) or absent (black), a movement can either go from right to left or left to right, etc. Modern AI makes the bet that with enough neurons, all of those nuances can still be captured by the network but ReSU implements them explicitly.

➤Biology validates ReSU!

By analyzing the "firing" patterns of ReSU neurons, researchers discovered something remarkable: they act very similarly with real fly neurons!

This was not reverse-engineered. It happened organically! By implementing ReSU, the artifical neurons in this architecture present the same activity patterns as the L1, L2 and L3 neurons found within a fly's brain. And not only was this observable with the firing patterns but also with the weights: ReSU neurons tend to give importance to the same sensory information and listen to the same other neighboring neurons, as real-life fly neurons do.

This is a very rare instance where biology directly validâtes researchers' intuition

➤Is ReSU's learning steerable? Where is supervision?

Intuitively, since neurons tweak their weights on their own and only focus on their own input, it almost seems like they just learn whatever they want to learn without any supervision whatsoever! That's what the global loss was for afterall. How can we be sure that the network is actually learning what we want it to learn?

ReSU is a huge bet on self-supervised learning (learning without supervision). The network isn't designed to learn one task in particular, but to develop a general enough representation of a domain, so that such a representation can work for any task of said domain. The hope is that the model extracts as much informative feature from training data as possible.

If ReSU, or a ReSU-like idea turns out to be the right way to build intelligent models in the future, then ReSU would serve as the self-supervised learning phase, while a subsequent fine-tuning phase would provide explicit supervision (though for now, the compatibility between these 2 steps hasn't been figured out).

➤Emergence of useful complex representations

Local learning algorithms have always hit the same wall: learning useful complex representations. This is another consequence of the lack of supervision.

Since local learning algs do not rely on a global loss, the 1st layer of the network is prone to learning useless stuff that the subsequent layers build on, dooming the entire chain of representation. Thus the entire hierarchical representation learned by the network can be completely useless. Backprop avoids this because the 1st layer is always kept in check with the global loss score

The team behind ReSU is making another bet here: that by extracting features predictive of the future, the network will inherently learn useful information. The learning rule of the neurons themselves is the supervision here, at least until a potential fine-tuning phase is added.

OPINION

This paper is interesting for many reasons. First, they leveraged biology in a very unusual way. The biological details they went to is a level that AI researchers usually don't touch, and it is very impressive.

Second, they confronted a problem that at least to my knowledge, proponents of local learning algorithms usually don't explicitly acknowledge: making sure that the model learns useful hierarchical representations. I never knew why exactly something like predictive coding still isn't widely adopted by the AI community (outside of "backprop already works"). Now I know.

In general, the sheer amount of work that went into this paper deserves a lot of respect

SOURCES: 
Paper: https://arxiv.org/abs/2512.23146
Thumbnail: https://neurosciencenews.com/fly-brain-model-neuroscience-3227/


r/newAIParadigms • • Feb 21 '26

New paper on Continual Learning "End-to-End Test-Time Training" (Nvidia Research, end of 2025)

Thumbnail
gallery
45 Upvotes

IMPORTANT: This thread was NOT written by me. I saved it 2 months ago from r/accelerate.

---

TL;DR:

The paper describes a mechanism that essentially turns the context window into a training dataset for a "fast weight" update loop:

  • Inner Loop: The model runs a mini-gradient descent on the context during inference. It updates specific MLP layers to "learn" the current context.

  • Outer Loop: The model's initial weights are meta-learned during training to be "highly updateable" or optimized for this test-time adaptation

From the Paper: "Overall, our empirical observations strongly indicate that TTT-E2E should produce the same trend as full attention for scaling with training compute in large-budget production runs."

---

Layman's Explanation:

Think of this paper as solving the memory bottleneck by fundamentally changing how a model processes information. Imagine you are taking a massive open-book exam.

A standard Transformer (like GPT-4) is the student who frantically re-reads every single page of the textbook before answering every single question. This strategy guarantees they find the specific details (perfect recall), but as the textbook gets thicker, they get exponentially slower until they simply cannot finish the test in time.

On the other hand, alternatives like RNNs or Mamba try to summarize the entire textbook onto a single index card. They can answer questions instantly because they don't have to look back at the book, but for long, complex subjects, they eventually run out of space on the card and start forgetting crucial information.

This new method, Test-Time Training (TTT), changes the paradigm from retrieving information to learning it on the fly. Instead of re-reading the book or summarizing it onto a card, the TTT model treats the context window as a dataset and actually trains itself on it in real-time. It performs a mini-gradient descent update on its own neural weights as it reads. This is equivalent to a student who reads the textbook and physically rewires their brain to master the subject matter before the test.

Because the information is now compressed into the model's actual intelligence (its weights) rather than a temporary cache, the model can answer questions instantly (matching the constant speed of the fast index-card models) but with the high accuracy and scaling capability of the slow, page-turning Transformers.

This effectively decouples intelligence from memory costs, allowing for massive context lengths without the usual slowdown.

---

Paper: https://arxiv.org/pdf/2512.23675

Open-Sourced Implementation: https://github.com/test-time-training/e2e


r/newAIParadigms • • Aug 07 '26

Goertzel predicts Google is abandoning research into alternative AGI paths

44 Upvotes

No question this is terrible news for us. According to Goertzel, recent moves at Google (such as Demis stepping down as CEO and DeepMind being more integrated into Google) suggest that they may be abandoning research on alternative paths to AGI and going all in on Transformer LLMs.

I made a thread a few months ago where I ranked Google as the biggest contributor to the research landscape for alternative architectures. They are almost the modern version of the legendary AT&T lab, where they provide tons of resources to researchers to explore interesting paths that may not pan out immediately (and for those who don't know, AT&T directly led to most of the biggest technological breakthroughs in the 20th century).

This would be a massive loss for the scientific community. IMO, science progresses when a deep-pocketed company can afford to pour billions into ideas that have no guarantee to work.

This is all speculation from Goertzel for now, but for me it's a truly terrifying prospect. Especially as someone who believes we are relatively close to AGI but that LLMs in their current form have already offered everything they have to offer. I am curious where y'all stand on this.

Link to the full story: https://x.com/bengoertzel/status/2085440120413421685


r/newAIParadigms • • Jun 09 '26

Could expressive, biomimetic neurons improve performance? This paper suggests that internal neuron complexity may be a new scaling axis for AGI

Post image
44 Upvotes

TLDR: Scaling has always been mostly about increasing the total number of neurons in a neural network. But the biological neuron is infinitely more complex than artificial ones. What if we also scaled internal neuron complexity? This paper provides quantitative evidence for doing so
---

➤Towards more biomimetic neurons

Current AI has relied on a massive number of trivially simple neurons, and the results have been spectacular thus far. But as we hit some performance walls, a group of researchers tried answering the following question: could scaling the internal neuron complexity be a new scaling axis for AGI?

The researchers evaluated different neural networks on 3 scaling axes: total number of neurons, total number of connections, and, newly, internal neuron complexity. The relationship between compute and these 3 variables respectively follows P = N(ke + kc). In other words:

  • investing only in neuron count is always leaving some meat on the bone. The optimum always involves a fine balance between network size (neuron count), neuron complexity and connectivity.

  • as compute budget grows (defined as the total number of parameters), the optimal architecture shifts toward both larger networks, more complex neurons, and higher connectivity

Note: after a certain point, scaling neuron complexity also hits diminishing returns because each neuron is already extracting as much information as possible

➤The overlooked role of recurrence

Recurrence simply means that a network's current state depends on its past states, which implies keeping track of time and maintaining some temporal memory. This is hypothesized to be important because the world is both deeply temporal (eg. video and audio) and sequential (eg. text).

The brain is massively recurrent. Its sensitivity to time is reflected in our tendency to focus on changes while gradually ignoring constants. That's why we can tune out background noise and still notice new sounds.

In neural networks, recurrence can be achieved by increasing the number of connection loops so that neurons communicate back and forth with each other. Neuron A (or group of neuron A) is connected with Neuron B which is connected back to Neuron A. There are tons of this kind of loop in the brain

On top of making us more time-aware, scaling the number of connections also reduces redundancy: the more neurons communicate with each other, the more they'll be incentivized to learn different things.

➤Inside the ELM ("Expressive Leaky Memory") architecture

This architecture is focused on implementing both recurrent and expressive neurons.

-Recurrence

The authors implemented recurrence in two ways:

1- they manually connected neurons in order to force them to do a lot of loops between each other

2- their internal state is recurrent: the current state of a neuron depends on its past

-Expressiveness

A classical neuron takes input from surrounding neurons, sums it, and passes the result through a nonlinear activation function. ELM neurons are far more complex. Each of them are like whole dynamical ecosystems:

1- At time t, incoming signals are first split into groups and processed through branch-like structures loosely inspired by dendrites. This delays the mixing of information and allows the model to capture more complexity within the input

2- The processed input is compared against the neuron's internal memory through a small MLP to compute a memory update. This memory is itself composed of multiple smaller memory units operating on different timescales (milliseconds, seconds, minutes, hours...)

Note: Scaling neuron complexity usually means increasing the size of this internal MLP and the number of those smaller memory units.

3- The resulting memory update is merged with the previous memory to produce a proposed output. But this is not yet the final output. This proposal still has to be compared to an average of the neuron's past outputs before deciding on the final output at time t+1

This step's goal is to explicitly make the neuron sensitive to changes rather than raw output. A bit like how a human's brain gets used to some background noise and only pays attention when it hears a new sound. The ELM neuron pays attention to changes instead of constants by tracking its own activity pattern.

➤Results

The biomimetic ELM architecture performs quite well on spiking audio benchmarks as well as a modified Wikipedia corpus. It's nowhere near replacing Transformers as that was never the point, but it suggests that implementing both expressive and recurrent neurons could truly unlock AI

---
PAPER: https://arxiv.org/abs/2605.12049


r/newAIParadigms • • Feb 26 '26

'Thermodynamic computer' can mimic AI neural networks — using orders of magnitude less energy to generate images

Thumbnail
livescience.com
40 Upvotes

I've already posted about this, but for new members who missed it: this has been touted as a potentially game-changer for AI. It is an entirely new type of hardware for AI, that doesn't even rely on bits anymore but on something called "probabilistic bits" (pbit) which leverages noise to make neural networks far more efficient.

This article actually brings something I wasn't aware of/didn't cover in my previous post: their unconventional chip makes image generation much more efficient, especially if it's based on diffusion. It's also promising for novel types of neural nets like Energy-Based Models (EBMs ren't really novel but their potential is still vastly underexplored)

The claims are quite extreme and many members have cautioned against this, but feel free to judge for yourself.

Key passages:

Conventional computing works with definite binary bit values — 1s and 0s. However, an increasing amount of research over the past decade has highlighted that you can get more bang per buck in terms of resources like electricity consumed to complete a computation when working with probabilities of values instead [...] A new "generative thermodynamic computer" works by leveraging the noise in the system rather than despite it, meaning it can complete computing tasks with orders of magnitude less energy than typical AI systems require. 

and

The efficiency gains are particularly pronounced for certain types of problems known as “optimization” problems, where you want to get the most out while putting the least in. Thermodynamic computing could be considered a type of probabilistic computing that uses the random fluctuations from thermal noise to power computation.

and

These diffusion models seemed to Whitelam “a natural starting point” for a thermodynamic computer, diffusion itself being a statistical process rooted in thermodynamics. While conventional computing works in ways that reduce noise to negligible levels, Whitelam noted, many algorithms used to train neural networks work by adding in noise again. "Wouldn't that be much more natural in a thermodynamic setting where you get the noise for free?"

and

He also flagged a potential benefit beyond the energy savings: "This article also shows how physics-inspired approaches can provide a clear fundamental interpretation to a field where "black-box" models have dominated, providing essential insights into the learning process,"


r/newAIParadigms • • Dec 20 '25

"AI frontiers" published a pretty respectable report on the remaining breakthroughs for AGI

Thumbnail
ai-frontiers.org
39 Upvotes

TLDR: "AI frontiers" analyzed current model's performance in in roughly 7 categories to assess how far we are from AGI: visual reasoning, world modeling, auditory processing, speed, working memory, long-term memory and hallucinations.

They come to the conclusion that most of these could be solved through standard engineering but that continual learning will require a breakthrough.

---

I'll preface by saying that generally speaking I do no agree with those guys on most things (especially that "AI 2027" paper). That said, I give them credit on this one because their report is pretty thorough.

Key passages:

AI advances can generally be placed in one of three categories: (1) “business-as-usual” research and engineering that is incremental; (2) “standard breakthroughs” at a similar scale to OpenAI’s advancement that delivered the first reasoning models in 2024; finally, (3) “paradigm shifts” that reshape the field, at the scale of pretrained Transformers.

and

Models still struggle with visual induction. For example, they perform worse than most humans in a visual reasoning IQ test called Raven’s Progressive Matrices. Yet, when presented with text descriptions of the same problems, top models score between 15 to 40 points better than when given the raw question images, exceeding most humans. This suggests the modality is what is making the difference, rather than a deficiency in the model’s logical reasoning itself. The remaining bottleneck is likely perception, not reasoning. 

and

Speed is superhuman in text and math, but lags where perception or tool use is required. GPT-5 is much faster than humans at reading, writing, and math, but slower at certain auditory, visual, and computer use tasks. In some cases, GPT-5 also seems to use reasoning mode to complete fairly simple tasks that should not require much reasoning, meaning that they take an unnecessarily long, convoluted approach that slows them down.

and

The only broad domain in which GPT-4 and GPT-5 both score zero is long-term memory storage, or continual learning — the capacity to keep learning from new experiences and adapting behavior over the long term. Current models are “frozen” after training. They still have a kind of “amnesia,” resetting with every new session. 

Of all the gaps between today’s models and AGI, this is the most uncertain in terms of timeline and resolution. Every missing capability we have discussed so far can probably be achieved by business-as-usual engineering, but for continual long-term memory storage, we need a breakthrough. 

---

Thoughts

Considering how even SOTA models still consistently struggle with counting fingers despite the "progress" suggested by various benchmarks, I think they are vastly underestimating how far we are from solving vision.

Other than that though, I salute the rigor behind this report. We may disagree on the findings but at least the process/scientific approach is there. Science should always be the answer to disagreements!