r/reinforcementlearning • • Dec 01 '20

M [R] Researchers from the University of Washington and Google develop Deformable Neural Radiance Fields (D-NeRF) that can turn casually captured selfie photos/videos into photorealistic renderings of the subject from arbitrary viewpoints, dubbed "nerfies".

0 Upvotes

Check out the paper presentation here:

Abstract:

We present the first method capable of photorealistically reconstructing a non-rigidly deforming scene using photos/videos captured casually from mobile phones. Our approach -- D-NeRF -- augments neural radiance fields (NeRF) by optimizing an additional continuous volumetric deformation field that warps each observed point into a canonical 5D NeRF. We observe that these NeRF-like deformation fields are prone to local minima, and propose a coarse-to-fine optimization method for coordinate-based models that allows for more robust optimization. By adapting principles from geometry processing and physical simulation to NeRF-like models, we propose an elastic regularization of the deformation field that further improves robustness.

We show that D-NeRF can turn casually captured selfie photos/videos into deformable NeRF models that allow for photorealistic renderings of the subject from arbitrary viewpoints, which we dub "nerfies". We evaluate our method by collecting data using a rig with two mobile phones that take time-synchronized photos, yielding train/validation images of the same pose at different viewpoints. We show that our method faithfully reconstructs non-rigidly deforming scenes and reproduces unseen views with high fidelity.

Authors: Keunhong Park, Utkarsh Sinha, Jonathan T. Barron, Sofien Bouaziz, Dan B Goldman, Steven M. Seitz, Ricardo Martin-Brualla.


r/reinforcementlearning • • Oct 07 '20

I asked RL-expert what and why he logs/tracks in reinforcement learning experiments for training and debug. Here is what he said.

0 Upvotes

For effective training of reinforcement learning agent it's quite important to see what is going on in the training and understand why agent behaves in particular way. This is challenging especially when the agent doesn’t behave the way we would like it to behave, which is like always.

He shared categorized list of metrics/statistics that you want to keep track of to inspect/debug your agent learning trajectory.

I. How is the agent doing?

  • Episode return -> care about this one most, and try to find sane baseline for your problem.

  • Episode length

  • Solve rate

II. Progress of training

  • Total environment steps

  • Training steps

  • Wall time -> tells you how fast you can progress or try new ideas.

  • Steps per second

III. What is the agent thinking/doing?

  • State/Action value function

  • Policy entropy

IV. How the training goes?

  • KL divergence

  • Network weights/gradients/activations histograms -> Beware Dying ReLUs / Vanishing or Exploding gradients or activations.

  • Policy/Value/Quality/... heads losses

V. Aggregated statistics

  • Average and standard deviation

  • Minimum/Maximum value -> inspecting extremes can help spot a bug.

  • Median

What other categories or metrics you observe that help you fix or improve your policy?

I hope you find it helpful! Deep dive in the Article.


r/reinforcementlearning • • Jul 19 '22

Advice on RL for trading

0 Upvotes

I'm making DQN for automatic trading.

I am feeding it with 100 numbers representing the last variations of the price in percent, normalized.

I "punish" (negative reward) the network when it has not bought and the price goes up, or when it has bought and the price goes down.

Inversely, I "reward" the network when it has bought and the price goes up, or when it has not bought and the price goes down.

Right now this is the network:

Dense(64, activation="relu")
Dense(64, activation="relu")
Dense(64, activation="relu")
Dense(3, activation="relu")

It ends with 3 neurons because there are 3 possible actions: Buy, Sell, Wait.

When running this, the network overfits a LOT and learns every possible trade until it wins every time, during years.

When I update the network like this:

Dense(64, activation="relu")
Dropout(0.3)
Dense(64, activation="relu")
Dropout(0.3)
Dense(64, activation="relu")
Dropout(0.3)
Dense(3, activation="relu")

It is not able to learn AT ALL anymore. With a dropout lower than 0.3 it overfits completely, with a dropout higher than 0.3 it is not able to learn at all.

Is there any beginner flaw in there ? Any recommendation ? I have spent weeks on it, trying different inputs / model sizes, and all I ever get is extreme overfit or extreme underfit. Thanks in advance.


r/reinforcementlearning • • Apr 23 '26

Reinforcement learning kinda made me realize something uncomfortable

10 Upvotes

the model isn’t trying to “do the right thing”
it’s trying to win whatever game you accidentally designed??

and if your reward is even a little off, it won’t fail, it’ll optimize the wrong thing perfectly

feels less like training intelligence and more like designing a system that can’t outsmart youis this why so many RL demos look good in theory but fall apart in real use?


r/reinforcementlearning • • Jul 14 '26

Selling RL Environments

2 Upvotes

To all the founders and builders, I want honest opinions on how difficult is to sell RL environment ? also like collect data for computer use models ?


r/reinforcementlearning • • Jan 08 '22

Hiring: My team is hiring an 2 interns at Intel. Read post description

0 Upvotes

Looking for 2 interns for summer. There are few pre-reqs.

Must be in US.

Must enroll in a Ph.D program (Sorry no MS and BS students)

Must have a track record for doing RL research, i.e 2 to 3 publications at least.

If you are interested, please send me a link to your resume.

Thanks

Edit: hiring 2 interns


r/reinforcementlearning • • Mar 28 '26

Reinforcement learning in india

2 Upvotes

I wanted to know the most active RL communities/groups/researchers in India, and at which colleges are they. Wanted to pursue PG accordingly


r/reinforcementlearning • • Sep 14 '26

P I measured Isaac Lab VRAM on a 12 GB card: every stock task runs at 4096 envs headless. The "16 GB minimum" is for rendering, not training.

2 Upvotes

Every week there is a thread here or in r/robotics from someone with a 4060 laptop asking if Isaac Lab is even possible. NVIDIA's docs say 32 GB RAM / 16 GB VRAM minimum. I had an RTX 3060 12 GB (driver 580.173, Ubuntu 22.04, Isaac Lab 2.3.2 + Isaac Sim 5.1.0 in the official container) and a free afternoon, so I ran the numbers instead of guessing.

Method: rsl_rl PPO, --headless, 20 iterations per run, peak VRAM sampled with nvidia-smi every second. Each task at 512 / 1024 / 2048 / 4096 envs.

Task512102420484096steps/s @4096
Cartpole4.7 GB4.74.95.1244k
Ant4.74.95.36.0158k
Humanoid4.85.15.56.5110k
Anymal-C flat4.95.15.46.179k
Anymal-C rough terrain5.66.06.57.814k
Unitree Go2 flat4.85.05.46.183k
Franka reach4.64.85.15.5147k
Franka open drawer4.95.35.97.359k

What this means:

  • Headless Isaac Sim costs ~4.5 GB before the first env exists. That is the number the Zhihu crowd complains about ("4.5 GB with nothing running"). It is the Kit runtime, and it is fixed.

  • After that, 3,500 more envs cost 1 to 3 GB depending on contact complexity. Every stock task fits on 12 GB at 4096 envs.

  • On 8 GB: everything except rough terrain and open-drawer fits at 4096; those two fit at 2048 (6.5 / 5.9 GB). So yes, the 4060 laptop works, as long as you never open the GUI while training.

  • The 16 GB figure is real for rendering workflows (cameras, RTX sensors). For state-based RL it is 2x too high.

Two things that wasted more of my afternoon than the benchmark itself, in case you hit them:

  • scripts/tutorials/00_sim/create_empty.py is an infinite loop by design. Headless it looks hung. It is not. Ctrl-C.

  • Docker 28+ stores image layers under /var/lib/containerd, not under Docker's data-root. I pointed data-root at a big disk, pulled the 26 GB image, and filled the root partition anyway.

Also tried the Windows route (WSL2 + Docker Engine, 3050 Ti 4 GB): install works, GPU visible in the container, Isaac Sim boots in 8 s, then PhysX prints GPU Bp pipeline failed, switching to software and hangs. Can't tell whether that is the 4 GB or WSL2; if anyone has >= 8 GB under WSL2 and sees that line, I'd like to know.

Raw CSV and the bench script are in the bundle below if you want to reproduce on your card.


Full disclosure: I packaged this into a paid bundle, because the setup is the part everyone loses a week on. Isaac Lab Fast-Track ($49): the pinned Docker image + compose with persistent caches, a preflight script (driver / VRAM / RAM / disk / Docker / containerd root / CPU governor), the measured presets above wired into a ft-train <task> <8g|12g|16g|24g> command, a 14-entry error cookbook (DLL load failed, carb crash, NaN reward, CUDA OOM, Nucleus NoneType, the two above), a URDF linter that catches zero mass / bad inertia / disconnected trees / visual-mesh-as-collision before Isaac explodes, and a custom-URDF Direct RL template. Ubuntu 22.04 validated; WSL2 install path validated, training there not. Refund if the smoke test won't pass on hardware that meets the stated minimum.

https://appleddliu.gumroad.com/l/isaac-lab-fasttrack

Happy to answer questions about the numbers either way.


r/reinforcementlearning • • Jan 04 '22

Anyone using RL for Trading stocks?

0 Upvotes

r/reinforcementlearning • • Jun 10 '26

Roast my resume

Post image
0 Upvotes

I'm a first year student pursuing cse @ iiit h and im trying to get into deep learning.

This is my resume and skills uptil now. Uptil this point whatever I have learnt is from llms like Gemini and Claude handing me markdown files (lecture.md)

Should I try for any internships? Which ones?

What else should I learn in which order and from where? Thanks in advance


r/reinforcementlearning • • Mar 26 '23

Robot Failed self balancing robot

0 Upvotes

r/reinforcementlearning • • Nov 29 '24

DL, D, Robot "A Revolution in How Robots Learn: A future generation of robots will not be programmed to complete specific tasks. Instead, they will use A.I. to teach themselves"

Thumbnail
newyorker.com
0 Upvotes

r/reinforcementlearning • • Sep 19 '21

D, MF Can't understand why decision trees are considered machine learning. Please explain.

0 Upvotes

The biggest sticking point with me is that the data needs to be analysed and key features picked out (or discovered through pruning) and then 'hard coded' into decision nodes with leaves.

All of this is a real person doing analysis and literally building the tree and baking it in.

I'm not saying a DT is a useless tool (I use them often) but I struggle to see how such a labor intensive process that has no ability to change, adapt, or even learn, is considered machine learning.

What am I missing?


r/reinforcementlearning • • Jan 06 '26

Reinforcement Learning: Supervised, Unsupervised, or Something Else? (When to Use Each)

0 Upvotes

By the end of this tutorial, you will clearly understand:

  • Why RL looks similar to supervised learning—but behaves completely differently,

  • Why unsupervised learning is closer philosophically, yet still not the right definition,

  • When RL is the right tool, and when supervised is faster, cheaper, safer, and better,

  • How cost, risk, and feedback shape the correct choice,

  • How hybrid pipelines (Behavioral Cloning (BC) –> RL) work in the real world,

  • How to test your problem using a simple decision framework.

Link: https://www.reinforcementlearningpath.com/reinforcement-learning-supervised-unsupervised-or-something-else-when-to-use-each


r/reinforcementlearning • • Oct 17 '25

AI Learns to play Donkey Kong SNES with PPO (the infamous mine cart stage)

Thumbnail
youtube.com
0 Upvotes

Github link: https://github.com/paulo101977/Donkey-Kong-Country-Mine-Cart-PPO

Note: I'd be happy to answer any questions you may have about the training. If you'd like to run the training, I can help with that too.

**Training an AI Agent to Master Donkey Kong Country's Mine Cart Level Using Deep Reinforcement Learning**

I trained a deep RL agent to conquer one of the most challenging levels in retro gaming - the infamous mine cart stage from Donkey Kong Country. Here's the technical breakdown:

**Environment & Setup:**

- Stable-Retro (OpenAI Retro) for SNES emulation

- Gymnasium framework for RL environment wrapper

- Custom reward shaping for level completion + banana collection

- Action space: discrete (jump/no-jump decisions)

- Observation space: RGB frames (210x160x3) with frame stacking

**Training Methodology:**

- Curriculum learning: divided the level into 4 progressive sections

- Section 1: Basic jumping mechanics and cart physics

- Section 2: Static obstacles (mine carts) + dynamic threats (crocodiles)

- Section 3: Rapid-fire precision jumps with mixed obstacles

- Section 4: Full level integration

**Algorithm & Architecture:**

- PPO (Proximal Policy Optimization) with CNN feature extraction

- Convolutional layers for spatial feature learning

- Frame preprocessing: grayscale conversion + resizing

- ~1.500,000 training episodes across all sections

- Total training time: ~127 hours

**Key Results:**

- Final success rate: 94% on complete level runs

- Emergent behavior: agent learned to maximize banana collection beyond survival

- Interesting observation: consistent jumping patterns for point optimization

- Training convergence: significant improvement around episode 100,000

**Challenges:**

- Pixel-perfect timing requirements for gap sequences

- Multi-objective optimization (survival + score maximization)

- Sparse reward signals in longer sequences

- Balancing exploration vs exploitation in deterministic environment

The agent went from random flailing to pixel-perfect execution, developing strategies that weren't explicitly programmed. Code and training logs available if anyone's interested!

**Tech Stack:** Python, Stable-Retro, Gymnasium, PPO, OpenCV, TensorBoard


r/reinforcementlearning • • May 03 '18

Is this the best reinforcement learning meme you have seen?

Post image
0 Upvotes

r/reinforcementlearning • • Oct 28 '24

RL solves hard problems, but also

7 Upvotes

r/reinforcementlearning • • Aug 31 '25

Top grade RL dev setup for brookies

Thumbnail boxingbytes.github.io
1 Upvotes

Hi,

I released a short tutorial on how to spin up a RL dev/research setup, with GPU, for less than $0.25 an hour.

I am a student, when I wanted to do some more advanced research in RL, basic envs you find in most libraries at 250SPS wouldn't do it, and reproducing some papers which ran GPU clusters for days was just impossible.

Using pufferlib, a blazing fast rl library, and a very cheap gpu rental service, I now get to run 500M steps experimentd every day for less than a dollar.

Hopefully, some people will find this usefull.

https://boxingbytes.github.io/2025/08/24/puffer-vast.html


r/reinforcementlearning • • Sep 14 '26

50 AI hyperparameters, 500 training steps, one verified gradient step improved all 5 unseen seeds by 27.8% on average

0 Upvotes

I ran a Catalyst experiment that I think gets much closer to the reason I built it.

The result first:

  • 50 AI training controls

  • 500 AdamW steps

  • 3 development seeds differentiated together

  • 5 completely unseen seeds kept untouched until the end

  • One single bounded Catalyst-guided update

  • 5/5 unseen seeds improved

  • Held-out mean validation loss improved by 27.8%

  • Catalyst independently checked 5,050 partial derivatives

  • 53,608,500 optimizer steps executed across differentiation, verification and the measured re-evaluations

  • 546.18 seconds total for the Catalyst differentiation and verification

  • One CPU core

  • No GPU

  • Hardware: Intel i5-11400H and 16 GB RAM

The RTX 3050 Ti in the laptop was not doing the Catalyst computation. This was CPU-side work in Catalyst's interpreter on one core. 

The part I care about is not simply that Catalyst can calculate hypergradients.

The interesting part is that it can measure how a large set of training decisions affect the final result after an entire training process, independently check those measurements, and then use them to make an engineering decision.

The problem

AI training has a lot of knobs.

Learning rates, warmup, Adam betas, weight decay, clipping, EMA, dropout, LoRA parameters, loss weights, regularization, noise, curriculum settings and more.

Usually you tune these by trying configurations, training the model, looking at the result, and trying again.

Automated tuning makes this more systematic, but the basic process is still:

settings A → train → result

settings B → train → result

settings C → train → result

For this experiment I wanted something different.

I wanted a map of how the training process itself responds to its controls.

So I built a small pretrained network with rank-2 LoRA adapters on both layers and made the entire fine-tuning process one compiled Rust function.

Each run contains 500 AdamW optimizer steps.

The function exposes 50 continuous training-policy controls, including:

learning-rate schedule anchors, warmup, cosine schedule shape, per-layer learning-rate scales, LoRA alphas and initialization, Adam betas, epsilon, weight decay, clipping, EMA, dropout, regularization penalties, gradient noise, input noise, loss weights, distillation, auxiliary loss settings, curriculum and freezing behavior. 

I did not differentiate one lucky training seed

This was important because the first version of this experiment taught me that a gradient from one stochastic training trajectory can partly describe that specific seed.

So this time the objective contains three complete training runs at once.

Catalyst differentiates:

mean validation loss across seeds 0, 1 and 2

plus

10 × the variance across those three seeds

The variance term is small at this scale. It acts mainly as a stability tie-breaker.

Seeds 10, 11, 12, 13 and 14 were not evaluated until the final test. 

So conceptually Catalyst is differentiating:

50 training controls

→

500 optimizer steps on seed 0

500 optimizer steps on seed 1

500 optimizer steps on seed 2

→

one final training objective

For every control, Catalyst gives me the local effect of changing that setting on the final objective after the entire training process.

Catalyst produced a sensitivity map of all 50 controls

The strongest controls at this operating point were:

  • beta2: elasticity -5.52

  • ema_decay: +0.84

  • beta1: +0.57

Overall:

  • 3 controls were HIGH sensitivity

  • 24 were MEDIUM

  • 23 were NEAR-ZERO

  • 17 of the 50 controls accounted for 90% of total elasticity

So before changing anything, I already knew something a normal best-configuration search does not directly tell me:

which controls matter locally, which direction they push the final result, and how strong that effect is relative to the others.

That is one of the main things I find useful about Catalyst.

If I have 50 things I could spend engineering time tuning and 23 of them are barely affecting the result at the current operating point, that is valuable information by itself.

The verification is the part I think is easiest to miss

Catalyst does not calculate a derivative and simply assume it is right.

With N = 50 controls, Catalyst uses:

2N + 1 = 101 verification points

That means:

  • the original point

  • every control moved slightly downward

  • every control moved slightly upward

At every verification point, the independent verifier estimates all 50 partial derivatives using central differences at multiple step sizes.

Each objective evaluation in this experiment means running:

3 complete seeds × 500 optimizer steps = 1,500 optimizer steps

The complete measured accounting was:

  • 5,050 tangent evaluations

  • 101 primal values

  • 30,486 verifier evaluations

  • 102 measured before/after evaluations

  • 35,739 total objective evaluations

  • 107,217 complete 500-step training trajectories

  • 53,608,500 optimizer steps

Catalyst completed the differentiation and verification in 546.18 seconds.

Again, this was on one core of an Intel i5-11400H laptop CPU, with no GPU acceleration. 

All 101/101 verification points passed at the declared tolerance. 

The reason Catalyst spends that much computation checking itself is intentional.

The derivative path produces the sensitivities.

A separate numerical path asks whether the actual program moves the way those sensitivities say it should.

If they disagree beyond the allowed error and uncertainty, Catalyst refuses the result.

Then I used the information exactly once

Before the derivative existed, I fixed the update rule.

There was no repeated tuning after seeing the answer.

The rule was:

  • rank all 50 controls by absolute elasticity

  • use only the top 8

  • move against the normalized gradient

  • trust radius = 0.08

  • maximum move per control = 5% of its declared range

  • maximum move per control = 20% of its current value

  • respect all parameter bounds

  • apply the change once

The actual normalized move ended up being about 4%, so this was not a giant jump across parameter space. 

Before the update:

3-seed objective = 0.007466

After the update:

3-seed objective = 0.006365

That is a 14.7% improvement from one bounded step.

The first-order sensitivity map predicted an improvement of about:

-0.001194

The actual measured improvement was:

-0.001101

So the verified local gradient did a fairly good job of predicting what the multidimensional change would actually do. 

Then I froze the settings and touched the unseen seeds for the first time

This was the test I cared about most.

Catalyst had only differentiated development seeds 0, 1 and 2.

The new settings were frozen.

Then I evaluated both the original and Catalyst-guided settings on seeds 10 through 14.

SeedOriginalCatalyst-guidedChange
100.009670.00701-27.5%
110.004940.00442-10.7%
120.005930.00442-25.4%
130.013000.00987-24.1%
140.014360.00890-38.0%

Held-out mean:

0.00958 → 0.00692

That is:

27.8% lower mean validation loss

and:

5 out of 5 unseen seeds improved

That is the result I found most interesting.

One small update, based only on sensitivities measured across three development seeds, transferred positively to every stochastic training seed that had been kept untouched.

There was another result I did not expect

The sensitivity map changed substantially when I moved from one development seed to three.

For example, in the earlier single-seed experiment ema_decay was almost irrelevant.

In this multi-seed objective it became the second most influential control.

beta1 also changed sign.

That means a hypergradient from one training trajectory can partly be telling you something about that trajectory, not necessarily the broader training process.

Optimizing the mean behavior across several seeds produced a materially different picture.

To me, that is interesting in its own right.

I also compared it against conventional random search

I do not want to hide this result because it clarifies what Catalyst is and what it is not.

If the only goal is:

find the lowest loss on this tiny and extremely cheap training problem

then random search wins.

Quite comfortably.

Giving local random search the same objective-evaluation count Catalyst consumed produced a lower final loss.

Even 101 local random configurations found a lower-loss configuration than Catalyst's one deliberately small trust-region step. 

I think that distinction matters.

Random search tells me:

configuration #22,354 was the best one I happened to test

Catalyst tells me:

  • the direction of every control

  • the magnitude of every control

  • the relative importance of every control

  • which controls are barely relevant

  • which controls dominate the result

  • independently checked derivatives for each one

And in this demo I only let Catalyst make one small bounded move.

This is not evidence that Catalyst replaces hyperparameter search.

It is evidence that the training process can provide a useful, checked local map of itself.

Why I think that could matter for AI development

A lot of AI engineering still involves expensive experimentation.

Something performs badly, so an engineer asks:

maybe learning rate?

maybe clipping?

maybe warmup?

maybe EMA?

maybe loss weighting?

Then you spend compute answering each question.

A tool like Catalyst potentially changes the starting point.

Instead of treating all 50 controls as equally mysterious, you can begin with measured information about:

what matters, how strongly it matters, and which direction the current training process says to move.

That does not eliminate experimentation.

It can make experimentation less blind.

And there is another angle that interests me.

AI coding systems can already read a training loop and make an educated recommendation like:

lower the learning rate

or:

increase regularization

Catalyst gives them access to a different kind of information:

the actual compiled training program measured this sensitivity at this operating point, and an independent numerical verifier agreed.

That could make automated AI engineering much more grounded than repeatedly asking a language model to guess which training setting to change next.

What this demo does not prove

I want to be explicit here.

This does not prove that Catalyst finds globally optimal hyperparameters.

It does not prove that Catalyst replaces search.

It does not prove that the current implementation scales directly to arbitrary large-model training.

The network in this demo is deliberately tiny.

Catalyst currently supports a scalar LLVM subset rather than arbitrary tensor-heavy training programs.

This result is about local sensitivity, not global optimization.

And when I previously tried the same 500-step training process at a more aggressive learning rate, the local training landscape became too numerically rough for the derivative to be useful.

Catalyst refused the result rather than loosening the tolerance until it passed. 

I think that refusal behavior is important too.

The thing I actually care about

The exciting result for me is not:

I calculated 50 hypergradients.

It is:

I measured the effect of 50 engineering decisions through an entire stochastic training process, independently checked those measurements, used them for one predetermined small update, and that update improved every training seed the system had never seen.

And all of the differentiation and verification ran in roughly nine minutes on one core of a six-core 11th-gen consumer laptop CPU.

If this idea scales, I do not think the future is necessarily one where hyperparameter search disappears.

I think the more interesting possibility is that AI engineers, including AI agents themselves, can get a map of the training landscape before deciding where expensive experimentation is worth spending time and compute.

Full unedited demo, source, exact controls, artifacts, all 5,050 checks, timing data, held-out results, and benchmark comparison:

[LINK]

Catalyst:

github.com/lovettsendit/catalyst


r/reinforcementlearning • • Mar 06 '26

Seeking an arXiv endorsement

0 Upvotes

I'm an independent researcher, looking for an arXiv endorsement to submit a paper on adaptive, RL-driven PHI de-identification for streaming multimodal healthcare data.

Venkata Krishna Azith Teja Ganti requests your endorsement to submit an
article to the cs.LG section of arXiv. To tell us that you would (or
would not) like to endorse this person, please visit the following URL:

https://arxiv.org/auth/endorse?x=88IFE7

If that URL does not work for you, please visit

http://arxiv.org/auth/endorse.php

and enter the following six-digit alphanumeric string:

Endorsement Code: 88IFE7

Links:

HuggingFace demo: https://huggingface.co/spaces/vkatg/amphi-rl-dpgraph

GitHub: https://github.com/azithteja91/phi-exposure-guard

If you're an active arXiv author in cs.LG, cs.CR, or a related area and are willing to endorse, I'd greatly appreciate it.

Thank you!


r/reinforcementlearning • • Nov 10 '20

UCL vs Duke in RL

0 Upvotes

Hello,

I'm a student and I intend to apply for masters, but for university that does research in RL. Which is a better suggestion UCL or Duke University in terms of practical RL research?


r/reinforcementlearning • • Nov 14 '21

R OpenAI gym: is the AI located in the environment or in the controller?

0 Upvotes

The openAI gym is a well known software library for creating reinforcement learning problems. it contains of an environment for example the cart pole problem and of a controller.. The controller has to bring the environment into a certain goal state. Question: Where is the Artificial Intelligence hidden, in the cartpole environment or in the controller who determines the optimal action?


r/reinforcementlearning • • Jan 23 '25

aiXplain's Evolver: Revolutionizing Agentic AI Systems with Autonomous Optimization 🚀

0 Upvotes

Hey RL community! 👋 We all know how transformative Agentic AI systems have been in automating processes and enhancing decision-making across industries. But here’s the thing: the manual fine-tuning of agent roles, tasks, and workflows has always been a major hurdle. aiXplain’s Evolver – our patent-pending, fully autonomous framework designed to change the game. 💡 aiXplain's Evolver is a next-gen tool that:

  • 🔄 Optimizes workflows autonomously: Eliminates the need for manual intervention by fine-tuning Agentic AI systems automatically.

  • 📈 Leverages LLM-powered feedback loops: Uses advanced language models to evaluate outputs, provide feedback, and drive continuous improvement.

  • 🚀 Boosts efficiency and scalability: Achieves optimal configurations for AI systems faster than ever before.

🌟 Why it matters

We’ve applied Evolver across multiple sectors and seen jaw-dropping results. Here are some highlights:
1️⃣ Market Research: Specialized roles like Market Analysts boosted accuracy and aligned strategies with trends.
2️⃣ Healthcare AI: Improved regulatory compliance and explainability for better patient engagement.
3️⃣ Career Transitions: Helped software engineers pivot to AI roles with clear goals and tailored expertise.
4️⃣ Supply Chain Outreach: Optimized outreach strategies for e-commerce solutions with advanced analysis.
5️⃣ LinkedIn Content Creation: Created audience-focused posts that drove engagement on AI trends.
6️⃣ Drug Discovery: Delivered stakeholder-aligned insights for pharmaceutical companies.
7️⃣ EdTech Lead Generation: Enhanced lead quality with personalized learning insights.

Each case study shows how specialized roles and continuous refinement powered by Evolver led to higher evaluation scores and better outcomes.

📚 Curious about the technical details? Check out on Arxiv: A Multi-AI Agent System for Autonomous Optimization of Agentic AI Solutions via Iterative Refinement and LLM-Driven Feedback Loops

🔍 What do you think?

How do you see tools like this shaping the future of AI workflows? Are there industries or specific use cases where you think Evolver could make a huge difference? Looking forward to hearing your thoughts. 😊


r/reinforcementlearning • • May 26 '18

Can I use reinforcement learning for product recommendation in a e-commerce website? Are there any resources available on this topic?

Post image
0 Upvotes