r/mlscaling • u/Glittering_Author_81 • Mar 31 '25
The case that AGI is coming soon
r/mlscaling • u/Glittering_Author_81 • Mar 31 '25
r/mlscaling • u/COAGULOPATH • May 01 '24
I know research papers are preferred here instead of speculation, but this could be interesting.
On April 27th, a new model debuted on lmsys. It was removed on the 30th. Here is a summary of known facts:
Evidence points to it being a new OpenAI model, with reasoning capabilities similar to GPT4/Claude 3 Opus, perhaps exceeding them in some cases. Hard to say. I wish I'd used it more.
Here's it designing a game one-shot, and creating ASCII art (note that this exact image was on the internet, so this constitutes memorization of data, not actually drawing a unicorn from scratch).
It also had a nice writing style, with less of that ChatGPT "delve" stuff people complain about. This was impressive to see—I haven't seen an LLM with such a proficient grasp of rhyme and language.
On the other hand, it still falls for simple token-based tricks. (GPT4 got this right, Claude 3 Opus wrong. GPT3.5 and Gemini Sucktra didn't notice the word was misspelled.) And for some tasks it seems inferior to GPT4.
What do you think this is?
r/mlscaling • u/StartledWatermelon • Mar 26 '24
r/mlscaling • u/philbearsubstack • Aug 01 '21
It's well over a year since GPT-3 came out, and thus far there are no obvious signs of a successor. When we look at various specific benchmarks what we see is also worrying. It's been quite some time since there's been rapid progress on a range of different NLP tasks including:
The ARC reasoning challenge: https://leaderboard.allenai.org/arc/submissions/public
RACE: http://www.qizhexie.com/data/RACE_leaderboard.html
SuperGLUE: https://super.gluebenchmark.com/leaderboard
Is it possible that there was a "golden age" of rapid NLP progress, and it's now over, or is this just a brief lull with no special significance?
I've got to say that if we have left a rapid period of special progress I find that depressing because it did feel like we were on the verge of some truly astonishing achievements for a hot moment there.
r/mlscaling • u/maxtility • Sep 07 '23
r/mlscaling • u/MindPsychological140 • Jul 29 '26
r/mlscaling • u/gwern • Feb 01 '26
r/mlscaling • u/FedeRivade • May 09 '24
r/mlscaling • u/Beautiful_Surround • Jun 02 '24
r/mlscaling • u/atgctg • Sep 13 '24
r/mlscaling • u/niplav • Sep 17 '23
r/mlscaling • u/hold_my_fish • May 04 '23
r/mlscaling • u/gwern • 1d ago
r/mlscaling • u/dental_danylle • Jul 26 '25
r/mlscaling • u/gwern • Aug 26 '23
r/mlscaling • u/AtGatesOfRetribution • Apr 01 '22
r/mlscaling • u/khidot • Nov 29 '24
r/mlscaling • u/Docs_For_Developers • May 03 '25
Open source (Either true open source or non-profit) appear to thrive in fields with low hanging, but hidden fruit. Closed source appears to thrive in fields with high hanging, but visible fruit.
AI used to fall into category 1, where the fruit was so low hanging that a non-profit like OpenAI with the right perspective, a small team, and cheap scaling could see the hidden fruit and quickly scoop up $300 billion in value.
However, now AI has entered category 2, where everyone sees the fruit but it's high up in the trees. At this point you need to be closed source and for-profit in order to brute force scale past thresholds (Regulatory, Technical, etc).
My best evidence for this is that OpenAI themselves, the open source non-profit, realized they needed to be closed source for-profit in order to win the AI Race.
*Edit Note*
One user correctly pointed out that I should have clarified by just creating a new category like Closed For Profit company. What I was trying to mean is that the winner of AI will most likely be "Closed Source" and "For Profit".
This is coming from a pattern I've observed where I don't know of any industry where there is high hanging, but visible fruit where the marketshare winner isn't closed source and for profit. For example, I don't see an Nvidia competitor that is:
(1) open source, for profit
(2) closed source, non-profit
(3) open source, non-profit.
However, the user mentioned Red Hat so I'll need to look into them further to see if the pattern I've observed still holds. However, my bet is that they are probably a newer business in an area of low hanging fruit. Where with the right perspective, a small team, and cheap scaling they can scoop up to even $300 billion in value just like OpenAI did with AI.
r/mlscaling • u/yazriel0 • Nov 13 '24
r/mlscaling • u/philbearsubstack • Feb 03 '25
r/mlscaling • u/SnoozeDoggyDog • Jan 25 '21