r/computerscience • u/[deleted] • Mar 14 '24
The Realities of the AI Developer
Ever since Turing the idea of human-like machine intelligence floated around, but with recent advancements in computing power neural networks have deepened. The inclusion of GPT techniques have allowed the pushing of the Deep Neural Network (DNN) to heights never before seen. And now with the announcement of Devin, the AI Software Engineer, the nails in the coffin of the profession that nearly all CS majors end up in is finally being hammered in. I hope to convince you of the opposite: many of the companies behind the push aren't the humanists they claim to be, and their claims are exaggerated or even completely fabricated.
Neural networks have been around for quite some time, the idea dates back to the 1950s. But the fundamental concept hasn't really evolved since. Sure, the techniques have gotten more clever, but essentially we're still relying on the fundamental perceptron design. Which, if it works it works. And it does quite well as a statistical learning technique. However, the important distinction that a while these are called neural networks they are massively different than human brains, both in operation and fundamental structure. You don't have to take my word for it, though.
In 2021, Dr. Melanie Mitchell published a paper titled Why AI is Harder Than We Think, in a direct challenge to the AI researchers of today. While I wholly endorse reading the paper in its entirety, Dr. Mitchell brought up four fallacies that AI researchers fall for (and as a consequence, the population that listens to them).
Narrow intelligence is on a continuum with general intelligence
Easy things are easy and hard things are hard
The lure of wishful mnemonics
Intelligence is all in the brain
Dr. Mitchell further argues that AI springs are common and followed by an AI winter. We are presently in an AI spring, and an AI winter is coming. It's powerful logic that's mostly been ignored by the larger AI community, who insist that AGI is right around the corner.
But self-driving cars are still not a reality, and they were promised as early as 2015. We were promised by Elon Musk that they were going to take over. Ten years later we're still waiting and trillions of dollars have been spent on what seems to be the new fusion. So maybe it's time we stop listening to billionaires and start listening to real computer scientists, like Dr. Mitchell.
But truly these companies have made some very great advancements in the field of AI. And it's true, but i has come at a massive cost. The electricity demands are massive in a time when power consumption should be optimized on the dangerous precipice of a warming planet. The datasets used by OpenAI, Google, and Microsoft were hardly ethically obtained. And so we're left with a troubling realization that it certainly seems like this is just the new business craze (remember NFTs? Blockchain?) instead of a truly humanist pursuit. And those that cheer on them on hoping for the tech utopia of their dreams is just another form of wishful thinking.
So no, AGI isn't upon us, no matter how many times the company who tried to trademark GPT tries to will it to be through marketing materials. An Apple esque-bar graph is hardly scientific, and these companies are not ethical. They are out to make money, and have an invested interest in making the grandiose claims you see plague the news.
Thank you for coming to my TED talk, I'll have a peanut butter and jelly sandwich. And no, I'll make it myself, the AI keeps confusing the marmite with the jelly.
