r/statistics • u/gaytwink70 • Oct 15 '25
Discussion Love statistics, hate AI [D]
I am taking a deep learning course this semester and I'm starting to realize that it's really not my thing. I mean it's interesting and stuff but I don't see myself wanting to know more after the course is over.
I really hate how everything is a black box model and things only work after you train them aggressively for hours on end sometimes. Maybe it's cause I come from an econometrics background where everything is nicely explainable and white boxes (for the most part).
Transformers were the worst part. This felt more like a course in engineering than data science.
Is anyone else in the same boat?
I love regular statistics and even machine learning, but I can't stand these ultra black box models where you're just stacking layers of learnable parameters one after the other and just churning the model out via lengthy training times. And at the end you can't even explain what's going on. Not very elegant tbh.
151
u/busybody124 Oct 15 '25 edited Oct 15 '25
I think you and some commenters may be missing the fundamental philosophical difference between many classical statistical methods and deep learning. In many scenarios where "classical" methods are applied, explanation is a first class objective and prediction may not be of interest at all, or even make sense. In many scenarios where ML and DL are applied, prediction is the goal and explanation is not a priority or may not make sense.
An example: If I need to know if an image is pornographic or not in order to make an NSFW filter, I am not interested in sacrificing prediction performance in order to ensure that the model has some interpretable functional form, nor would it make sense to: a human viewing the image would not need an explanation as to why it's NSFW, but the goal here is to automate that task at scale.
On the other hand, if I'm trying to understand if a medical intervention reduced mortality, I am not interested in using it to predict mortality for specific unseen future individuals, instead my priority is to isolate the causal impact of this variable.
These are similar and sometimes overlapping sets of tools but they are used on extremely different tasks. Often DL is a means to an ends to build a software product, whereas stats are a tool to build our understanding of a system.
See To explain or predict? for more context on this.
8
u/the-anarch Oct 16 '25
Gary King (political scientist) used neural networks two decades ago to both explain and predict certain aspects of international conflict. He argued that for complex topics, which would include pretty much any human behavior, traditional statistics imposition of specific functional forms has less explanatory power not just less predictive power. (It's been a couple of years since I read his work, so if someone else has a different perspective, great.) The point being that at least some deep learning is about more than prediction. And, though big neural nets are complex, they aren't really a black box either. You may not compute everything by hand, but conceptually both the setup and the math are relatively approachable.
4
u/houndus89 Oct 16 '25 edited Aug 25 '26
Practice imagine historical subtract paltry sort willow sparkle
This post was anonymized with Redact
39
u/mr_stargazer Oct 15 '25
Erm...with all due respect, I have a different point of view.
What you just described is precisely what the field kept repeating for years - for many reasons we may dispute later, so the wheels keep churning.
Statistics is not only about being explainable. It's about about coming ways to measure uncertainty. This very point is why the Deep Learning field won't grow (beyond a certain point), and is confined in broken repositories, obscure papers and shrouded in a mist of hype and mysticism. Many high-end fields won't put them in production - No, I'm not talking about creating an app and hosting it online.
Let's take for instance the example you gave. I trained a machine that "predicts" NSFW websites. What is the uncertainty associated with this prediction? How confident is the model in this prediction? Moreover, if I stripe down this specific chunk of the model, what happens? This is my opinion the problem with Deep Learning. Not necessarily being white-box or not. It lacks a framework for reasoning about the model itself.
Yes, we do have some fields that are growing and which does have some stronger formalism and could be of aid (Conformal Prediction, for instance), but it still lacks wider adoption. What we normally see today is the typical researcher has been given a set of blocks and told to play, but at the same time, they don't know that each block incurs some penalty (variance), cost (increasing the variance of the gradients), and don't seem to care.
"More GPUs please!"
PS: I'm a DL Researcher.
35
u/busybody124 Oct 15 '25
Uncertainty aware deep learning is a thing that exists and an active area of research, though certainly not the norm in most cases. But I think ultimately the same notion of pragmatism applies: in many (not all!) situations where dl/ML is applied, the point estimate or even the predicted class is sufficient for accomplishing the goals of the system. For systems where having an understanding of uncertainty is important, practitioners should by all means ensure that their model is capable of producing that. But many comparisons of traditional and DL methods assume that both are being used to solve the same problems, which is rarely the case in reality. Don't use a deep learning model to analyze your clinical trial, and don't use a linear model for image segmentation, but do use either of them when the situation calls for it.
6
8
u/sagaciux Oct 16 '25
I agree with your conclusion but not with the argument. My perspective is: holding out a test set and evaluating performance there is perfectly reasonable (empirical risk minimization) and there are even good statistical guarantees there nowadays (PAC-Bayes generalization error bounds). But in the real world, which is what DL cares about anyways, these guarantees aren't that useful because unlike traditional statistics, DL is modeling really high dimensional and interrelated variables for which the data and the learned models are inevitably biased in some way, and this bias causes errors that are a) hard to notice in aggregate statistics, and b) can cause catastrophic problems because they are so heavily concentrated in the tails of the data distribution. Think self-driving car that suddenly is convinced a person is a traffic cone - no amount of confidence in the model's outputs can guarantee that something like this won't happen under the current ERM paradigm, because the errors could always be concentrated in a smaller region of the state space that we don't have the data or model capacity to evaluate.
4
1
1
63
u/Drisoth Oct 15 '25
Hard to respond to this, since I think you've got a mostly correct view of ML, but your reasons seem off to me.
A lot of econometrics ends up with somewhat of a black box since you don't really have the ability to describe why a certain effect occurs, just that it does. There's certainly more transparency than with ML tools, but you're still using tools that sacrifice explanation for predictive power. We lean on "ceteris paribus" a lot, which is often laughably unrealistic.
I dunno, I'd encourage you to be more critical of the models you prefer, and more open to the idea of using an extremely un-explainable model if explain-ability is irrelevant to your goal.
That said, I would agree with your general dislike of it. The issues you mention are real issues and should be thought of.
3
u/NarutoLpn Oct 16 '25
Is the goal of econometrics to explain why a certain effect occurs? I think the purpose of, at least causal inference, econometrics is to measure the causal effect of an intervention on an outcome. Why that effect occurs, may be pertinent to argue for mean independence but the figure of interest is the causal effect, in whatever units, of the treatment on outcome. Therefore, I don’t know if I’d agree that the methods of econometrics is a black box.
1
u/Drisoth Oct 16 '25
Your comment reads as disagreeing, but honestly I think I agree with you.
Econometrics structure gives some information back about the pathways and structure of the system, but is more opaque than other tools.
ML is even further down that path.
All I was trying to point out is that this isn’t black and white boxes, it’s a full spectrum in between. As a model gets more opaque it does get worse, but there’s no single point that’s too far.
1
u/Ma4r Oct 19 '25
Isn't the entire point of econometrics coming up with these models are to explain what happened in the past by relating various variables and how they relate to each other? Econometrics starts with a massive black box and tries to guess what's happening underneath, no? I view it the same as models in physics, the only difference is we are limited by the amount of data we can collect.
42
u/plc123 Oct 15 '25
Transformers have the advantage of actually working in extremely complex domains, unlike more explainable models. If you prefer working in domains where something like a transformer is not necessary, that's your preference.
32
u/NutellaDeVil Oct 15 '25
I’m guessing that OP’s bigger point is about what “actually working” means, and wanting some sort of mechanistic or structural explanation for data, not just a correlative one.
7
u/plc123 Oct 15 '25
But often the true mechanism is too complex to simulate. For instance, AlphaFold is predicting protein folds while a full simulation is beyond our current computational abilities.
11
u/Adept_Carpet Oct 15 '25
But AlphaFold is built on top of multiple centuries of development of a explainable models of organic chemistry, electromagnetism, DNA/RNA, the cell, etc.They knew in advance there would be chains and side chains, hydrogen bonds and van der Waals interactions, and under what conditions side chains might form covalent bonds.
The ability to do more without understanding can hold back progress. Ancient Greek sources transmitting even ancient-er Babylonian sources were relevant in astronomy until stellar parallax was measured in the 19th century, a multi-millenia cul-de-sac because of the creation of a model that was useful but explained nothing.
And since the goal of creating proteins is to either get rid of them, inject more of them, or spray them all over the place and let them get washed into the ocean, we probably want to develop an understanding of them that matches our ability to create them.
6
u/engelthefallen Oct 15 '25
Sounds like you want to be more in the inferencial side of statistics than the predictive side. The predictive really only cares about predictive accuracy, the how and why it works does not matter much to stakeholders.
Inferential side is more about creating explainable models using theory as your guide. These are like the models that dominate most research fields and will gladly trade predictive accuracy for being able to see inside the box.
So feels like moving down deep learning was just going deep into the wrong side of statistics for what you ideally want to be doing.
10
u/GodDoesPlayDice_ Oct 15 '25
Feel that way about LLMs, there is some neat stuff in the rest of DL imo
5
u/seanv507 Oct 15 '25
so I agree to some extent, but I think this is also due to bad teaching.Many people are using them without understanding what they are doing: cargo cult programming.
I think if you do a language modelling course, you will have a better understanding of what modelling is being done, and its less of a black box.
In particular, it might help to understand the background of n-gram language modelling (which one could argue is analogous to polynomial modelling)
I have found stanfords cs-224n Natural Language Processing with Deep Learning rather informative. In particular their transformer lectures and associated handouts, exercises.
[I still wouldn't claim to understand...]
5
Oct 15 '25
Aren't there mathematical models that can explain, at least in an abstract way, how transformers and artificial neural nets work? Not specifically for a single model, but in general terms? I find this a useful abstraction, but really no point in knowing how a specific model works.
5
u/bbbbbaaaaaxxxxx Oct 16 '25
Here are my rambling thoughts as someone who has done nothing but Bayesian ML for the past 15 years.
People do DL because its easier. If you want to make an explainable statistical model, you have to do a bunch of research to test out the statistical structure of distributions and their parametric forms. This IMHO is why PPLs haven't become the norm—they don't actually do much learning. DL and other "black boxes" just learn something. A lot of the time that's good enough because there's not a lot at stake if you get it wrong (ad delivery, product recommendation, games, slop).
That said, DL has hit a wall. DL models get better is by getting bigger, and we've seen that LLMs' power and compute requirements have basically exceeded the capacity of the world. So, from my standpoint, though it has never been a more boring time to be a DL researcher, it has never been a more exciting time to be a probabilistic ML researcher. We need to get smaller and probabilistic ML is the best way to get there.
3
3
u/Wyverstein Oct 16 '25
I think nns are more explainable then you think.
4
u/alpinecomet Oct 18 '25
“Explainable” sure, but none of the parameters or outputs are causal in anyway—rather they are confounded by design which sounds like what OP is really expressing boredom with.
0
u/Wyverstein Oct 18 '25
"Causal " the parameters of a linear model are not Causal. That not really a criteria of a model.
The embedding space of nns is very informative.
For example the bottle neck of an auto encoder are a great way to create encodings for complex categorical data.
0
Oct 19 '25
[deleted]
1
u/Wyverstein Oct 19 '25
Lol, For example a cobb douglas model is a linear model that is famously not causal.
Causal is a totally orthogonal concept to explainable. Which is what op was originally asking about.
My point is that nns are not necessarily black box tool. It depends on how they are used.
And to further my point double ml is a standard causal too that can use nns.
2
u/National-Sample44 Oct 25 '25
Not everything you do for a job will be super entertaining. That’s why you get paid to do it!
That being said I learned you can do some very cool statistical things with NNs because they’re great at spitting out probabilities. For instance you can build a DAG causal graph and train NNs to predict the conditional distribution of one variable based on the “parent” variable on the graph.
3
u/OwnEntertainer4572 Oct 15 '25
But practical testing is one of many core concept of statistics. You have your data. Now you can interpret what does the data mean. If you have a small sample size, some might say the data is inconclusive, but if your data is large, your task will be heavy.
I still prefer to find the middle ground between testing and letting my algorithm runs day and night, I’ll wrap it up to “my algorithm did all the possible testing so I was free to do other tasks”.
2
u/Bototong Oct 15 '25 edited Oct 15 '25
What are you talking about OP? Most ML are “statistics models” and theres a lot of “black box model” made by statisticians. e.g random forest, splines, GAM, and even the boosting algorithm (that was used on trees like xgboost, etc) was made by statisticians. More examples of “black box methods or hard-to-interpret” are pca, Regularization, elastic net, etc.
Statistics even have a field for it, its called COMPUTATIONAL STATISTICS. I even thought first that data science/ML was its subset.
1
u/sundaysexisthebest Oct 15 '25
It’s gonna be like that for lots of things down this path. Science? Engineering? It’s all about problem solving. Look at the history of language models, you’ll see why it’s the way it is, and probably why it’ll be replaced in a near future. So take it easy and stay curious, get that good grades and move on to things that excite you.
1
u/LilParkButt Oct 16 '25
In the workforce, unless your doing a research role, you mainly use classical ML models which are very interpretable. You couldn’t talk about a Deep Learning model in a very interpretable way to a stakeholder, so it simply isn’t used as much.
1
u/EverchangingMind Oct 16 '25
Yes, agree!
You should consider working on ML applications for tabular data, where the models being used are much more interpretable.
1
1
u/msjgriffiths Oct 16 '25
There are plenty of function approximation methods in statistics that are very hard to interpret (eg. basis functions, polynomials, etc). They're not super common in econometrics.
I think you're approaching this the wrong way. You can always do counterfactual probing of the learned model. In some cases you can build the counterfactual ("causal") model into the training approach (see eg David Sonntag).
That said, the field comes from computer science so you might be reacting to the "lego block" mentality that's quite common at the intro level. That generally doesn't exist when you interact with researchers who know how the system really work.
1
u/houndus89 Oct 16 '25 edited Aug 25 '26
Insurance square divide swim blanket practice jellyfish
This post was anonymized with Redact
1
u/Evionlast Oct 16 '25
I think the class failed to explain why deep learning is useful, for some problems at a large scale there's nothing else, and for problems for which there's something else deep learning or maybe just the algorithms of AI give within a reasonable performance scientific hypothesis validation, the probabilistic reasoning of deep learning is easy to understand and to replicate.
1
Oct 16 '25
I've been using "AI" to describe things like simulated annealing or GLMs for over a decade now...
Look at Cynthia Rudin Lab's Rashomon Set-based work. I think you'd dig that stuff. There's also a lot of research on how over-engineered a lot of NNs are, even going so far back as AlexNet.
You also might find the Geometric Deep Learning (textbook that takes a more algebraic geo look at the structures and training process) or work by Carey Priebe's JHU Lab more interesting than a purely architectural look at deep learning.
I think pretty much every intro to deep learning class I've seen is super boring for people interested in real mathematics and super interesting for people who "want to make an anime girl generator" or shit like that. Research level is where it gets interesting to mathematicians.
Keep in mind that NN models are doing pretty damn well on certain language and image tasks but will still suck ass on lots of other tasks. A lot of the AI startups are learning they need to use a lot of rigorous stats to build their good models and then have a GenAI chatbot to help users find the right statistical model to use.
1
u/WignerVille Oct 16 '25
Continue down the path of causal inference, experimental design and so on. There are many very interesting applications and questions. Or maybe optimization and linear programming? But even if you walk down this path. You need to have some understanding of ML.
In any case it depends on what you like. I am not that into GenAI either. It doesn't excite me that much. But I know it is something that I need to have in my toolbox.
1
u/Slow-Boss-7602 Oct 19 '25
AI is not a field of statistics.
2
u/DojiNoni14 Oct 25 '25
I just explained to my 9th grade math class, AI is all statistics. I left out the part where it’s poor planning by people who don’t understand how to better society. Please explain how it’s not statistics?
1
u/DojiNoni14 Oct 25 '25
Welcome to the real world where you learn theory to attempt to apply it to real world situations.
1
u/WhosaWhatsa Oct 31 '25
This conversation centers around application and our goals for that application. Statistics aren't anathema to DL, etc. There are no sides to this argument in reality. In reality, we match tools with problems. The 'mistakes' occur when we don't match the tool with the problem that accomplishes our goal.
So if you're noticing that black box models are a 'problem', then the justification needs to be centered around how the model interacted with the context of the issue it's meant to solve. In short, there's nothing 'wrong' with black boxes just like there's nothing wrong with jig saws; in some cases they are appropriate and extremely helpful, and in others they are damn near dangerous.
However, I do take your subjective point about 'elegance' and 'explanation'. I would encourage you to consider the very fascinating but under studied topic of language in statistics. Statistics generally become 'applied' once we start using words in conjunction with the numeric symbol itself. Seem too esoteric of a concept? I can understand that critique, but if there's one broad 'truth' I've come to know from this field, it's that how we justify the tool for the problem is the only real issue at hand. And there's plenty of elegance required to make that justification clearly and convincingly.
0
u/4by3PiRCubed Oct 15 '25
If you are actually serious about statistics, you would'nt hate deep learning, I would suggest you to actually work through the matrix multiplications to understand it better.
For normal Deep Learning architectures try understanding back propagation in depth by actually solving it through lagrangian and calculus by hand
For transformer, its sole purpose is to formulate richer representations of given, work through the equations to understand how it assigns trainable attention weights to different tokens while being equally dynamic, I would suggest you to read Bishop and Bishop DL book (available online for free)
3
u/d3fenestrator Oct 15 '25
I don't think OPs point is that they cannot follow the computations and need more material.
8
u/deejaybongo Oct 15 '25
OP's point is to complain about something unfamiliar they've barely learned about.
4
u/4by3PiRCubed Oct 15 '25
Exactly, Deep Learning is just another iteration of the usual playbook in statistics, minimize some loss function on some given data, its stupid to downplay it because it is seemingly "black box"
Infact the decision function of Neural Nets has much better learning capabilities simply because the number regions is so easy to scale up, when compared to regression trees or linear regression
3
u/engelthefallen Oct 15 '25
Could also be their class is not really focusing on that side at all either. To teach the sum of deep learning in one semester you are likely barely going into any one method in the depth you would really need and just surveying everything at a pretty surface level. They may not really be getting into loss functions and optimizing them at all and literally just treating them as black boxes for the course focusing on like the basic algorithmic parts.
1
u/thisaintnogame Oct 15 '25
> Not very elegant tbh.
I'm no AI/LLM fanboy but that's quite an attitude. LLMs are capable of things that seemed impossible ten years ago. They are objectively amazing technology. Of course they might ruin all of society by making misinformation run rampant and ruin our clean water supply to cool the GPUs, but still amazing technology.
The fact that the engineering focus (try things until they work) works better at creating real things than the theory focus (write down the DGP and prove things) is an interesting meta-lesson. Ben Recht, a computer scientist at Cal, writes a great substack where he often dives into the philosophy of science behind all of this. I highly recommend it if you want to challenge your views that 'just engineering' isn't interesting or elegant https://www.argmin.net/
0
u/srpulga Oct 15 '25
This felt more like a course in engineering than data science.
All of ML is like that, it being a computer science discipline. Perhaps you just don't like data science.
Not very elegant tbh.
I disagree.
-3
u/compu_musicologist Oct 15 '25
Is explainability worth anything if the predictive accuracy is poor, i.e., can you trust an explanation from a model that cannot accurately predict?
2
u/alpinecomet Oct 18 '25
Yes. In fact the most predictive model is usually the most confounded and least explainable in the sense that the coefficients will be biased or meaningless.
118
u/[deleted] Oct 15 '25
I don't think anyone with a statistical background is impressed by modern "data science", AI, or whatever. It's already known stuff repackaged as something new. The black box approach is the worst because it emphasizes heuristics over anything with a theoretical backing.