MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/learnmachinelearning/comments/xyk2si/linear_regression_visualizing_squared_errors/irj7cph/?context=3
r/learnmachinelearning • u/RacerRex9727 • Oct 08 '22
31 comments sorted by
View all comments
5
Why is the square taken, why is the absolute value of the error not considered? Is it just due to ease of differentiation for optimization or is there a deeper reason?
2 u/RacerRex9727 Oct 08 '22 Yes, that’s the primary motivation. Absolute values are difficult to differentiate.The visual here is simply to show a graphical interpretation of squared errors. 4 u/crimson1206 Oct 08 '22 Absolute values are super easy to differentiate. Non-differentiability at 0 really isn't a relevant problem practically.The main difference between an squared loss vs. absolute loss is that a squared loss punishes outliers much more than an absolute loss does.
2
Yes, that’s the primary motivation. Absolute values are difficult to differentiate.
The visual here is simply to show a graphical interpretation of squared errors.
4 u/crimson1206 Oct 08 '22 Absolute values are super easy to differentiate. Non-differentiability at 0 really isn't a relevant problem practically.The main difference between an squared loss vs. absolute loss is that a squared loss punishes outliers much more than an absolute loss does.
4
Absolute values are super easy to differentiate. Non-differentiability at 0 really isn't a relevant problem practically.
The main difference between an squared loss vs. absolute loss is that a squared loss punishes outliers much more than an absolute loss does.
5
u/riricide Oct 08 '22
Why is the square taken, why is the absolute value of the error not considered? Is it just due to ease of differentiation for optimization or is there a deeper reason?