MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/learnmachinelearning/comments/xyk2si/linear_regression_visualizing_squared_errors/irige8f/?context=3
r/learnmachinelearning • u/RacerRex9727 • Oct 08 '22
31 comments sorted by
View all comments
5
Why is the square taken, why is the absolute value of the error not considered? Is it just due to ease of differentiation for optimization or is there a deeper reason?
2 u/RacerRex9727 Oct 08 '22 Yes, that’s the primary motivation. Absolute values are difficult to differentiate.The visual here is simply to show a graphical interpretation of squared errors. 5 u/[deleted] Oct 08 '22 But it can give the wrong intuition that 2d area of the squares is somehow meaningful. Nice animation though, and looks good 4 u/crimson1206 Oct 08 '22 Absolute values are super easy to differentiate. Non-differentiability at 0 really isn't a relevant problem practically.The main difference between an squared loss vs. absolute loss is that a squared loss punishes outliers much more than an absolute loss does.
2
Yes, that’s the primary motivation. Absolute values are difficult to differentiate.
The visual here is simply to show a graphical interpretation of squared errors.
5 u/[deleted] Oct 08 '22 But it can give the wrong intuition that 2d area of the squares is somehow meaningful. Nice animation though, and looks good 4 u/crimson1206 Oct 08 '22 Absolute values are super easy to differentiate. Non-differentiability at 0 really isn't a relevant problem practically.The main difference between an squared loss vs. absolute loss is that a squared loss punishes outliers much more than an absolute loss does.
But it can give the wrong intuition that 2d area of the squares is somehow meaningful. Nice animation though, and looks good
4
Absolute values are super easy to differentiate. Non-differentiability at 0 really isn't a relevant problem practically.
The main difference between an squared loss vs. absolute loss is that a squared loss punishes outliers much more than an absolute loss does.
5
u/riricide Oct 08 '22
Why is the square taken, why is the absolute value of the error not considered? Is it just due to ease of differentiation for optimization or is there a deeper reason?