Data Science and ML
Non-Linearity: Can Linear Regression Compete With Gradient Boosting? | by Samuele Mazzanti | Oct, 2024
Some weeks ago, I published a post on LinkedIn.
The post was based on the following figure, comparing the predictions made by two models: Linear Regression, and CatBoost.
The gist of the post was that a gradient-boosting model like CatBoost seems to provide a more “reasonable” interpretation of the relationship between a predictor and the target variable (namely, house condition and house price).
Indeed, many relationships in nature are non-linear.
The post received some objections, among which the following comment stood out for the large number of likes:
This started a discussion, and I found the following comment (written by the same author…
