Linear Regression vs XGBoost: Which regressor wins?

When I started doing regression problems the first model I worked with is linear regression. It is the first model you learn, it is fast…