: predicting a quantitative response $Y$ on the basis of a single predictor variable $X$, assuming there is a linear relationship.

In other words, we assume the relationship between $X$ and $Y$ as

$$ Y\approx\beta_0+\beta_1X $$

where $\beta_0$ and $\beta_1$ are the model coefficients, or parameters,

We train the data to produce coefficient estimates, $\hat\beta_0$ and $\hat\beta_1$, and compute the prediction of $Y$ on the basis of $X=x$ as

$$ \hat y=\hat\beta_0+\hat\beta_1x $$

3.1.1 Estimating the Coefficient

Goal

Find the intercept $\hat\beta_0$ and slop $\hat\beta_1$ such that the resulting line is as close as possible to the observed data points.

→ Closeness can be measured in various methods, but the most common approch involves minimizing the least squares criterion.

Residual and RSS

Least Squares Coefficient

We choose $\hat\beta_0$ and $\hat\beta_1$ such that $RSS$ is minimized, as