def. Loss function is a function that encapsulates the “closeness” of the estimate and ground truth. For example a loss function may measured the geometric closeness by:

def. Mean Squared Error (MSE) is the arithmetic mean of the loss function defined:


The following shows why MSE is useful; it is just a sum of variance and bias squared.