Machine Learning trade-off

In machine learning, there is always a trade off between

• complex hypotheses that fit the training data well

• simpler hypotheses that may generate better.

As the amount of training data increases, the generalization error decreases