Overfit or Not

Three hidden curves under noise, three fittings. Choose a polynomial with ridge regularisation, k-nearest neighbours or a regression tree; buy extra training data at a point a sample; run animated 5-fold cross-validation; see variance as a fan of twenty bootstrap threads; and push degree past the data to watch double descent. Then lock the fit that generalises.

← LabLab blogHome