Flexible or inflexible method

• When the sample size n is large and number of predictors p is small, then the method is inflexible.
• Flexible methods work better when a large number of predictors need to be predicted.
• An inflexible method will work better in the case of small number of predictors.

Flexible or inflexible method

• When the number of predictors is large, then the method is flexible.
• Flexible methods work better when a large number of predictors need to be predicted.
• An inflexible method will work better in the case of small number of predictors.

Flexible or inflexible method

• When the relationship between predictors and response is non-linear then the method is flexible.
• Flexible methods are good at fitting non-linear models.

Flexible or inflexible method

• When the variance of error terms is extremely high, then the method is inflexible.
• Choosing a flexible model in the case is over fitting.
• A flexible method will end up fitting the noise.