Question 8

• Given two learning algorithms and and a small data set , which algorithm will produce more accurate classifiers when trained on datasets of the same size as ?
• Because is small it will be necessary to use holdout and resampling methods.
• This means we cannot answer the question directly without making the assumption that the performance of the two learning algorithms changes smoothly with changes in the size of the training set.
• The technique for this analysis is 5*2 cross validation.