Evaluating Hypothesis and Experimental Design

• Evaluating Hypothesis
• Estimating Hypothesis Accuracy
• Problems with Estimating Accuracy
• Four Important Sources of Error
• Dealing with Error
• Statistical Questions in Machine Learning?
• Question Assumptions
• Question 1
• Confid. Intervals for Disc. Val. Hyp.
• Question 3
• Comparing Learning Algorithms
• Problems with McNemar
• Question 5
• Question 6
• 10-fold Cross Validation
• Question 7
• Question 8
• Comparing Algorithms w/ Small Samples
• Question 9
• Why or When Accuracy?
• Four Spurious Effects?
• Summary