 
  
  
  
  
 Next: Problems with Gain Ratio
Up: Decision Tree Learning
 Previous: Example
 
-  Information Gain has natural bias towards attributes with many values over ones
with few
-  For instance   attribute has highest information gain attribute has highest information gain
-  use Gain Ratio
-     
-  entropy of S with respect to the values of A
-     
-  if attribute A (Date),    
-  if attribute B splits the examples in half,    
-  if attributes A and B have the same   then B will clearly
score higher then B will clearly
score higher
 
Patricia Riddle 
Fri May 15 13:00:36 NZST 1998