Next: Information Gain Example
Up: Decision Tree Learning
Previous: What Attribute is the
-
, where 
is
the set of possible values for the attribute 
and 
is
the subset of 
for which attribute has value 
. - Information Gain is the expected reduction in entropy caused by knowing the value of
attribute .
- Information Gain is the information provided about the target
function value, given the value of some other attribute .
- The value of
is the number of bits saved when
encoding the target value of an arbitrary member , by knowing the
value of .
Patricia Riddle
Fri May 15 13:00:36 NZST 1998