Choose Learning Algorithm

• Learning Algorithm for choosing weights to best fit the set of training examples
• best fit could be defined as minimizes the squared error E
• 
• We seek the weights that minimize E for the observed training examples
• We need an algorithm that incrementally refines the weights as new training examples become available & is robust to errors in estimated training values
• One such algorithm is LMS (basis of Neural Network algorithms)