chapter  8
36 Pages

Backpropagation: Some Comments and Variations

As unlikely as it may seem, one event which crystallized much of the interest in neural nets was a single simple back-propagation application which learned to map text to sound: NETtalk. Amazingly enough this model was a nexus for interest, excitement, and activity concerning neural networks and in particular back propagation. I want to beg the reader's patience for a moment to recount a short historical note about this period of time, which provides motivation and perspective for much of technical and conceptual work to follow.