A Learning Algorithm for Adaptive Time-Delays in a Temporal Neural Network

Abstract

The time delay neural network (TDNN) is an effective tool for speech recognition and spatiotemporal classification. This network learns by example, adapts its weights according to gradient descent, and incorporates a time delay on each interconnection. In the TDNN, time delays are fixed throughout training, and strong weights evolve for interconnections whose delay values are important to the pattern classification task. Here we present an adaptive time delay neural network (ATNN) that adapts its time delay values during training, to better accommodate to the pattern classification task. Connection strengths are adapted as well in the ATNN. We demonstrate the effectiveness of the TDNN on chaotic series prediction.