迷路の価値関数を学ぶ再帰型ニューラル網

This paper shows that a new type of artificial neural network (ANN) -- the Simultaneous Recurrent Network (SRN) -- can, if properly trained, solve a difficult function approximation problem which conventional ANNs -- either feedforward or Hebbian -- cannot. This problem, the problem of generalized maze navigation, is typical of problems which arise in building true intelligent control systems using neural networks. (Such systems are discussed in the chapter by Werbos in K.Pribram, Brain and Values, Erlbaum 1998.) The paper provides a general review of other types of recurrent networks and alternative training techniques, including a flowchart of the Error Critic training design, arguable the only plausible approach to explain how the brain adapts time-lagged recurrent systems in real-time. The C code of the test is appended. As in the first tests of backprop, the training here was slow, but there are ways to do better after more experience using this type of network.

50p, 30 figs. Pang did most of the work here. Werbos created the designs. With her agreement, Werbos included this in int'l patent WO 97/46929 published 12/11/97. In 1997 Pang and Baras showed SRNs improve performance in a realistic communications task. The code draws on ch.8 of Werbos, Roots of Backpropagation, Wiley 1994, containing the 1974 thesis which first presented true backprop. Werbos later trained the SRN on 6 easy mazes, with steady gains on 6 hard mazes used for testing