Network from Scientific Research

The basic principle of dynamic gating. Here, we have a simple three-layer feedforward neural network that can compute the exclusive-OR function of the input. With a three-unit hidden layer, the network achieves maximum dimensionality with two inputs and can easily compute the exclusive-OR. With four input neurons, as we have in this example, we need to either increase the number of hidden units or gate half of the input using a context signal such as is shown here.

DOI