开发者

Should an input layer include a bias neuron?

I was wondering: in a multi-layer feed-forward ne开发者_开发问答ural network should the input layer include a bias neuron, or this is just useful in hidden layers? If so, why?


No, an input layer doesn't need a connection to the bias neuron, since any activation it received from the bias neuron would be completely overridden by the actual input.

For example, imagine a network that's trying to solve the classic XOR problem, using this architecture (where the neuron just marked 1 is the bias):

Should an input layer include a bias neuron?

To run this network on input (1,0), you simply clamp the activation of neurons X1=1 and X2=0. Now, if X1 or X2 had also received input from the bias, then that input would be overridden anyways, thus making such a connection pointless.

0

上一篇:

下一篇:

精彩评论

暂无评论...
验证码 换一张
取 消

最新问答

问答排行榜