Measuring distribution in distributed representations

摘要

The concept of distribution is often encountered in neural network architectures without any formal quantification. A method of quantifying the amount of distribution present in the hidden layer representations of a feed-forward network with binary inputs is described.