ABSTRACT

The state space of neural network is high dimensional descrete space, a clear understanding of the space and simple formulas of relevant calculation are nescesary for neural network research. In this paper, the properties of the space, especially the distributions of density of state ρ(x) and conditional density of state ρ 2(x 0,x 1 | x), are discussed. Simple formulas to calculate the volume of sphere, shell, basin attraction and etc. are given in the paper.