Usually, a Neural Network consists of an input and output layer with one or multiple hidden layers within. In a Neural Network, all the neurons influence each other, and hence, they are all connected.