Complexity at almost every level of the universe arises from disorder and chaos. Order and symmetry are units of uniformity, which is sterilisation for complexity.
At the same time, this 'chaos' needs regularity in order for it to accrue.
The universe has lower and upper boundsLife (and neural networks) needs noise/chaos