java-deep-learning is a simple deep learning library made by a person who somehow thought that this would be a productive use of his time.
It covers the all basics like layers, activations, optimizers, and loss functions and stuff.
Also be warned that there might be a lot of bugs.