Non-linear Hypotheses
Performing linear regression with a complex set of data with many features is very unwieldy. Say you wanted to create a hypothesis from three (3) features that included all the quadratic terms:
Neurons and the Brain
Neural networks are limited imitations of how our own brains work. They've had a big recent resurgence because of advances in computer hardware.