While I do spend lots of time pushing the idea of linear approximations on my students, we do need nonlinear functions to describe most interesting physical phenomena.

For this, you also need non-linear thresholding functions that adjust the weights between the layers of neurons.