A lot of Stanford classes are free on youtube. They are probably among the best. Andrew Ng coursera classes are modified from his Stanford class. Most of math are not difficult, linear algebra, caculus and some statistics like maximum likelihood etc. Math can be more difficult if you want to study some branches of deep learning. The goal is to establish approximate functions with deep learning which is stacking up basic simple units into multiple layers of a deep network.