It will actually be pretty amazing at blue collar jobs. It's infact bad at white collar jobs. The reason you see so much more automation in white collar jobs right now is

(1) Easy to automate blue collar jobs are already automated.

(2) Data is not easily available or cost of training on data is very high.

(3) Cheaper to hire humans then to make expensive robot bodies.

Most blue collar jobs rely on experience which is what Neural networks should be good at. It's just that training to live in the real world is slow and hard.