Do what your gut tells you. No one has a clue about how to live your life. If they think they do, they’re wrong. Having a PhD, especially in ML should be a godsend for you, since in 5 years people with these skills are going to be very VERY sought after