I would not sacrifice the flexibility and your job might pay you more in a few years.

Side note: I started to sell stock options this year kind of as a side hustle (there is a learning curve but I think it went well). Our household is similar, we max our retirement and with expenses it’s hard to have “extra” that can go to other things (without decreasing amount going into retirement). This is what motivated me to try and find a side hustle.