I think you'd have to make a lot more money to make up for a loss in flexibility.

Could you find a job that is as flexible and pays more? Maybe, but it's really hard to know what the working environment is like until you actually work somewhere (unless you know someone well who already works there).

If you do leave, make sure you leave on good terms, so you could always return if you want to in the future.