Why do you seem more upset about how this colleague feels, over what you’re potentially doing to your family.. and to his family too?

If you can’t even spare a sentence to cover how what you’ve done and are obsessing about will effect them, then you’re too far gone to give advice to.