> I told him I’m okay with doing this but that I want to work a year in my field (I’m a new graduate) before doing so, So that I have connections in our home country.

Completely reasonable. If you can't get on the same page, you can always consider doing ld for this time.