I've just had a similar issue on some doors. Real pain in the arse to get a nice finish with hard edges where the paint has flaked.

Agree with others who've said scrape as much if the loose paint away, skim with mud and reprime/paint