Correct. You could trim the door by butting the trim up against the door frame instead of on top of the frame. If you get thicker trim no one will every notice (except you).