Another way to look at this, is the only reason cold air is coming in through the door is because warm air is escaping out the top of the house somewhere. Hire a pro or learn up and DIY a Blower door test to negatively depressurize the house and then point an IR camera around should help you find those air leaks and many can be plugged with a simple can of spray foam.