You can also build/buy inserts that go over your windows to keep the draft out.

We have pretty good windows (older replacements) but I built inserts anyway and they keep our bedroom noticeably warmer.