If spot heating key areas while they are in use allows you to set-back the whole-house temperature, that can save a good bit. Electric heaters, pellet stoves, etc. can all be used that way.

As others have said, electric heat pumps tend to be much cheaper than oil and there are potential tax incentives or rebates right now that can make them more affordable.