When something like a planet is orbiting a massive object in a vacuum, the planet is moving sideways at the same time as falling into the massive object, so it keeps missing. The smaller inner planets are moving sideways much faster than the outer planets, so they continue to miss the sun.

That sideways motion combined with the gravitational pull towards the sun results in an elliptical orbit.