The conductors supplying the plates would also be at a million volts, so would also need insulating with something of huge dielectric strength. You also need to consider the discharge characteristics of a capacitor - almost the inverse of a battery, so the energy would need to be exploited in a fundamentally different way.