It is a question of timescales. Capacitors are typically used to “smooth out” power over timescales of nanoseconds to seconds (super capacitors can sometimes go up to minutes or hours). Batteries can smooth out power over timescales of minutes to years.

Batteries are also better at “clamping” to a certain voltage, while capacitor voltage is typically more variable.