Not really. It's gonna spark as you make the circuit. It's pretty inevitable. The circuit is complete ever so slightly before the metal makes contact because the voltage is enough to jump the air gap which is the spark you see.

Normally you don't really see it due to the angles involved (leaning over to plug something in at shin height) or because you're plugging in a device that's turned off and so the circuit doesn't complete until you manually switch it on.

As long as it's fully inside the outlet and only happens when you plug/unplug something, it's probably fine.