Those are mollies. There is a piece on the back that prevents you from removing them, which is how they work. I’d suggest taking a chisel and sliding it behind them, gradually shearing off the plastic. The part inside the wall can stay there, and you can use joint compound to patch the hole.

Could also use a drill and just drill the center right out.