What are the negatives of having those athletes compete without a flag or national recognition? I truly don't see how this option could ruin the Olympics.

It's the same thing in tennis where some of the best players in ATP or WTA are from Russia/Belarus but I'd rather see them compete with no country beside their name than not compete at all.