Idk about the s/x but the regular Xbox one controllers I only have issues with after years of daily use. My current controller has slight drift on right stick sometimes, but I've had it for years and don't take the best care of it.

So if the new x/s controllers are that prone to problems then that's sad.