Exactly. That's why the idea of "thoughtcrime" from 1984 was so horrific, because you can't fully control what you think even when you have a very strong incentive from a repressive state to do so.

Denying anyone their individual rights because of their political or other beliefs should be a horrifying idea too. Only actions likely to lead to harm should lead to restrictions to your rights. Like public calls to or threats of violence