Not self defense, he did not assault you nor verbally threaten your safety. And you’re clearly self aware of your issues so I don’t think being autistic is gonna work as an excuse either. Part of being an adult is recognizing your weak spots and working on them. Sounds like you need to work on ignoring people. Move forward and grow from it.