Worries about joining book groups as a man

After seeing some posts here on book clubs, it's re-sparked my reservations about book clubs.

I've had rotten luck trying to find book groups that accept men and I'm unsure how to find some that will.

In the majority of cases where I've joined groups that accept anyone, I find myself struggling to break in. I come with my notes and thoughts, but I feel like I struggle to jump in.

I'm autistic, so perhaps that could be the true obstacle.

I'm located near london uk if anyone knows decent groups in the area