In your zoom settings you should be able to set your default to join with mic off (and video off if you want that too.) That way you have to enable any talking or video yourself rather than being video/mic on as you join.

I always have mine muted by default and push to talk for any talking.