Men tend towards larger upper body size, heavier musculature, larger overall skeleton, higher quantities and more locations for body hair, etc.

Women tend towards lighter frames, larger hips, gozongas, less body hair in fewer places, etc.

Men and women even store fat differently after puberty with women storing it more subcutaneously (better insulation for the baby cooker) and men storing it more around their vital organs (bad for your long term health but good for protecting your organs in combat).

Fun fact though... higher estrogen in women and higher testosterone in men has a similar effect on the vocal cords, making the voice deeper. Men get that deep bass like Vin Diesel and women get that sultry husky voice like Scarlett Johansson.