Yes, and for this reason submarines don't use active (pinging) sonars when they are trying to stay undetected. In fact any noise a submarine makes can be used to detect it, so submarine designers go to a lot of effort to make their submarines as quiet as possible, with things like machinery noise from the engines, and noise from the propellers, being particularly important. While detecting the noise of an otherwise hidden submarine can give you a good idea of the direction it is from you, using directional sound detectors, it it somewhat harder to determine the distance it is, unless you have several listening devices that are separated by a large enough distance to get a good triangulation.

If you haven't seen it, watch the Hunt for the Red October. It's a classic movie, and gives a good sense of how submarines try to find one another, and how they try to avoid being found. "One ping only" is a classic moment from that film.