It sounds like the "gap" between the drywall and the floor is not the issue. Is the air coming through the concrete? Or between the concrete and the bottom plate of the framing? Or from above the bottom plate?

It seems more likely you need to seal the drywall to the framing.

Others have mentioned moisture from the other side of wall. Hopefully there is a barrier between the framing and the wet dirt around you.