it sounds like the check valve is bad, stuck in the open position. The check value is usually screwed into the tank, it may look like a brass adapter fitting. The small ones are not that expensive or hard to replace.