The wall drags only the layer of liquid in contact with it. That layer drags along another layer a little less, that next layer drags along another layer even less and so on. The intensity of the dragging at a certain distance of the wall is the literal definition of viscosity.