Unless you're running EQ then there shouldn't be a possibility of any clipping problems.

Anyway, you would lose a little bit of dynamic range. Probably not enough to make a practical difference.