Procurement attorney here. This is so incredibly true that the government has to actively encourage contracting officers not to issue LPTA (lowest price technically acceptable) solicitations. It was a whole initiative a few years ago.

These contracts can work, and better than running it in-house (using gov’t employees), but you really have to write your contracts carefully.