While any energy harvested ultimately comes from work done by the wearer, it isn’t necessarily entirely additional work that wouldn’t be done if wearing non-energy harvesting fabric. It’s just that the energy transferred to the fabric can potentially be harvested for orher purposes by the carbon nanotube yarn.

With that said, I assume a useful energy harvesting fabric would feel like smoothly flowing lightweight silk. Hopefully it would be better than sackcloth though!