That grimy feeling might be some sort of build up from fabric softener if you use that in your weekly washes. The build up is like a waxy substance that might speed up discoloration and also prevent the fabric from breathing. Once I’ve stopped using that my clothes and sheets and towels seem to last longer.