The simple is answer is: sand big, clay small. Clay particles are tiny, so they hold more water between them (more surface area per volume). Sand is basically tiny rocks, which themselves don't shrink at all. The shrinkage happens when the water between the particles evaporates. The sand is holding less water, thus less shrinkage.