It's one thing if they have your number that is linked to info to identify you.

It's another when a phone number is basically an incremental number, even scammers will work up the chain to call and see who answer.

Then there's companies that sell your data to others, and Meta/Facebook eventually obtains it.