Viewing a single comment thread. View all comments

alwaysaloneguy t1_j1bto65 wrote

John Oliver did a segment on Data Brokers a few months back that I found both horrifying and fascinating. The sophistication of the software needed to go through all of that data and connect those dots

23

tigernamednoel t1_j1c869b wrote

It’s super interesting and as you said complex. Bit scared of it when I started at my company and now just resigned to the fact that it’s happening. From a technical side though it’s a very very interesting thing to work on, and how one company does it is very different from others. Some techniques are optimized for speed and real time queries while others are definitely more in depth and are built to provide extremely comprehensive data points.

10

KmartQuality t1_j1emfan wrote

Every Walmart sends many gigabytes of purchasing data back to HQ every day.

1