HanaBothWays t1_jac9ad2 wrote on February 28, 2023 at 11:57 AM

This is an expansion of the existing tool to remove CSAM which has been around for a long time.

If you are a teenager and someone spread around the photos you shared with them, or if you’re an adult now but someone spread around nude photos of you as a teen from way back when (or you’re worried that they will as a form of revenge porn), you can upload hashes of those photos to this tool and they will be detected and removed when someone uploads them, like known CSAM content is.

freediverx01 t1_jaceg2s wrote on February 28, 2023 at 12:51 PM

What mechanisms are in place to prevent people from submitting random photos just because they don’t like porn?

HanaBothWays t1_jacf8pt wrote on February 28, 2023 at 12:59 PM

It doesn’t say.

But the tool, like the CSAM takedown system, is coordinated with the National Center for Missing & Exploited Children (NCMEC) and adult sites like Pornhub and Onlyfans use the CSAM tool, so even if they aren’t talking about it in the article they have something in place to prevent that. If it could easily be gamed to take down legal, consensually posted pornography featuring adults, Pornhub and Onlyfans would not be voluntarily using it.

freediverx01 t1_jaclir0 wrote on February 28, 2023 at 1:53 PM

This system is ripe for abuse without any outside oversight. All it takes is for that organization to be controlled by a group of reactionary right wingers, and then they can ban anything they want.

HanaBothWays t1_jaco6si wrote on February 28, 2023 at 2:14 PM

Just because the anti-abuse safeguards are not detailed in the article doesn’t mean they don’t exist.

It doesn’t talk about the specific hash functions used for this thing either but those definitely exist and they are definitely using them.

freediverx01 t1_jacrudt wrote on February 28, 2023 at 2:40 PM

My concern is based on the lack of oversight and transparency of an organization with so much potential power. We have a long history of attacks on civil liberties under the banners of child protection and counter-terrorism.

HanaBothWays t1_jacuass wrote on February 28, 2023 at 2:58 PM

When the big porn sites start having issues with NCMEC and how they curate their databases, I’ll worry about that. But they all seem to get along fine right now, so I’m not worried about it.

freediverx01 t1_jadi20h wrote on February 28, 2023 at 5:33 PM

You’ll have to forgive me, but when the supreme court has become so completely politicized and illegitimate, it’s hard to have any faith in the resiliency of any other institutions.