Conversation

Notices

1. jjg (jjg@sunbeam.city)'s status on Wednesday, 09-Jan-2019 13:30:20 EST jjg

   Has anyone taken time to enumerate how dangerous this new Facebook feature is?

   https://techcrunch.com/2017/11/27/facebook-ai-suicide-prevention/

   If not I’ll take a whack, but if it’s already been covered I’m happy to syndicate 😁

   1. Bob Mottram 🔧 ☕ ✅ (bob@soc.freedombone.net)'s status on Wednesday, 09-Jan-2019 13:40:33 EST Bob Mottram 🔧 ☕ ✅

      in reply to
      @jjg I think it could have dangerous aspects. It depends on who the "first responders" are. Also this same type of system could be used to have "first responders" go after dissidents.
   2. Charles Stanhope (cstanhope@social.coop)'s status on Wednesday, 09-Jan-2019 13:43:02 EST Charles Stanhope

      in reply to

      @jjg Oh man, we really should not want Facebook to be our "machines of loving grace" here. And I hesitate to think about who are the "first responders" to most situations like that here in the US. AI instigated swatting...

      1. Charles Stanhope (cstanhope@social.coop)'s status on Wednesday, 09-Jan-2019 13:52:18 EST Charles Stanhope

         in reply to

         @jjg Reading through that article again, I think there's an unstated goal besides people's safety. Facebook wants the AI so it can filter out people posting or live streaming their suicides. Even if people aren't helped, if these events don't show up on Facebook, then they don't get negative press...

         1. jjg (jjg@sunbeam.city)'s status on Wednesday, 09-Jan-2019 16:29:35 EST jjg

            in reply to

            @cstanhope agreed.

            Also think of the advertising data for mood-altering pharmaceuticals...

   3. GCU Prosthetic Conscience (gcupc@glitch.social)'s status on Wednesday, 09-Jan-2019 13:44:50 EST GCU Prosthetic Conscience

      in reply to

      @jjg One obvious risk is them sending "first responders" (ie police) who are dangerous to the person in need of help. You get things like this: https://www.thedailybeast.com/man-threatens-suicide-police-kill-him

      Besides the privacy risks, and the risks of informing the wrong person (eg someone's domestic abuser) about the post.

      1. jjg (jjg@sunbeam.city)'s status on Wednesday, 09-Jan-2019 16:28:52 EST jjg

         in reply to

         @gcupc exactly the kind of risk I have in mind.

         Given the danger level of these interactions this system may *increase* deaths.

   4. Rowan :ancomheart: (queerquill@sunbeam.city)'s status on Wednesday, 09-Jan-2019 15:40:25 EST Rowan :ancomheart:

      in reply to

      @jjg this is the first im hearing of it. holy fuck, and its not like you can just delete fb- for some sites its the only way to login

      1. jjg (jjg@sunbeam.city)'s status on Wednesday, 09-Jan-2019 16:30:20 EST jjg

         in reply to

         @queerquill exactly. Also “ghost profiles” make Facebook essential inescapable to all but the most savvy.

   5. girl lover 9000 (dangerdyke@cybre.space)'s status on Wednesday, 09-Jan-2019 16:52:50 EST girl lover 9000

      in reply to

      @jjg this is terrifying. Even before all this there is video footage of cops responding to suicide attempt reports with "wellness checks" by breaking in with their guns drawn. Even without extrapolating use of the technology to target political dissidents or other persecuted minorities, this will endanger the lives of trans and POC people who are already suicidal by putting them in direct contact with police.

   6. _ (cybertrash@cybre.space)'s status on Wednesday, 09-Jan-2019 16:30:55 EST _

      in reply to

      @jjg
      The joking response is "looking forward to the cops kicking down the door of ironic edgy losers posting about nooses".

      I don't like Facebook trying to guess people's mental state, because first responders aside they will sell your crises to the first group to wave enough funds in their face.