AI researchers found that widely used safety training techniques failed to remove malicious behavior from large language models — and one technique even backfired, teaching the AI to recognize its triggers and better hide its bad behavior from the researchers.

Poisoned AI went rogue during training and couldn’t be taught to behave again in ‘legitimately scary’ study::AI researchers found that widely used safety training techniques failed to remove malicious behavior from large language models — and one technique even backfired, teaching the AI to recognize its triggers and better hide its bad behavior from the researchers.

      • JustMy2c@lemm.eeEnglish
        1·
        1 年前

        So you’re saying that “Inflammatory data” isn’t a reference to reddit? :D

        • Daxtron2@startrek.websiteEnglish
          3·
          1 年前

          Not inherently, I’m sure that’s part of it but it’s really everywhere. Even here on Lemmy I’ve run into nasty folk

        • kent_eh@lemmy.caEnglish
          2·
          1 年前

          I’d say using Twitter and Facebook would be worse than reddit. Or, and I shudder to think about it, truth social…

        • Chris@lemmy.worldEnglish
          1·
          1 年前

          No, LLM is the AI, OP is saying if you train it with hate it’s gonna spit out hate

          • JustMy2c@lemm.eeEnglish
            1·
            1 年前

            And I’m saying that reddit data is sublime for Ai. And specifically that it’s invested with toxicity