ChatGPT went from answering a simple math correctly 98% of the time to just 2%, over the course of a few months.

By June, “for reasons that are not clear,” ChatGPT stopped showing its step-by-step reasoning.

  • @emptyother@lemmy.worldEnglish
    3•1 year ago

    This is probably very unlikely and I got no idea what I’m talking about: But what if feeding it even small amounts of its own content, text produced by a chatgpt instance, poisons it? That it gets confused from being fed text that adheres perfectly to its own rules, and locks that text down as perfect and not needing small variations.

    I remember some article warning about this in a big scale, and I’m thinking why must it be big? If its only a probability tree, even small changes to the probability would cause issues further up the branches.

    But blind speculation.

    • @habanhero@lemmy.caEnglish
      3•1 year ago

      I don’t know if small amounts of text could do that, but I could imagine if LLMs keeps get trained on data generated by itself and other LLMs (which is likely to become a major source of content on the internet in the future), the quality of output can decrease significantly over time.