I’m calling it now, the adoption of AI agents into software development will be one of the most costly mistakes in the field’s history. Agents cannot program, and it’s taking longer and longer to realize that they can’t. They are a highly sophisticated statistical model designed to mimic the distribution of programming. The output is broken, but in a way that’s getting harder and harder to detect. Which is exactly what you’d expect from an increasingly accurate statistical model.

  • Tiresia@slrpnk.net
    link
    fedilink
    English
    arrow-up
    1
    ·
    6 hours ago

    What do you mean LLMs don’t learn? How do you think they became capable of stringing a sentence together?

    They don’t learn during a deployment, but neither do humans; humans only learn during sleep. The behaviors a human exhibits while “learning” in the moment are just stochastic parrot behaviors based on their immediate context window, if the human doesn’t sleep in time the event can slip out of their context window and they don’t learn despite having acted as if they do.

    You seem to be very naive about human learning in general. What makes the “truth” of school lessons greater than the “truth” of an LLM’s curated dataset it is reinforcement learned on? Have you ever seen actual evidence that mitochondria exist, or are you just stochastically parroting your biology teacher?

    I also oppose LLMs in almost all applications (live translation being an example of a good application). But please oppose it with arguments based in reality.

    • Log in | Sign up@lemmy.world
      link
      fedilink
      arrow-up
      6
      ·
      5 hours ago

      What do you mean LLMs don’t learn? How do you think they became capable of stringing a sentence together?

      You’re confusing constructing the LLM, which is done with an actual AI (neural network) and a massive corpus of text (stolen from millions of humans in the greatest intellectual theft in history) and running the LLM, which is done with a random number generator and a massive matrix of probable next words.

      They don’t learn during a deployment,

      They don’t learn. They don’t change. They’re as random next time as this time.

      but neither do humans; humans only learn during sleep.

      False and false. Soooo much pseudoscience.

      The behaviors a human exhibits while “learning” in the moment are just stochastic parrot behaviors

      Wrong again.

      if the human doesn’t sleep in time the event can slip out of their context window and they don’t learn despite having acted as if they do.

      If that were true, most people would learn very badly first thing in the morning and get better and better later in the day. I think you’ll find that most school teachers would vehemently disagree with your nonsense conclusions.

      Then again, perhaps by “doesn’t sleep in time” you mean stays up all night, then admittedly they might function less well cognitively but (a) we tend not to regularly torture humans that way and (b) you’re massively overstating the role of sleep in the learning process.

      You seem to be very naive about human learning in general.

      No, you seem to be very naive indeed, to extremes, about the intelligence and reliability of LLMs. When I ask them about general things that I know about, I tend to get the right answer about 60%-70% of the time. Why would I believe it when I didn’t know the answer. To trust an LLM to tell you the truth about stuff you aren’t checking when it clearly blags nonsense so frequently when you are is really really stupid.

      What makes the “truth” of school lessons greater than the “truth” of an LLM’s curated dataset it is reinforcement learned on?

      Most teachers tend to consistently teach the content of the syllabus rather than randomise what they say to classes based on the preceding conversation. They reinforce and update their prior knowledge by also learning from the mark schemes of the tests and exams their students sit.

      Have you ever seen actual evidence that mitochondria exist, or are you just stochastically parroting your biology teacher?

      No. I trust my teachers. I am rational to do so. I don’t trust LLMs. You are irrational to do so.

      But please oppose it with arguments based in reality.

      You are utterly deluded and have bought the hype. You seem unable to distinguish between distinct things and are dismissing a large amount of evidence that your “just as good as a human” is a crap-spewing shit machine, no more honest than donald J trump, and with no less sharting.