SWE-Bench Verified by OpenAI tests how well a model can solve real bugs in real Python code from GitHub. These bugs are all public information — so the AI models have almost certainly trained on th…
  • abcdqfr@lemmy.worldEnglish
    1·
    18 hours ago

    I also likes to cheat on tests by studying every answer on the subject the test giver might put in the test??? We’ve got a computer than can study and pass tests, cmon. Where’s the real story?

    • V0ldek@awful.systemsEnglish
      4·
      10 hours ago

      Hey mate what do you think learning is. Like genuinely, if you were to describe the process of learning a subject to me.

    • YourNetworkIsHaunted@awful.systemsEnglish
      11·
      14 hours ago

      This isn’t studying possible questions, this is memorizing the answer key to the test and being able to identify that the answer to question 5 is “17” but not being able to actually answer it when they change the numbers slightly.

    • self@awful.systemsEnglish
      15·
      18 hours ago

      it’s appropriate that you think your brain works like an LLM, because you regurgitated this shitty opinion from somewhere else without giving it any thought at all