• maria [she/her]@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    9
    ·
    5 days ago

    everything hits the tokenizer at some point 💀 which is where all data meets their maker.

    • a palm tree? 🌴 oh u mean generic tree with fancy leaves? 🌳❇️
    • a chair? 🪑 oh u mean symbols arranged chair-wise?
    • a heartfelt message to your crush? 💖 oh u mean char[]? (characters stringed together in a sequence)
    • a wonderful picture? u mean a list of colors and a columns count?

    everything loses detail after the tokenizer.

    • lfox02@lemmy.blahaj.zone
      link
      fedilink
      English
      arrow-up
      3
      ·
      5 days ago

      Behold, a man! - ChatGPT

      a wonderful picture? u mean a list of colors and a columns count?

      Isn’t that all digital photography anyway?

        • lfox02@lemmy.blahaj.zone
          link
          fedilink
          English
          arrow-up
          1
          ·
          4 days ago

          The joke is a cross between a famous anecdote about Diogenes and the inner workings of vision-capable AI models.

          Diogenes really liked to disrespect his social superiors, so when, in a lecture, Plato defined human beings as “featherless bipeds”, Diogenes plucked a chicken and presented it to him saying “Behold - Plato’s human being” (or something along those lines, the quote is slightly different in every source).

          In order to “see” things from images and video, a garden variety LLM needs to integrate with another model that analyzes the picture it is given and gives a text description (source: HuggingFace). What I’m getting at is that, based on that idea of stripping things of context, ChatGPT could probably confidently tell you something in the vein of Plato taking the piss due to its inherently limited ability to see.

          • maria [she/her]@lemmy.blahaj.zone
            link
            fedilink
            English
            arrow-up
            1
            ·
            4 days ago

            oh wowie no way someone did the reading on HUGGINGFACE??? wowie, never expected that link to make it to 196…

            anyway: good joke, i get it now, thank u.