• Gsus4
    link
    fedilink
    English
    arrow-up
    8
    ·
    edit-2
    1 year ago

    I’ve tried it and so far it’s a bit underwhelming. Looks like no model so far can get close to the initial shock I had when chatGPT was released. They’re all nerfed to hell and have lots of guardrails.

      • Gsus4
        link
        fedilink
        English
        arrow-up
        3
        ·
        1 year ago

        Yea, I’m still using the openAI one and I’m very surprised google can’t match it, with the reams of data it collects and has stored over decades. There is something between model design and data quantity that openAI got right and I’m not sure exactly what it was, but I need to find a better name for it than “data cleaning” or “hyperparameter tuning”.

  • Lvxferre@lemmy.ml
    link
    fedilink
    English
    arrow-up
    5
    ·
    edit-2
    1 year ago

    I’m laughing my arse off of this. Just making dumb questions to ChatGPT.

    I’ll provide both the original query and translation.

    [Original] Qual a diferença entre o comportamento de uma laranja e uma batata?

    Laranjas e batatas são frutas e vegetais, mas se comportam de maneiras muito diferentes. Aqui estão algumas das principais diferenças[SIC]:
    Movimento: Laranjas não se movem sozinhas, enquanto batatas podem rolar ou deslizar se não forem apoiadas.
    Crescimento: Laranjas crescem em árvores, enquanto batatas crescem no subsolo.
    Sensibilidade: Laranjas não são sensíveis ao seu ambiente, enquanto batatas são sensíveis à luz e à temperatura.
    Reações: Laranjas não reagem a estímulos, enquanto batatas podem reagir a mudanças em seu ambiente, como brotar ou apodrecer.
    Propósito: Laranjas são comidas como frutas, enquanto batatas são comidas como vegetais ou usadas como amido.
    Em geral, laranjas são mais passivas e batatas são mais ativas. As laranjas não precisam fazer nada para sobreviver, enquanto as batatas precisam poder responder ao seu ambiente para crescer e se reproduzir.

    Aqui está uma tabela que resume as principais diferenças no comportamento de laranjas e batatas:

    • Característica | Laranja | Batata
    • Movimento | Não se move sozinho | Pode rolar ou deslizar se não for apoiado
    • Crescimento | Cresce em árvores | Cresce no subsolo
    • Sensibilidade | Não sensível ao ambiente | Sensível à luz e à temperatura
    • Reações | Não reage a estímulos | Pode reagir a mudanças no ambiente, como brotar ou apodrecer
    • Propósito | Comido como fruta | Comido como vegetal ou usado como amido
    [Translated] What's the difference in behaviour between an orange and a potato?

    Oranges and potatoes are fruits and vegetables, but they behave in completely different ways. Here are some differences main [SIC]:
    Movement: Oranges don’t move on their own, while potatoes can roll or slid if not supported.
    Growth: Oranges grow on trees, while potatoes grow in the subsoil.
    Sensibility: Oranges are not sensible to the environment, while potatoes are sensible to light and temperature.
    Reactions: Oranges don’t react to stimuli, while potatoes can react to changes in the environment, like sprouting and rotting.
    Purpose: Oranges are eaten as fruits, while potatoes are eaten as vegetables or used as starch.
    In general, oranges are more passive and potatoes are more active. Oranges don’t need to do anything to survive, while potatoes need to be able to answer to their environment to growth and reproduce.

    Here’s a table summing up the main differences in behaviour between oranges and potatoes:

    • Feature | Orange | Potato
    • Movement | Can’t move on their own | Can roll or slid if not supported
    • Growth | Grow on trees | Grow in the subsoil
    • Sensibility | Not sensible to the environment | Sensible to light and temperature
    • Reactions | Don’t react to stimula | Can react to changes in the environment, like sprouting or rotting
    • Purpose | Eaten as fruit | Eaten as veg or used as starch

    Okay… this is so fucking dumb in so many fucking levels that I don’t… I don’t even…

    • “Oranges and potatoes are fruits and vegetables” - Wrong. Oranges are fruits, potatoes are vegetables. The original does not imply which is which, it implies that both belong to both categories.
    • “Oranges don’t move on their own, while potatoes can roll or slid if not supported” - yeah, TIL oranges totally don’t roll. Not at all. And not considerably easier than potatoes do.
    • “potatoes grow in the subsoil” - I might be wrong but don’t they grow in the soil? As in, the upper layer? (Don’t trust me on that.)
    • “Oranges are not sensible to the environment” - yeah… leave an orange under the sun for some time, and then come back saying that. Or in a wet cloth.
    • “Oranges don’t react to stimuli, while potatoes” - *rolls eyes*
    • “In general, oranges are more passive and potatoes are more active.” - I swear that I am not translating this wrong.

    Granted, I did a tricky question to fool the bot, but note how it’s hallucinating all the time. And it does not model whatsoever utterance purpose; for example what’s the point of labelling potatoes “active” and oranges “passive”?

    There’s also a small linguistic issue with word order. “Principais diferenças” (adjective then noun) is allowed in Portuguese only in a few, very specific situations; it sounds off in this context. For most part you’d use “diferenças principais” (noun then adjective). It’s a small detail though; on a grammatical level the bot is okay, the issue is on semantic and pragmatic levels.


    EDIT: I also asked in Venetian “Cuaƚa difarensa infra ƚa patata e ƚa naransa?” (what’s the difference between the potato and the orange?). Bard surprisingly enough understood the question… and answered it in English. On the other hand, it answered “Quali sono le novità di oggi?” (“which are the news of today?”) in “grammatical” Italian.