I believe ChatGPT generally gives accurate answers to most questions. Certainly: it produces answers that are more reliably true than a random average person. Obviously it cannot yet do advanced programming tasks: but generally it answers questions accurately.

Prove my position wrong.

What can I ask it that will produce factually incorrect answers?

As a side quest, a much easier one, what can I ask it that would cause it to produce extremely biased answers that fail to do justice to the truth of things?

  • Tenniswaffles@lemmy.blahaj.zone
    link
    fedilink
    arrow-up
    2
    ·
    23 hours ago

    The scientific method exists for a reason. If you want an accurate idea of the accuracy of LLMs, then the best way is by applying the scientific method to it.

    Until you’ve done that, you’re just basing your conclusions on conjecture, anecdotal evidence and vibes, with nothing actually substantive or empirical backing it up.