• Jiral@lemmy.org
    link
    fedilink
    English
    arrow-up
    3
    ·
    1 day ago

    But the benchmarks are semi useless. Performance at new problems in your precise use case matter and that’s only something one can find out you using it. This can differ wildly from what benchmarks suggest. AI can be an ability enhancer when for example someone who has no idea hos to code suddenly manages to create crappy code but that manages to do a job where for example success can be easily verified. But if the result should ve good or even reliable … well…