• Riskable@programming.dev
    link
    fedilink
    English
    arrow-up
    2
    ·
    7 months ago

    Yeah… The big commercial models have system prompts that fuck it all up. That’s my hypothesis, anyway.

    You have to try it with an open source model. You tell it to turn the titles, URLs, and nothing else. That seems to work fantastic 👍

    I’m doing it with Open WebUI and ollama cloud which is open source models that you could run locally—if you have like $5,000 worth of hardware.