@sabreW4K3@lazysoci.al to Tech@programming.dev • 2 months agoThe first GPT-4-class AI model anyone can download has arrived: Llama 405Barstechnica.comexternal-linkmessage-square10fedilinkarrow-up167cross-posted to: technology@lemmy.world
arrow-up167external-linkThe first GPT-4-class AI model anyone can download has arrived: Llama 405Barstechnica.com@sabreW4K3@lazysoci.al to Tech@programming.dev • 2 months agomessage-square10fedilinkcross-posted to: technology@lemmy.world
minus-square@xionzui@sh.itjust.workslinkfedilink9•edit-22 months agoYou can get usable performance on a CPU with good memory bandwidth. Apple studios are the best way to get that right now, but a good Epyc with 256GB of RAM works too. Of course, you could also just run 5 GPUs
minus-square@IsThisAnAI@lemmy.worldlinkfedilink5•2 months ago“usable” sure if you want to wait 10 minutes a word.
You can get usable performance on a CPU with good memory bandwidth. Apple studios are the best way to get that right now, but a good Epyc with 256GB of RAM works too.
Of course, you could also just run 5 GPUs
“usable” sure if you want to wait 10 minutes a word.