Stamets@lemmy.world to People Twitter@sh.itjust.works · 11 months agoThe dreamlemmy.worldimagemessage-square250fedilinkarrow-up11.99K
arrow-up11.99KimageThe dreamlemmy.worldStamets@lemmy.world to People Twitter@sh.itjust.works · 11 months agomessage-square250fedilink
minus-squarearthurpizza@lemmy.worldlinkfedilinkEnglisharrow-up2·11 months agoThose server farms are because the needs of corporations might just be different from the needs of regular users. I’m running a 8 GB LLM model locally on my PC that performs better than 16 GB models from just a few months ago. It’s almost as if technology can get better and more efficient over time.
Those server farms are because the needs of corporations might just be different from the needs of regular users.
I’m running a 8 GB LLM model locally on my PC that performs better than 16 GB models from just a few months ago.
It’s almost as if technology can get better and more efficient over time.