Stamets@lemmy.world to People Twitter@sh.itjust.works · 1 year agoThe dreamlemmy.worldimagemessage-square250fedilinkarrow-up11.99K
arrow-up11.99KimageThe dreamlemmy.worldStamets@lemmy.world to People Twitter@sh.itjust.works · 1 year agomessage-square250fedilink
minus-squarearthurpizza@lemmy.worldlinkfedilinkEnglisharrow-up2·1 year agoThose server farms are because the needs of corporations might just be different from the needs of regular users. I’m running a 8 GB LLM model locally on my PC that performs better than 16 GB models from just a few months ago. It’s almost as if technology can get better and more efficient over time.
Those server farms are because the needs of corporations might just be different from the needs of regular users.
I’m running a 8 GB LLM model locally on my PC that performs better than 16 GB models from just a few months ago.
It’s almost as if technology can get better and more efficient over time.