lens0021@programming.dev to AI@lemmy.ml · 9 days agoDocker Model Runner is now Generally Availablewww.docker.comexternal-linkmessage-square1fedilinkarrow-up15file-textcross-posted to: docker@programming.dev
arrow-up15external-linkDocker Model Runner is now Generally Availablewww.docker.comlens0021@programming.dev to AI@lemmy.ml · 9 days agomessage-square1fedilinkfile-textcross-posted to: docker@programming.dev
minus-squarevermaterc@lemmy.mllinkfedilinkarrow-up3·edit-29 days agoDo you guys successfully use small self hosted models somewhere? Although I can see a use case for LLMs, it’s always the biggest ones that can output any useful results (and by “biggest” I usually mean: the ones I can’t afford to run by myself)
Do you guys successfully use small self hosted models somewhere? Although I can see a use case for LLMs, it’s always the biggest ones that can output any useful results (and by “biggest” I usually mean: the ones I can’t afford to run by myself)