Lee Duna@lemmy.nz to Technology@lemmy.worldEnglish · 11 months agoWant a more private ChatGPT alternative that runs offline? Check out Janbgr.comexternal-linkmessage-square82fedilinkarrow-up1430
arrow-up1430external-linkWant a more private ChatGPT alternative that runs offline? Check out Janbgr.comLee Duna@lemmy.nz to Technology@lemmy.worldEnglish · 11 months agomessage-square82fedilink
minus-square🇸🇵🇪🇨🇺🇱🇦🇹🇪🇷@lemmy.worldlinkfedilinkEnglisharrow-up5·11 months agoI think a good 13B model running on 12GB of VRAM can do pretty well. But I’d be hard pressed to believe anything under 33B would beat 3.5.
minus-squaremiss_brainfart@lemmy.mllinkfedilinkEnglisharrow-up4·edit-211 months agoAsking as someone who doesn’t know anything about any of this: Does more B mean better?
minus-squarealphafalcon@feddit.delinkfedilinkEnglisharrow-up5·11 months agoB stands for Billion (Parameters) IIRC
I think a good 13B model running on 12GB of VRAM can do pretty well. But I’d be hard pressed to believe anything under 33B would beat 3.5.
Asking as someone who doesn’t know anything about any of this:
Does more B mean better?
B stands for Billion (Parameters) IIRC