☆ Yσɠƚԋσʂ ☆@lemmy.ml to Technology@lemmy.mlEnglish · 26 days agoBonsai 27B: The First 27B-Class Model to Run on a Phoneprismml.comexternal-linkmessage-square1fedilinkarrow-up18cross-posted to: technology@midwest.socialhackernews@lemmy.bestiver.se
arrow-up18external-linkBonsai 27B: The First 27B-Class Model to Run on a Phoneprismml.com☆ Yσɠƚԋσʂ ☆@lemmy.ml to Technology@lemmy.mlEnglish · 26 days agomessage-square1fedilinkcross-posted to: technology@midwest.socialhackernews@lemmy.bestiver.se
minus-squareIrdial@lemmy.mllinkfedilinkEnglisharrow-up2·26 days agoI’m surprised that the model’s benchmark performance isn’t that much worse than the base given that it’s running with 1-bit quantization. Impressive.
I’m surprised that the model’s benchmark performance isn’t that much worse than the base given that it’s running with 1-bit quantization. Impressive.