Abrinoxus@lemmy.today to Aneurysm Posting@sopuli.xyz · 2 months agod whalemmy.todayimagemessage-square18fedilinkarrow-up1341file-text
arrow-up1341imaged whalemmy.todayAbrinoxus@lemmy.today to Aneurysm Posting@sopuli.xyz · 2 months agomessage-square18fedilinkfile-text
minus-squareMeron35@lemmy.worldlinkfedilinkarrow-up4·2 months agoA fair bit. EmbeddingGemma is open weights and allows for 128-768 dimensions. It’s not as simple as more dimensions = better, due to size, efficiency, and context rot limitations though. Introducing EmbeddingGemma: The Best-in-Class Open Model for On-Device Embeddings - Google Developers Blog - https://developers.googleblog.com/en/introducing-embeddinggemma/
A fair bit. EmbeddingGemma is open weights and allows for 128-768 dimensions.
It’s not as simple as more dimensions = better, due to size, efficiency, and context rot limitations though.
Introducing EmbeddingGemma: The Best-in-Class Open Model for On-Device Embeddings - Google Developers Blog - https://developers.googleblog.com/en/introducing-embeddinggemma/