da_cow (she/her)@feddit.org to 196@lemmy.blahaj.zoneEnglish · 23 天前let me rule to you: Israel GPTfeddit.orgimagemessage-square100fedilinkarrow-up11.01K
arrow-up11.01Kimagelet me rule to you: Israel GPTfeddit.orgda_cow (she/her)@feddit.org to 196@lemmy.blahaj.zoneEnglish · 23 天前message-square100fedilink
minus-squareboonhet@sopuli.xyzlinkfedilinkEnglisharrow-up5·23 天前They can be deterministic, but you can vary the temperature and also use seeds
minus-squarevoodooattack@lemmy.worldlinkfedilinkEnglisharrow-up1·23 天前I didn’t say they normally aren’t. What I’m saying is that a shared KV-Cache removes that guarantee by introducing an external source of entropy.
They can be deterministic, but you can vary the temperature and also use seeds
I didn’t say they normally aren’t. What I’m saying is that a shared KV-Cache removes that guarantee by introducing an external source of entropy.