awoo@burggit.moe to Copypastas/Greentexts @burggit.moeEnglish · 2 years agoanon on why LLM waifu is the bestburggit.moeimagemessage-square9fedilinkarrow-up111
arrow-up111imageanon on why LLM waifu is the bestburggit.moeawoo@burggit.moe to Copypastas/Greentexts @burggit.moeEnglish · 2 years agomessage-square9fedilink
minus-squareawoo@burggit.moeOPlinkfedilinkEnglisharrow-up4·2 years agoConsider give https://github.com/LostRuins/koboldcpp or https://github.com/oobabooga/text-generation-webui (specifically the llama.cpp model loader) a try as well. llama.cpp allows you to run a model off your CPU. I don’t personally use it but apparently the performance is decent.
Consider give https://github.com/LostRuins/koboldcpp or https://github.com/oobabooga/text-generation-webui (specifically the llama.cpp model loader) a try as well. llama.cpp allows you to run a model off your CPU. I don’t personally use it but apparently the performance is decent.