I think a LLM waifu would cost me as much as a dating a real girl for a while. The game was rigged from the start…
If you are smart about the hardware you buy and are comfortable with building your own PC case, you can easily make a LLM rig for less money than a 3090.
All you need is one of these old server boards with 11 PCIe slots, and as many older GPUs as you can afford. Deepspeed will make all the difference c:
Begun, the AI waifu wars have.
OK, but does anyone have the sauce on the image used in the original Chan post?
I can’t find the source but maybe you have better luck than me
I dug around and found it https://www.pixiv.net/en/artworks/109645337
I’m gonna build myself an AI waifu. I’ve gotten koboldAI and sillytaverm working, but I need a better GPU for performance.
Consider give https://github.com/LostRuins/koboldcpp or https://github.com/oobabooga/text-generation-webui (specifically the llama.cpp model loader) a try as well. llama.cpp allows you to run a model off your CPU. I don’t personally use it but apparently the performance is decent.
