This guy has the Qwen 3.8 177b MoE running on 12gb vram with 64gb of ram, getting 24.4 tokens/sec. A bit more resource hungry than the Qwen3.6 35b, but not by much and still well within the realm of home usage for what is essentially a Frontier model.
Word. it may be worth it for you to check out his Qwen 3.6 35b on a 1060 vid as well to get something almost as capable but probably much more faster on your rig. I was getting 23 tokens/sec on that one with my 1080 and 24gb of ram. And it’s a pretty capable model as well. It’d probably fly on what you’re running.
Yeah true—I liked his breakdown of slower thinker, then faster do-er model setup. I have 3.6 35b on LM studio, but need to look at his optimizations because even with 4090/64gb ram it was pretty slow. Will be a good project ;)