I feel like you definitely can get away with as much as even 5, but if you actually look at the CLI, it will tell you how many draft tokens actually got accepted. In some situations like writing simple text, over 90% of my two draft tokens get accepted so setting it to five would have made it faster. However if you run a task which requires heavy reasoning, even two draft tokens start approaching close to only 60%. Considering Qwen3.8-27B overthinks more than an anxious teenage girl, you should generally with two. If you take my example with the quant dropped to UD-Q5_K_XL with 262K tokens and reasoning low for a task that isn’t actually complex, just long, then go right ahead and let it run with 5.
Edit: excuse the horrendous grammar, I was distracted
I feel like you definitely can get away with as much as even 5, but if you actually look at the CLI, it will tell you how many draft tokens actually got accepted. In some situations like writing simple text, over 90% of my two draft tokens get accepted so setting it to five would have made it faster. However if you run a task which requires heavy reasoning, even two draft tokens start approaching close to only 60%. Considering Qwen3.8-27B overthinks more than an anxious teenage girl, you should generally with two. If you take my example with the quant dropped to UD-Q5_K_XL with 262K tokens and reasoning low for a task that isn’t actually complex, just long, then go right ahead and let it run with 5.
Edit: excuse the horrendous grammar, I was distracted