And the real maddening part is that search engines have been so enshitfied to make way for AI that’s wrong like 9/10, so you’re forced to rely on it for answers because if you try google, the snake wraps around and eats it’s own tail giving you an AI answer! stalin-stressed

  • neo [he/him]@hexbear.net
    link
    fedilink
    English
    arrow-up
    7
    ·
    8 days ago

    Yeah but inference cannot exist without the prohibitively expensive up-front cost of training. And of course the larger the model the more costly the inference. That’s why you read stories like “new trend in SV: pay in tokens.” Opus 4.6 is gonna mop the floor with a 2B param model designed to run on an edge PC, but the cost of getting to the point that it can be used, and actually using it, is still very high.