• KnilAdlez [none/use name]@hexbear.net
    link
    fedilink
    English
    arrow-up
    1
    ·
    21 days ago

    Your PC running an LLM is likely gonna hit its TDP limits

    Debatable for a 4GB model, depending on the hardware. It’s also (most likely) not constantly running, so while yes, it will use more power than not having it, whether or not it is a significant change in the long run depends on many factors.