• NewOldGuard@lemmy.ml
    link
    fedilink
    English
    arrow-up
    2
    ·
    21 days ago

    I think their point is that regular web browsing will use less power than web browsing with local LLM calls. Your PC running an LLM is likely gonna hit its TDP limits, while browsing will be a fraction of that. Yes it’s less power than used by a trillion parameter model but I think their point is it’s vastly more than your non-LLM standard browsing would be

    • KnilAdlez [none/use name]@hexbear.net
      link
      fedilink
      English
      arrow-up
      1
      ·
      21 days ago

      Your PC running an LLM is likely gonna hit its TDP limits

      Debatable for a 4GB model, depending on the hardware. It’s also (most likely) not constantly running, so while yes, it will use more power than not having it, whether or not it is a significant change in the long run depends on many factors.