• NewOldGuard@lemmy.ml
      link
      fedilink
      English
      arrow-up
      2
      ·
      20 days ago

      I think their point is that regular web browsing will use less power than web browsing with local LLM calls. Your PC running an LLM is likely gonna hit its TDP limits, while browsing will be a fraction of that. Yes it’s less power than used by a trillion parameter model but I think their point is it’s vastly more than your non-LLM standard browsing would be

      • KnilAdlez [none/use name]@hexbear.net
        link
        fedilink
        English
        arrow-up
        1
        ·
        20 days ago

        Your PC running an LLM is likely gonna hit its TDP limits

        Debatable for a 4GB model, depending on the hardware. It’s also (most likely) not constantly running, so while yes, it will use more power than not having it, whether or not it is a significant change in the long run depends on many factors.