• FunkyStuff [he/him]@hexbear.net
        link
        fedilink
        English
        arrow-up
        9
        ·
        29 days ago

        It’s the same thing though, no? Whatever power it takes to run a query in dedicated hardware in a data center is the same or lower than the power to do it on a cell phone. On a cell phone it’s even worse because charging the battery, then using battery power to run AI queries is less efficient than just powering a GPU to run several queries in parallel. That’s without getting into other efficiencies of scale and the fact that a data center is designed to keep power usage low compared to an iPhone which is designed to be the worst consumer product someone will pay $1000 for.

        • fuckwit_mcbumcrumble@lemmy.dbzer0.com
          link
          fedilink
          English
          arrow-up
          7
          ·
          29 days ago

          It’s the same thing though, no?

          Not even close. A phone is lightyears more efficient than a server because it has to run on a battery. A server just needs to not outpace the air conditioning unit positioned right in front of it. Servers do a lot more per watt than say a desktop or maybe even a laptop. But phones do so much with almost no power otherwise you’d get an hour of battery life.

          • FunkyStuff [he/him]@hexbear.net
            link
            fedilink
            English
            arrow-up
            5
            ·
            29 days ago

            You’re right that phones are more efficient than I gave them credit for, but power costs are absolutely a consideration for the tech companies that are training large models.

            Besides, how much more power efficiency does a phone have that it can make up for only doing 1 query at a time compared to a GPU running several at a time, benefiting from cache locality since it’s just using the same data over and over for different queries, etc? I highly doubt that the efficiency of scale could be outweighed by mobile hardware’s power usage edge.

            • fuckwit_mcbumcrumble@lemmy.dbzer0.com
              link
              fedilink
              English
              arrow-up
              6
              ·
              29 days ago

              The key is that Apples model isn’t all that large, and that’s how they’re targeting being able to do it efficiently on a phone. It also sucks so IDK.

    • Kiagz [she/her]@hexbear.net
      link
      fedilink
      English
      arrow-up
      8
      ·
      29 days ago

      It’s so great. You can’t even buy a new washing machine now without AI being crammed into it. I’m sure the next kettle I buy will also have AI, somehow

  • DragonBallZinn [he/him]@hexbear.net
    link
    fedilink
    English
    arrow-up
    34
    ·
    29 days ago

    Who the hell even ASKED for this? The fact that tech companies insist on cramming it down everyone’s throat makes me hate it even more.

    Don’t suppose there’s a Linux phone?

    • Azarova [they/them]@hexbear.net
      link
      fedilink
      English
      arrow-up
      12
      ·
      29 days ago

      Don’t suppose there’s a Linux phone?

      Linux phones have considerable problems unfortunately. The biggest being battery life, which is a problem with Linux in general. The other major hurdle is getting certain apps to work, banking apps being the biggest difficulty. If what you’re really looking for is a phone that you have much more control over, I would suggest an alternative android-based OS. I was in a similar position as you, looking for a phone I could control and trust, and I ultimately landed with a Pixel phone with GrapheneOS, which I have been immensely happy with and it gave me pretty much everything I was looking for in a Linux phone. GrapheneOS is only developed for the Pixel series of phones though, so if you’re looking at different models (or have a non-Pixel already), then you’ll need a different OS. There’s been some good threads about it on here if you search around.

  • goose [he/him]@hexbear.net
    link
    fedilink
    English
    arrow-up
    20
    ·
    29 days ago

    The notification and email summaries are generally useful, but every once in a while it’ll call an anniversary party email thread an “Annihilation party” or imply that there are six people at the door because it’s grouping six separate notifications.

  • stigsbandit34z [they/them]@hexbear.net
    link
    fedilink
    English
    arrow-up
    20
    ·
    29 days ago

    ? We literally don’t need this at all? What the actual fuck

    Plus it’s just adding to the already massive amounts of environmental damage that tech does to begin with