cross-posted from: https://lemmy.dbzer0.com/post/32023985

Writing a 100-word email using ChatGPT (GPT-4, latest model) consumes 1 x 500ml bottle of water It uses 140Wh of energy, enough for 7 full charges of an iPhone Pro Max

    • SlopppyEngineer@lemmy.world
      link
      fedilink
      arrow-up
      17
      ·
      2 days ago

      That’s physics. For a closed loop system, the cooling has to be done with air, which is less efficient and that doesn’t work so well in say Texas in summer.

      • curbstickle@lemmy.dbzer0.com
        link
        fedilink
        arrow-up
        4
        ·
        edit-2
        1 day ago

        Making it a stupid design, yes.

        Edit: putting your massive heat generating data center (beyond what most DCs will do) in support of AI in Texas is stupid.

        Closed loop systems absolutely have other options in design, which ive mentioned in another comment chain.

        As terrible as they are as companies, meta, apple, and others have made much more appropriate decisions - like locating their big load DCs in cold climates, partnering with the locale to make use of the heat being generated, removing the need for power to be used to perform those tasks - making them not only efficient designs, but compared to putting a DC in Texas like a dipshit (or LA, or NV, or anywhere else with a hot climate), makes the whole thing better for the environment.

        Yes, its a stupid design.

      • Flying Squid@lemmy.world
        link
        fedilink
        arrow-up
        6
        ·
        edit-2
        2 days ago

        I am so not an engineer, so maybe this is super stupid, but would there be some way to make it a closed loop by capturing the evaporated water and then letting it travel enough of a distance that it cools off and liquefies condenses and ends up in a holding pool?

        Edit: I told you I was stupid.

        • SlopppyEngineer@lemmy.world
          link
          fedilink
          arrow-up
          3
          ·
          2 days ago

          It’s actually how a liquid cooled PCs works. The warm liquid goes to a big radiator where fans blow air on the radiator to cool things. But lots of radiators becomes expensive and takes space. You’re talking about a few hundred megawatt of heat.

          • Flying Squid@lemmy.world
            link
            fedilink
            arrow-up
            1
            ·
            2 days ago

            The space would be a problem for sure, but couldn’t you just use natural condensation to do it with a long enough pipe?

            • SlopppyEngineer@lemmy.world
              link
              fedilink
              arrow-up
              2
              ·
              1 day ago

              Yes, but you have to account for pressure differences. Steam condensing to water shrinks and causes big pressure changes. It’s a lot easier to either vent it or use liquid everywhere.

            • curbstickle@lemmy.dbzer0.com
              link
              fedilink
              arrow-up
              2
              ·
              1 day ago

              Thats one option, part of strategies for reuse of liquid cooling.

              To mention, its more energy efficient than air cooling, so there is a benefit. Smart companies though will also look to reuse strategies like using it for building heat. Larger companies will partner with the town/city to distribute the heat into town-wide systems, like for power generation or distributed heating systems, warm greenhouses, or even to dry out wood pellets for pellet stove systems.

              Going long is effectively the same as using radiators though, you’ll just need more pipe to do it without a radiator.

        • fsxylo@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          4
          ·
          2 days ago

          Probably expensive+ you’re going to lose mass no matter what because physics don’t give a shit.

          • Flying Squid@lemmy.world
            link
            fedilink
            arrow-up
            4
            ·
            2 days ago

            Unless you are talking about the entire planet, I’m fairly certain rain is not part of a closed loop cooling system for a server farm.

    • Gladaed@feddit.org
      link
      fedilink
      arrow-up
      6
      ·
      2 days ago

      It improves the efficiency of the data centre because you need less expansive cooling. You need to get rid off the heat somehow.