Fucking piece of shit Sam Altman should be executed on a wooden plank and his corpse should be displayed on a public square for the next 100 years.

I was saving up for building a pc but at this point I’d rather just throw my money in a fire than buy RAM or SSD. Even Apple has better Ram pricing than these goons.

    • RisingSwell@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      3
      ·
      2 days ago

      7 years ago 16gb wasn’t enough for me and all I do is play games and watch YouTube. 16gb means Minecraft + chrome crashed videos.

      Now I have 32gb and don’t use chrome and memory no longer causes any issues.

        • RisingSwell@lemmy.dbzer0.com
          link
          fedilink
          English
          arrow-up
          1
          ·
          2 days ago

          I dedicate that much to vanilla minecraft, we have very different expectations on results I think. If I’m playing modded I dedicate 16 just so I don’t ever have to worry about running out.

          Firefox almost halved my browser ram usage back in the day though.

            • RisingSwell@lemmy.dbzer0.com
              link
              fedilink
              English
              arrow-up
              1
              ·
              1 day ago

              I have a laptop, it’s just unreasonable. Need the ability to just pick it up and walk off. I figure if I spend more time on my laptop than anything else it probably should be one of my most high end things.

  • invo_rt [he/him]@hexbear.net
    link
    fedilink
    English
    arrow-up
    40
    ·
    2 days ago

    Basically, all RAM is manufactured by three companies. RAM pricing operates on a 4~5 year pricing cycle where high prices encourage a increase in production which in turn lowers prices and discourages production which raises prices and so on.

    There hasn’t been much investment to increase overall manufacturing capacity of RAM and the factories to do so aren’t quick to spin up. RAM was already at low prices earlier this year which indicated a decrease in production. Then OpenAI announced they’d be buying 40% of the global RAM supply, a massive amount. This has led to retailers starting to jack up RAM prices. I panic bought a 2x16GB kit for $200 at the beginning of the week. That same SKU is now $400.

    As a warning, this RAM shortage will affect EVERYTHING with RAM in it, GPUs, phones, etc.

  • Azarova [they/them]@hexbear.net
    link
    fedilink
    English
    arrow-up
    29
    ·
    2 days ago

    riding my 10 year old rig till it disintegrates at this point. maybe the silver lining to the AI bubble popping will be that we finally see part prices fall, but nothing cool ever happens so probably not.

  • RION [she/her]@hexbear.net
    link
    fedilink
    English
    arrow-up
    20
    ·
    2 days ago

    I used to love speccing out PC builds, even purely hypothetically just to see how good a setup I could put together for X amount of money. But then during the crypto boom and COVID it got way less fun and has mostly stayed that way…

  • segfault11 [any]@hexbear.net
    link
    fedilink
    English
    arrow-up
    26
    ·
    2 days ago

    wtf happened 😭 i bought 32GB RAM in april and it was like $45. granted it was SODIMM and probably not high performance gaming RAM or whatever but still…

    i looked it up and the kit i got is now $180 😬

  • WilsonWilson [comrade/them, any]@hexbear.net
    link
    fedilink
    English
    arrow-up
    13
    ·
    2 days ago

    I was thinking about throwing together a linux box and running a smol deep seek model locally but it looks like ima put that on hold for a while. I just checked ebay and used prices for 64GB are out of control as well. Any chance big ai is influencing this? They really seem desperate to get revenue on the books. I am getting hit up for ai services at every turn now. Firefox is asking me if I want my web browsing summarized by ai (NO), google wants me to let them review my email (NO), github trying to force me to use copilot (i use a free model), Insurance tape worms are advertising their use of ai and I’m just waiting for chase bank to push it on me (NO)

      • BodyBySisyphus [he/him]@hexbear.net
        link
        fedilink
        English
        arrow-up
        5
        ·
        2 days ago

        A couple months ago I tried running oLlama on a server blade with a ton of RAM and traditional processor cores and performance was still pretty horrible. Is there a better way to do it or do you just need a GPU?

        • stupid_asshole69 [none/use name]@hexbear.net
          link
          fedilink
          English
          arrow-up
          6
          ·
          2 days ago

          You need a gpu. Anything nvidia is fine, more ram is better, but you can use system ram to swap out what you’re doing.

          If you’re doing it yourself, consider how smaller models built to do one specific thing can do the job. For example: a small 8gb video card can do text inference and its results can be sent to something like kokoro on cpu for tts and you suddenly have a talking llm on an eight year old budget gpu.

      • WilsonWilson [comrade/them, any]@hexbear.net
        link
        fedilink
        English
        arrow-up
        4
        ·
        2 days ago

        Any tips on a specific server model(s)? Years ago I got a GIANT ebay 4u server which I intended to use as a security video server and run a custum isa 16channel bnc card but none of the linux drivers worked. I then started to write my own driver based on video4linux but the card was so old I couldn’t find white paper on i/o specs and scope and logic analyzer couldn’t handle the frequencies for reverse engineering so I just used it for a year as a 200lb paperweight samba server. If I could find something cheap and lightweight with modern hardware that could possibly work. If it already came with the ram that would be a nice bonus.

        • unperson [he/him]@hexbear.net
          link
          fedilink
          English
          arrow-up
          1
          ·
          edit-2
          1 day ago

          Memory bandwidth is what you need. An EPYC 9xx4 / 9xx5 with all 12 DDR5 DIMMs, or a newish dual socket Xeon with 16 modules.

          With fast memory the GPU is unnecessary until you want to do training which needs a lot of FLOPS.

  • RipLemmDotEE@lemmy.today
    link
    fedilink
    English
    arrow-up
    13
    ·
    2 days ago

    Wow, I bought almost that exact same ram in March for $115.

    That’s brutal.

    I hope Sam Altman fucks himself with a rusty spoon.