• BaroqueInMind
    link
    fedilink
    English
    arrow-up
    2
    ·
    edit-2
    5 months ago

    What’s the bus speed of the RAM? You might run it just fine but still bottlenecked there.

      • BaroqueInMind
        link
        fedilink
        English
        arrow-up
        2
        ·
        edit-2
        5 months ago

        With 144Gb of total RAM, you should be able to run any CPU intensive software.

        The LLMs use GPU vRAM though, so it doesn’t matter how much system RAM you have, since GPU vRAM is what the xformers and tensor scripts prioritize and have been ultimately optimized to use over CPU and RAM.