• AstroStelar [he/him]@hexbear.net
    link
    fedilink
    English
    arrow-up
    13
    ·
    edit-2
    21 days ago

    I was thinking the same thing. The article claims 30,000 to 60,000 tons of CO2e emissions from sending 4GB of data to hundreds of millions of phones. For reference, estimates for the US AI industry’s emissions are between 30 and 80 million tons per year, global total emissions are 80 billion. How often this gets repeated for new versions is unclear.

    As for inference, Chrome won’t even use it for its biggest use case: everything done via the search bar and “AI mode” is still sent to high-param models in Google’s servers, likely because user data is Alphabet’s cash cow. The local model is only used in very niche cases:

    the features that do use the local model (Help-Me-Write in <textarea>, tab-group AI suggestions, smart paste, page summary) are buried in textarea-context menus and tab-group right-click menus that the average user will discover, on average, never.