I joined Lemmy back in 2020 and have been using it as @qaz@lemmy.ml until somewhere in 2023 when I switched to lemmy.world. I’m interested in systemd/Linux, FOSS, and Selfhosting.

  • 419 Posts
  • 2.12K Comments
Joined 3 years ago
cake
Cake day: June 10th, 2023

help-circle
  • Deepseek recently published a paper in which they describe that vision tokens contain more information than text tokens and that this can be used to compress context.

    We present DeepSeek-OCR as an initial investigation into the feasibility of compressing long contexts via optical 2D mapping.

    Experiments show that when the number of text tokens is within 10 times that of vision tokens (i.e., a compression ratio < 10×), the model can achieve decoding (OCR) precision of 97%. Even at a compression ratio of 20×, the OCR accuracy still remains at about 60%. This shows considerable promise for research areas such as historical long-context compression and memory forgetting mechanisms in LLMs.

    It reminds me of LLM caveman speak, it used to have another option to use Chinese instead of English. A language like Chinese is seemingly better at encoding information in fewer tokens and I think this is the same mechanism why OCR tokens work so well.

    That said, I also doubt that voice messages are more efficient than text prompts, but it’s best not to waste too much time engaging with these sorts of LinkedIn posts (and LinkedIn in general).





















  • Maybe not as good as Claude, but they are good enough, and open-source, and free. The US market is going to learn the hard way why open-source curbstomps greedy bullshit.

    Correct, the American frontier models Claude Opus, GPT 5.4, GPT 5.5, and Gemini 3 Pro still score better (while costing significantly more), but the runner ups are all Chinese models.

    Then it’ll just come from Germany or France or elsewhere. It doesn’t take millions of dollars to train a good model, despite these US companies pretending that it does.

    Well, it does. Deepseek-R1 cost $6 million and that was considered to be very cheap. Europe only really has Mistral’s models, Proton’s Lumo and several models that focus on transparency, ethically sourced training data, and supposedly better local language support (OpenEuroLLM, GPT-NL), but they’re by far not as good as other models and I don’t expect them to be for quite some time.


  • I’ve said this before. The Chinese models are significantly better and will outcompete the models from the US, it was just a matter of people realizing that.

    My other prediction, being that they will lobby for tariffs or banning Chinese models outright also seems to be coming true.

    A Dark-Money Campaign Is Paying Influencers to Frame Chinese AI as a Threat

    Build American AI, a nonprofit linked to a super PAC bankrolled by executives at OpenAI and Andreessen Horowitz, is funding a campaign to spread pro-AI messaging and stoke fears about China.

    I do wonder how Europe is going to react. Will they just focus on their home grown Mistral or will they consider Chinese open weight models? I feel like the EU is quite wary of anything Chinese and that many people won’t fully comprehend the actual security risk and that they will initially dismiss are avoid them, but they can’t ignore it forever. Qwen 3.6 35B which can be ran at home is already leaving Mistral’s latest models in the dust.









  • We are obviously looking at things like Mythos, which is more sophisticated at finding vulnerabilities. In the next week or so, we will be changing our tack on coding the open and making our code public until we’re on top of that risk.

    Most of our repos, unless they’re essential, will be removed for security reasons.

    Security by obscurity because security vulnerabilities don’t exist if you can’t see them