Lemmy.one
  • Communities
  • Create Post
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
pepperfree@sh.itjust.works to LocalLLaMA@sh.itjust.worksEnglish · 15 天前

When DeepSeek V4 and R2?

sh.itjust.works

message-square
26
fedilink
191

When DeepSeek V4 and R2?

sh.itjust.works

pepperfree@sh.itjust.works to LocalLLaMA@sh.itjust.worksEnglish · 15 天前
message-square
26
fedilink
alert-triangle
You must log in or # to comment.
  • Kyrgizion@lemmy.world
    link
    fedilink
    English
    arrow-up
    30
    ·
    15 天前

    I remember how we would get into trouble for copying each other’s homework in high school.

    • Riskable@programming.dev
      link
      fedilink
      English
      arrow-up
      10
      ·
      15 天前

      Now we get in trouble for generating each other’s homework 🤷

  • mtpender@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    15
    ·
    15 天前

    OK Tech bros, repeat after me:

    “Thou shalt not make a machine in the likeness of a human mind.”

    • pepperfree@sh.itjust.worksOP
      link
      fedilink
      English
      arrow-up
      3
      ·
      14 天前

  • Omega@discuss.online
    link
    fedilink
    English
    arrow-up
    13
    ·
    15 天前

    I wonder if a good fine tuned model beats every general purpose LLM if you need it for a really specific purpose

    • laz@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      21
      ·
      15 天前

      Yes it does

    • kata1yst@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      8
      ·
      15 天前

      Of course, and this is why the new hotness is a Mixture of Experts for one model that is effectively a bunch of experts arguing over the answer, or else on a different scale there’s the Combination of Agents where different specialized agents perform specialized tasks.

    • pepperfree@sh.itjust.worksOP
      link
      fedilink
      English
      arrow-up
      1
      ·
      15 天前

      There is new project which they share fine-tuned modernbert on some task. Here is the org https://huggingface.co/adaptive-classifier

  • Endmaker@ani.social
    link
    fedilink
    English
    arrow-up
    6
    ·
    15 天前

    I thought DeepSeek’s selling point was efficiency?

    • laz@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      13
      ·
      15 天前

      It was beating near frontier models at tenth of a cost could be hosted by you or any cloud service for you and the open weights were not censored for China’s pr and could be jailbroken to say write code for shady stuff which any frontier model would refuse.

      • mindbleach@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        9
        ·
        edit-2
        14 天前

        You dropped these: ,,,,,,

        • Kissaki@programming.dev
          link
          fedilink
          English
          arrow-up
          6
          ·
          14 天前

          No time for commas with how fast this tech is developing

    • ikt@aussie.zone
      link
      fedilink
      English
      arrow-up
      6
      ·
      edit-2
      15 天前

      AI as a tech product is advancing faster than any other tech I’ve ever seen, you mentioning DeepSeek’s revelations from like 8 months ago already feels like an eternity

  • Jankatarch@lemmy.world
    link
    fedilink
    English
    arrow-up
    5
    ·
    14 天前

    (None of them are THAT much better than previous, even worse in some areas)

  • DragonTypeWyvern@midwest.social
    link
    fedilink
    English
    arrow-up
    4
    ·
    14 天前

    Wait a second.

    Grok’s symbol is a lightning bolt?

    • lastunusedusername2@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      2
      ·
      12 天前

      Grok 2 will have two lightning bolts

  • TriflingToad@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    3
    ·
    edit-2
    14 天前

    how about you grok deez nuts (it is 1 am please forgive me)

  • ikt@aussie.zone
    link
    fedilink
    English
    arrow-up
    3
    ·
    15 天前

    The most surprising thing about this image is that Grok is on it, they started way behind the 8ball and have caught up

    • magic_lobster_party@fedia.io
      link
      fedilink
      arrow-up
      9
      ·
      15 天前

      It’s flip flopping between being a full on Nazi and arguing against MAGA with facts and logic.

      • pepperfree@sh.itjust.worksOP
        link
        fedilink
        English
        arrow-up
        1
        ·
        14 天前

        The RL is so good grok changed it’s personality by changing small part of it’s system prompt

        • mindbleach@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          2
          ·
          14 天前

          Anakin: It’s aligned.

          Padme: To be good?

    • pepperfree@sh.itjust.worksOP
      link
      fedilink
      English
      arrow-up
      1
      ·
      15 天前

      It changed after Grok 3

      • ikt@aussie.zone
        link
        fedilink
        English
        arrow-up
        1
        ·
        15 天前

        yeah i hate musk but the fact grok was launched in nov 2023 years behind the competition and has caught up is shocking

        • pepperfree@sh.itjust.worksOP
          link
          fedilink
          English
          arrow-up
          3
          ·
          15 天前

          They got the whole Twitter database. It’s kinda the same with Gemini. But somehow Meta isn’t catching up, maybe their llama 4 architecture isn’t that stable to train.

          • veroxii@aussie.zone
            link
            fedilink
            English
            arrow-up
            5
            ·
            15 天前

            Or maybe Facebook data is even worse than Twitter?

            • pepperfree@sh.itjust.worksOP
              link
              fedilink
              English
              arrow-up
              1
              ·
              14 天前

              Llama 3.3 was good, tho. For the multimodal, llama 4 also use llama3.2 approach where the image and text is made into single model instead using CLIP or siglip.

LocalLLaMA@sh.itjust.works

localllama@sh.itjust.works

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !localllama@sh.itjust.works

Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.

Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.

As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.

Rules:

Rule 1 - No harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.

Rule 2 - No comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.

Rule 3 - No comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as "llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they’re still using the same algorithms since <over 10 years ago>.

Rule 4 - No implying that models are devoid of purpose or potential for enriching peoples lives.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 9 users / day
  • 134 users / week
  • 601 users / month
  • 1.52K users / 6 months
  • 20 local subscribers
  • 3.58K subscribers
  • 385 Posts
  • 2.07K Comments
  • Modlog
  • mods:
  • SkySyrup@sh.itjust.works
  • pax@sh.itjust.works
  • noneabove1182@sh.itjust.works
  • SmokeyDope@lemmy.world
  • MonsterBug@sh.itjust.works
  • BE: 0.19.7
  • Modlog
  • Legal
  • Instances
  • Docs
  • Code
  • join-lemmy.org