Like if I type “I have two appl…” for example, often it will suggest “apple” singular instead of plural. Just a small example, but it is really bad at predicting which variant of a word should come after the previous

  • @Kichae@lemmy.ca
    link
    fedilink
    410 months ago

    The algorithms are the same. The models are different, being trained on a smaller data set.

    • @FooBarrington@lemmy.world
      link
      fedilink
      5
      edit-2
      10 months ago

      No, the algorithms are not the same. Phones don’t use transformer models for text prediction, they use Markov chain-based approaches. Also, retraining of transformer models for individualized completion would be too expensive, whereas it’s basically free with Markov approaches. Where do you get these ideas?