Revitalizing the Docker Model Runner Community | Docker
www.docker.com
Docker Model Runner is GA, now in all Docker versions with Vulkan support for nearly any GPU. Star, fork, and contribute in our unified repo.
  • vermaterc@lemmy.ml
    3·
    9 days ago

    Do you guys successfully use small self hosted models somewhere? Although I can see a use case for LLMs, it’s always the biggest ones that can output any useful results (and by “biggest” I usually mean: the ones I can’t afford to run by myself)