• yeehaw@lemmy.ca
    link
    fedilink
    English
    arrow-up
    2
    ·
    16 hours ago

    This is cool, are there any decent ones that run in docker and have a web UI?

    • rebelsimile@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      1
      ·
      14 hours ago

      I’ve been using open webui (search for it with those terms) to run local models in a docker container served from Llama for the last few months and I love it.