• ComradePenguin@lemmy.ml
    link
    fedilink
    English
    arrow-up
    2
    ·
    3 days ago

    Why pay for really expensive models when you can get almost the same performance for a fraction of the cost?

    The future is not about the most powerful models necessarily. There will be cases, and there will be a development in intelligence going forward.

    My prediction is that the future of AI (LLM++) will be harnesses and tools, not the absolute best inference.

    • brucethemoose@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      20 hours ago

      Yeah.

      At this point, everything around the LLM is woefully behind the performance of LLMs themselves. If all LLM development stopped tomorrow, I think there would still be years of catching up to do.

      • ComradePenguin@lemmy.ml
        link
        fedilink
        English
        arrow-up
        2
        ·
        14 hours ago

        Most definitely.

        I am an extreme user of LLMs and other AI, and the limit is creativity and adaptability. It is no longer the “intelligence” of the models that counts, they are already insanely good now. I use Kimi K3 and it blows me away.

        The limit is what my mind can conjure up.

        • brucethemoose@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          14 hours ago

          Well even the human user aside, I’m thinking of agent harnesses, tools, prompt “hacking,” constrained and exotic sampling, augmentations like control vectors or loras, RAG, databases, multimodel thinking…

          The basic chatbot interface is hardly tapping into these models at all. They’re very effective tools when specifically constrained, but most are still figuring out how to do that.