I don’t get why a group of users that are willing to run their own LLMs locally and do not want to relay on centralized corporations like openAI or google prefer to discuss using a centralized site like Reddit

  • kakes@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    30
    ·
    8 months ago

    Maybe they don’t know about Lemmy, or maybe they want to run LLMs locally for reasons other than idealism?

  • rufus@discuss.tchncs.de
    link
    fedilink
    English
    arrow-up
    10
    ·
    8 months ago

    We only got about 40000 active users here on Lemmy. Guess most people like to see dozens of posts per day even in a niche community. I like it here. But I guess it’s going to be difficult to attract users from /r/LocalLLaMA And as far as I know we haven’t advertised there yet. I’m still not sure if we should…

  • Cheers@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    7
    arrow-down
    1
    ·
    8 months ago

    Personally speaking, the issue isn’t I don’t want to rely on them, it’s that I can’t use them for my use case because it’d be a HIPPA violation.

    The alternative is a run a local/cloud version that I control. Discussing the set up process can be done on reddit without endangering patients.

  • wandermind@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    6
    ·
    edit-2
    8 months ago

    Because it’s not ideological, they just want to generate porn, which is against OpenAI TOS.

    • rufus@discuss.tchncs.de
      link
      fedilink
      English
      arrow-up
      3
      ·
      edit-2
      8 months ago

      To be fair, I saw /r/LocalLLaMA referenced in a scientific paper (“bloc97” in the paper about Streaming-LLM) talking about NTK-aware RoPE scaling. Which is kind of an awesome achievement.

      And to me it’s fascinating that Reddit is generally friendly towards porn. I think they have started to restrict adult content with their API change but so far there are lots of corners where you can even post pictures of your member. And that’s not really possible on many of the other big commercial online platforms. I wonder where they’re headed in the long term.

  • Mixtral@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    1
    ·
    7 months ago

    For me, I found only one group about LLM here in search. You can make Lemmy better if share another groups for similar topics since search feature doesn’t work well yet.

  • cro_magnon_gilf@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    4
    arrow-down
    5
    ·
    8 months ago

    Because reddit is a comfy echo chamber where people are banned for opposing the ruling dogmas in the subs. People love that