Open Source DeepSeek R1 Runs at 200 Tokens Per Second on Raspberry Pi | NextBigFuture.com
www.nextbigfuture.com
Experimenters have had overnight tests confirming they have OPEN SOURCE DeepSeek R1 running at 200 tokens per second on a NON-INTERNET connected Raspberry Pi.
  • hendrik@palaver.p3x.deEnglish
    101·
    4 days ago

    Yeah, my computer also runs a game at 200fps. But I’m not saying if it’s Minesweeper or a recent AAA game…

    • ffhein@lemmy.worldEnglish
      4·
      4 days ago

      Yea… it’s not quite the same thing to actually run DeepSeek R1, a 671B model, and for example DeepSeek-R1-Distill-Qwen-1.5B

      • suokoEnglish
        2·
        4 days ago

        A recent i7 on CPU only can manage qwen 1.5 in a satisfactory way, comparable to big online players. Curious about recent ultra Intel and snapdragons

        • hendrik@palaver.p3x.deEnglish
          1·
          4 days ago

          My old computer and laptop run 13B models at 2 - 3 tokens a second on CPU only. That’s a bit slower than I can read. I wonder what my new phone does.