cm0002@lemmy.world to Free Open-Source Artificial Intelligence@lemmy.worldEnglish · 4 days agoOpen Source DeepSeek R1 Runs at 200 Tokens Per Second on Raspberry Piwww.nextbigfuture.comexternal-linkmessage-square9fedilinkarrow-up132arrow-down12
arrow-up130arrow-down1external-linkOpen Source DeepSeek R1 Runs at 200 Tokens Per Second on Raspberry Piwww.nextbigfuture.comcm0002@lemmy.world to Free Open-Source Artificial Intelligence@lemmy.worldEnglish · 4 days agomessage-square9fedilink
minus-squarehendrik@palaver.p3x.delinkfedilinkEnglisharrow-up1·4 days agoMy old computer and laptop run 13B models at 2 - 3 tokens a second on CPU only. That’s a bit slower than I can read. I wonder what my new phone does.
My old computer and laptop run 13B models at 2 - 3 tokens a second on CPU only. That’s a bit slower than I can read. I wonder what my new phone does.