robber@lemmy.ml to LocalLLaMA@sh.itjust.worksEnglish · 2 months agoQwen3-Coder-Nexthuggingface.coexternal-linkmessage-square10linkfedilinkarrow-up125arrow-down10file-text
arrow-up125arrow-down1external-linkQwen3-Coder-Nexthuggingface.corobber@lemmy.ml to LocalLLaMA@sh.itjust.worksEnglish · 2 months agomessage-square10linkfedilinkfile-text
minus-squareAvid Amoeba@lemmy.calinkfedilinkEnglisharrow-up1·edit-22 months agoInteresting. 3B models run decently fast on my CPU and I have a lot of system RAM. 🤔 E: Just tried it on 100% CPU on AMD 7700 with DDR5 3600 and it does 6.5t/s. Not bad.
Interesting. 3B models run decently fast on my CPU and I have a lot of system RAM. 🤔
E: Just tried it on 100% CPU on AMD 7700 with DDR5 3600 and it does 6.5t/s. Not bad.