Skip to main content

Tried DeepSeek R1 on Raspberry Pi 5, and the speed? Not as expected! 😳

https://itsfoss.com/deepseek-r1-raspberry-pi-5/

#opensource #ai


I Ran Deepseek R1 on Raspberry Pi 5 and No, it Wasn't 200 tokens/s

Everyone is seeking Deepseek R1 these days. Is it really as good as everyone claims? Let me share my experiments of running it on a Raspberry Pi.
Abhishek Kumar (It's FOSS)
#opensource #AI
in reply to It's FOSS

el_haych2024
el_haych2024
• •
my experience running distilled model locally was like experiencing that Weave Trump's always going on about.
Unknown parent

It's FOSS
It's FOSS
• •

You're right, running AI models on the Raspberry Pi 5 is a challenge. The accuracy drop with the 7B model could be due to quantization artifacts affecting precision on limited resource. I’ll be testing this further on the ArmSoM AIM7 with its NPU to see if the trend holds. 🙂

— Abhishek

This entry was edited (2 months ago)

Lo, thar be cookies on this site to keep track of your login. By clicking 'okay', you are CONSENTING to this.

⇧