I'm trying to run an AI model, specifically gemma3, on my Raspberry Pi accessible at raspberrypi.local. I attempted to use the command "docker model pull ai/gemma3:4B-Q4_0" but got an error stating 'unknown command: docker model'. I know that if I were on Docker Desktop, I could easily enable this feature in settings, but there doesn't seem to be any option for this on my Raspberry Pi. Any advice on how to proceed would be appreciated!
1 Answer
You'll need to install the docker-model-plugin since it might not be included by default on your setup. Run this command in your terminal: `sudo apt update && sudo apt install docker-model-plugin`. That should enable you to use the 'docker model' commands without any issues!
Quick question: after executing 'docker model pull ai/deepseek-r1-distill-llama:70B-Q4_0', where can I find the model? I can't seem to see it listed under images.
Thanks a lot! I was seriously pulling my hair out over this.