I'm going to be without internet for the next 3-6 months, and I've got some programming tasks to tackle related to my job. I'm not a professional programmer—just a hobbyist—and I rely on AI to help me out. What are my best options for using AI offline?
4 Answers
It really depends on your hardware setup. If you have something like a Qwen 3 mixture-of-experts model, that could be a great start. I’ve got a pretty powerful rig with a 4090 and 64GB RAM, and I’ve found that the Qwen3 30B A3B runs smoothly for coding tasks. If your computer isn’t as powerful, you might want to try smaller models to find what works best for you. Also, a neat trick: appending '/nothink' to your prompt can turn off reasoning, which might help with performance! Just keep in mind that I haven't fully tested its coding abilities, so you'll want to experiment yourself.
Ollama is a solid choice if you're looking for something to run locally on your laptop. It works great without needing an internet connection!
Just curious, are you heading to the wilderness or moving somewhere remote? That definitely makes a difference in what tools you can bring along!
Related Questions
Set Wordpress Featured Image Using Javascript
How To Fix PHP Random Being The Same
Why no WebP Support with Wordpress
Replace Wordpress Cron With Linux Cron
Customize Yoast Canonical URL Programmatically
[Centos] Delete All Files And Folders That Contain a String