Using deepseek r-1 as your con Introduction Deepseek recently <a href="https://x.com/deepseek_ai/status/1881318130334814301" target="_blank">announced</a> their new open source model deepseek r-1. Here's a short explainer video by Fireship. <a href="https://youtu.be/-2k1rcRzsLA?si=3QXq2V4v3JvVtzc4" target="_blank">https://youtu.be/-2k1rcRzsLA?si=3QXq2V4v3JvVtzc4</a> Why this model? Firstly, deepseek r-1 is open source which for me meant that I can run this model on my machine and do all sorts of stuff with the LLM. Second, the model is cheap in terms of compute. It can be run on various machines and the chain of thought gives surprisingly good results though your mileage may vary. Moreover, you can fine-tune this model to suit your needs provided you have enough compute and data to do so. Setting up as a coding assistant TL;DR If you want to save your time, here's a quick rundown If I saved you some time, I think it deserves a praise. After all many people copy-pastes their AI ghostwritten blogs to increase read time, so a like will be highly appreciated. The longer version For folks who are not accustomed with the tools, don't worry I got you covered. Installing Ollama We'll use <a href="https://ollama.com/" target="_blank">ollama</a> to install and run our model. So go to ollama's page and download it based on your operating system. Download Ollama Visit the deepseek r-1 model page on ollama website, as of writing the blog the link is <a href="https://ollama.com/library/deepseek-r1:7b" target="_blank">https://ollama.com/library/deepseek-r1:7b</a> Deepseek r-1 comes in multiple variants, the list aforementioned categorizes the models. Pick the one that suits you best, I can run the 7b model which also happens to be the default model in ollama. After picking the right model, copy the command mentioned on the ollama page by clicking on the copy button. Run this command in your terminal (powershell/command prompt for windows user) This command will automatically install and run the model. Installing Continue Extension In <a href="http://code.visualstudio.com/" target="_blank">VSCode</a> install the <a href="https://marketplace.visualstudio.com/items?itemName=Continue.continue" target="_blank">Continue</a> extension. After it is installed, you'll see the continue icon on the left pane of VSCode. Now that the extension is installed, click on the extension icon, you'll see an option to add chat model. Choose ollama in the "Provider" section and "Autodetect" in the model. This will open and edit the config file like this Now should should see your chat model in the chat box of continue AI. Setup Complete That's it this was the setup, now you can use the newly installed deepseek model as your personal coding assistant.The best part it will work offline too, as it runs on your machine. Conclusion Deepseek's r1 is different, what I like about it is that you can literally look at all the chain of thought live it makes before outputting the final result and duly improve the prompt if you feel some assumption is wrong. Well the model is not too perfect and I do have some fair share of pain points with it. That said I am also running a very small version of the model compared, deepseek r-1 model is 400x larger than that the one I am using. That said, having the ability to run such a model locally is a breakthrough in itself and it's only going to get better.
