LLM in your desktop

Yes, as the title says, we can download, install, configure to run multiple models in our desktop.

Welcome to Ollama, an open source tool to get up and running with large language models on our desktop.

This short article is going to show you how to do this.

Install Ollama

Go to the website https://ollama.com/ and click the download button, will lead you to the following page.

According to the OS on your laptop/desktop, choose that OS and click download.

Install the downloaded Ollama.

Assuming you are working on a laptop/desktop with Windows 11 as the OS.

Start the Windows PowerShell.

From the command prompt, give the command

ollama run <model name>        

in the below image you can see I have given "llama3.2" which is a smaller version of the llama model.

First time, this will download the necessary data to make sure model has everything to answer queries.

There are lots of models supported by ollama, which you can find the list in the below given website -> https://ollama.com/models

Once all the data has been downloaded, an llm prompt will be given to you to start prompting.

That's it. You have an LLM configured in your desktop and ready to use for your any purposes :)

Best is it is opensource and free.

I will write / showcase more on this as I learn.

Now a short video to show you the action of an desktop llm :)

Neural Notes in Social Media

Medium : neuralnotes.medium.com

LinkedIn Newsletter: https://www.dhirubhai.net/build-relation/newsletter-follow?entityUrn=7276939112887066624

Connect or Follow: Sriram Srinivasan