How to run LLama3 locally on your Computer

I am going to show you how to run Llama3 locally on your computer with an interface that is better than Chatgpt. We will be using Ollama , Docker, Inc , and WebUI.

Step 1 - Download and install Ollama on your computer:

Ollama is a software toolkit designed to make working with large language models (LLMs) easier and more accessible. It streamlines the process of setting up, running, and customizing these powerful AI models.

Here's what Ollama offers Simplified Setup, Easy Model Deployment, Customization Options, Multiple LLM Support

Step 2 - Download and install Docker on your computer:

Docker is a software platform that uses containers to package applications and their dependencies. Imagine a container as a self-contained shipping box for your application. Everything it needs to run (code, libraries, runtime) is packed neatly inside, ensuring it runs consistently regardless of the environment.

Step 3 - Go to WebUI repository and copy the code from their README section:

Step 4 - Open your Terminal and install your LLM models through Ollama

You can install any llm model by running the following code:

ollama pull (name of model)

Example: ollama pull llama3

Step 5 - Launch your WebUI

Copy and paste the code you got from WebUI GitHub repository, and paste and run it in your terminal after your models have finished downloading. It would show up in your docker dashboard like this:

Step 6 - Launch the WebUI interface:

Go to your Chrome browser and write this web link - localhost:3000