3 Simple Steps to run LLMs on your Laptop

3 Simple Steps to run LLMs on your Laptop

  1. Install Ollama:

  • Visit?ollama.com?and download the installer for your OS (Mac or Windows).
  • Click and start the application you will get a screen below, click install and copy the command.

  • Open your command terminal and paste the above command and press enter.


2. Select an LLM:

  • Go to Ollama and search for LLM’s and select the one which you would like to play with. I am using deepseek-r1 with 18.1Million pulls so far.


  • If you have a powerful machine (RAM, GPU etc) you can download biggest model, as big models will take more resources to run. However, I am going to select the 1.5 billion parameters for this example.
  • Copy the run command next to it. Open the terminal and paste the command and press enter.


  • You can start asking questions from the command terminal, but it is not quite intuitive.

3. Install Chatbox AI:

  • Install ChatBox AI app for your Mac or windows and add it as an application.
  • Configure ChatBox AI with Ollama's Api provider.

  • Use the selected LLM model for chatting, allowing you to disconnect from the internet while interacting (your data stays within your laptop!) also with chatboxai you can ask questions uploading pdf.

All applications mentioned are opensource and free to use.

要查看或添加评论,请登录

Akram Ali的更多文章

  • From Engineer to Associate Accountant: A Journey of Transformation

    From Engineer to Associate Accountant: A Journey of Transformation

    For years, I worked as a consultant, delivering enterprise performance management solutions to clients, primarily…

    24 条评论
  • Generative AI: Lack of Information Architecture increases misinformation risks

    Generative AI: Lack of Information Architecture increases misinformation risks

    Imagine AI as a powerful engine. It can take you anywhere, but without a proper roadmap (Information Architecture)…

    2 条评论
  • Generative AI with Planning Analytics and WatsonX

    Generative AI with Planning Analytics and WatsonX

    Generative AI itself is a type of artificial intelligence that can create new content like text, images, audio and even…

    1 条评论
  • ESG - Sustainability - TM1/PA

    ESG - Sustainability - TM1/PA

    TM1/PA – ESG – Sustainability IBM accelerator catalog is a great place to look at the knowledge base on IBM technology.…

    1 条评论
  • PA SaaS in AWS

    PA SaaS in AWS

    Planning Analytics as a service in AWS has been one of the most awaited announcements for Enterprise Performance…

  • Finance Transformation - On Premises vs Cloud

    Finance Transformation - On Premises vs Cloud

    As part of the Finance Transformation journey many organisations across the globe are assessing/assessed their software…

  • TM1 Rest API – CRUD App – 4th and the Final Chapter

    TM1 Rest API – CRUD App – 4th and the Final Chapter

    In this chapter we will discuss about login screen and routing the token through the application and deleting the…

  • TM1 Rest API – CRUD App – 3rd Chapter

    TM1 Rest API – CRUD App – 3rd Chapter

    In this chapter we are going to discuss on update and delete operation of rest API. Among PUT/POST/Patch, based on the…

  • TM1 Rest API – CRUD App – 2nd Chapter

    TM1 Rest API – CRUD App – 2nd Chapter

    This article is a continuation of the 1st chapter and it will discuss on POST operation of TM1 Rest API. Also, this…

    1 条评论
  • TM1 Rest API – CRUD App – 1st Chapter

    TM1 Rest API – CRUD App – 1st Chapter

    As we all know Representational state transfer (REST) Application programming interface (API) can perform Create Read…

    3 条评论

社区洞察

其他会员也浏览了