How To Build You Own AI Powered?PC

Motivation

I want to make API calls to LLM models without getting charge for heavy usage and run experiments on LLM models. While I can run open source LLM models on my laptop but it is not powerful enough to run the bigger LLM models. Even for smaller models that my laptop can handle, their high resource demands significantly degrade system performance.

My solution is to build a PC with the hardware capacity to handle my AI workloads.

Prerequisites

• Intel Core i9–14900KF Desktop Processor
• MSI Z790 GAMING PRO WIFI Motherboard
• TeamGroup T-FORCE VULCAN 64GB (2x32GB) DDR5 6000MHz Memory
• KINGSTON KC3000 1TB PCIe Gen4 NVMe M.2 SSD
• GIGABYTE GeForce RTX 4070 Ti SUPER GAMING OC 16G Graphics Card
• DeepCool ASSASSIN IV Premium CPU Air Cooler
• Super Flower Leadex III Gold UP (2024) ATX 850W Power Supply
• DeepCool CC560 V2 Mid-Tower ATX Case
• USB stick with at least 8GB of storage

Installation

Installing the?CPU

Align the golden triangle on the corner of the CPU with the triangle on the socket.

Open the CPU socket latch on your motherboard.

Carefully place the CPU into the socket without applying force. Lower the socket latch to secure the CPU.

Installing SSD

Locate the M.2 slot on your motherboard.

Remove the M.2 heatsink cover, nsert the M.2 SSD at a 30-degree angle and press it down gently.

Secure it with the provided screw and replace the heatsink if applicable.

Installing RAM

Locate the RAM slots on your motherboard (usually near the CPU).

Open the retention clips on the appropriate slots.

• If you have a dual RAM stick configuration, insert the RAM sticks in the 2nd and 4th slot.
• If you have a quad RAM stick configuration, insert the RAM sticks in all 4 slots.

Align the notch on the RAM stick with the slot and press down firmly until the clips lock into place.

Installing the CPU?Cooler

Apply thermal paste to the back of the cpu.

Attach the mounting brackets to the motherboard. Secure the cooler on top of the CPU using the screws provided. And connect the cooler fan to the CPU_FAN header on the motherboard.

Install the Motherboard in the?Case

Align the I/O shield with the back of the case. Position the motherboard on the standoffs in the case. Secure the motherboard using the screws provided with the case.

Install PSU

Install the?GPU

Remove the PCIe slot covers on the case that align with the top PCIe slot. Insert the GPU into the top PCIe x16 slot until it clicks into place. Secure the GPU with screws. Connect the PCIe power cables from the PSU to the GPU.

Connect the PSU to the Motherboard

• 24-Pin ATX Power: Plug the 24-pin cable from the PSU into the large 24-pin socket on the motherboard.
• 8-Pin CPU Power: Connect the 8-pin CPU power cable from the PSU to the socket near the top-left corner of the motherboard.

Connect Front Panel to Motherboard

• USB Ports: Connect the case USB 3.0 and USB 2.0 cables to their headers on the motherboard.
• HD Audio: Connect the HD audio cable from the case to the header labeled HD_AUDIO.
• Connect the +PLED, -PLED, PowerSE, +-HDDLED, and RESET SW cables.

Installing OS

Hookup the powercable, keyboard, mouse to your computer. Download Ubuntu Desktop (in my case its version 24.04.1) from the official website. Install BalenaEtcher, insert your usb and flash the download Ubuntu iso to your usb with BalenaEtcher.?

Insert the usb into your PC, follow the default installation process.

Happy Developing ??