1.2 Hardware Knowledge CPU VS GPU
GPU VS CPU AI Processing and LLMs

1.2 Hardware Knowledge CPU VS GPU

·CPUs are often able to handle a wide variety of tasks at a reasonable speed.?

·GPUs are often focused on one specific type of task and optimized based on that single task type.?????

Examples:?

  • CPUs are first come first serve where everyone gets a ticket at a deli line with a single workstation performing all functions.??
  • GPUs can run multiple activities in parallel, like a deli setup with 3 or workstations specifically set up for task types, such as cutting meat, making a sandwich, or slicing cheese. There is no need to reconfigure the workstation for every customer, hence the wait time is significantly reduced.?
  • Using the example below, picture one worker at each workstation. A CPU user may be capable of doing all the work but is slower if not optimized, however, a GPU format that is optimized would require one employee per workstation to run in parallel, hence the operation and maintenance costs are typically more expensive.?

In this scenario Time is Money and by utilizing GPUs responses are quicker than using a CPU. Throw in some optimization and expect 100+ quicker responses.


This is an important concept to plan since the volume can be a significant driver when determining how to build an AI solution. Today there currently is only one true player.


Today the only Player in the market is Nvidia but competition is growing.


SECTION 1.3 will focus on the Hardware and Platforms utilized

要查看或添加评论,请登录

Raymond Stevens的更多文章

  • PMO: A Guide to Savings Time and Money

    PMO: A Guide to Savings Time and Money

    Quite frequently costs are evaluated at companies, costs compared, team members reduced, however cutting costs and…

  • Direct to Consumer OMNI Solutions

    Direct to Consumer OMNI Solutions

    OMNI is often a term that is misunderstood. Essentially, OMNI is a basic business principle that allows data from…

  • Looking to improve your customer experience? A quick dive into Operation Excellence for Retailers

    Looking to improve your customer experience? A quick dive into Operation Excellence for Retailers

    Today's retail environment is extremely different than our previous environment due to new product offering such as…

    3 条评论
  • SCAMMERS: TARGETING UNEMPLOYED

    SCAMMERS: TARGETING UNEMPLOYED

    In a recent communication, I identified a potential scammer but honestly, it was difficult to distinguish reality from…

    1 条评论
  • 1.3 (Bonus Opinion) Market Share: GPU Leaders

    1.3 (Bonus Opinion) Market Share: GPU Leaders

    #Shown above the cost of GPUs is higher than CPUs at low volume, however, the costs of CPUs grow quickly due to a lack…

  • 1.3 Models: Market share

    1.3 Models: Market share

    Currently, models play a critical role in how AI works. Currently, there are two types of models used for AI.

  • New Technology = New Implementation Leaders 1.4

    New Technology = New Implementation Leaders 1.4

    Something that is unique and that has flown under the radar is that traditional implementation partners are no longer…

  • AI: HOW IT'S MADE (1.0/1.1)

    AI: HOW IT'S MADE (1.0/1.1)

    This section will cover LLMs, Market Share and Trends, and some light technical knowledge on hardware solutions…

    1 条评论
  • AI: How it's Made (Series Overview)

    AI: How it's Made (Series Overview)

    This Article is intended to be a 5-minute introduction to the evolution of Generative AI and includes hands-on…

    3 条评论
  • It's here, The Golden Age of AI

    It's here, The Golden Age of AI

    AI and machine learning are rapidly transforming many industries and businesses. There are many use cases and examples…

社区洞察

其他会员也浏览了