课程: Large Language Models on AWS: Building and Deploying Open-Source LLMs

免费学习该课程！

今天就开通帐号，24,700 门业界名师课程任您挑！

Summary

Summary

课程: Large Language Models on AWS: Building and Deploying Open-Source LLMs

开始一个月试用 购买团队方案

Summary

“

- [Instructor] Open source LLM deployment on AWS. We've reached the end of this course. Let's talk about how we went from research, right, getting all these checkpoint models to production, putting things on AWS. First up here, we mastered some key technologies, Llama CPP. We also got into UV. We got into GGUF, so the llama.cpp tool chain is really a rich tool chain, because it has servers, chat bots, it has quantization. It also has the ability to, you know, optimize for your particular hardware. So it's a very rich tool kit that has advanced capabilities. We also got into the rust-based UV package manager, which solves some tremendously horrendous problems with Python for AI and ML, and makes them trivial. We also got into the GGUF format, which again, the idea here is that you take these research tools, and you convert them into a single file format, so you can use it in production. Okay, let's talk about the production deployment journey. What did we do? We got into model…

内容