课程: Large Language Models on AWS: Building and Deploying Open-Source LLMs
Python UV packaging overview
课程: Large Language Models on AWS: Building and Deploying Open-Source LLMs
Python UV packaging overview
- [Instructor] Let's walk through a UV Python script execution flow. First up on the left node here in green, we have the Python script that say hello.py, and you can see that it has a third-party dependency, which is typically the Achilles heel of Python. And this is the beginning of the flow where UV helps us out. Next up, we go to the blue node here and we see that UV command execution takes over. And this is a Rust-powered process. This is the main control point. Next up, in the orange, we have an ephemeral environment that's used. And this is really cool because UV is able to put something temporarily as a package and I don't have to worry about it. It's autocleaned after use and this is where the execution happens. Now, in the bottom node here, this is where the yellow UV cache is kept, and you can see that maybe it's 6.8 megabytes in size, it's temporary storage. But if we look at what's happening here is that it's a continuous operation. We're connecting all of the components together and it allows us to have a very effective way to deal with third-party packages in Python. So what are some of the takeaways? Sub-millisecond installation here. We also have the ability to have key performance capabilities enabled. And then finally what we have here is a amazing tool that helps you run tools like a script or run some kind of, you know, utility that typically would require a lot of, you know, dependency set up and using third-party tools. But in this case, it goes away and goes to the background. And that's really what I think the power is of this Rust-based packaging tool for Python is that it makes it ephemeral and you don't think about packaging, you just run the code. And that's the advantage of a tool like UV.
内容
-
-
-
(已锁定)
Implications of Amdahl’s law: A walkthrough4 分钟 5 秒
-
(已锁定)
Compiling llama.cpp demo4 分钟 17 秒
-
(已锁定)
GGUF file format3 分钟 18 秒
-
(已锁定)
Python UV scripting3 分钟 55 秒
-
Python UV packaging overview1 分钟 59 秒
-
(已锁定)
Key concepts in llama.cpp walkthrough4 分钟 37 秒
-
(已锁定)
GGUF quantized llama.cpp end-to-end demo4 分钟 3 秒
-
(已锁定)
Llama.cpp on AWS G5 demo4 分钟 20 秒
-
(已锁定)
-