课程: Large Language Models on AWS: Building and Deploying Open-Source LLMs
免费学习该课程!
今天就开通帐号,24,700 门业界名师课程任您挑!
Python UV scripting
课程: Large Language Models on AWS: Building and Deploying Open-Source LLMs
Python UV scripting
- [Instructor] One real problem with doing AI and ML is you have to deal with Python packaging. And for a long time it's been non-deterministic, slow, but, there is some help on the way. And this is a tool that could come in handy for a project you're working on for large language models, as you need to use Python somehow. First step, install UV. So we can see here, I do a curl to astral.sh here and boom, we get UV running. It's ridiculously fast. And one thing to point out, is if I go to which uv, ah, here we go. It's in my .local/bin. And if I do a du command on this, we say du - sh, here, home/Noah/.local/bin/uv, you can see it's tiny. So this is the advantage of RUST right? It's a RUST based tool that fixes the problem with Python packaging, which is a little bit ironic, is it's tiny, binary optimized, just incredibly fast. And if you want to run it, you can go right here. And you can see there's all kinds of cool options here. Now, the feature that I think is really interesting…
内容
-
-
-
(已锁定)
Implications of Amdahl’s law: A walkthrough4 分钟 5 秒
-
(已锁定)
Compiling llama.cpp demo4 分钟 17 秒
-
(已锁定)
GGUF file format3 分钟 18 秒
-
(已锁定)
Python UV scripting3 分钟 55 秒
-
Python UV packaging overview1 分钟 59 秒
-
(已锁定)
Key concepts in llama.cpp walkthrough4 分钟 37 秒
-
(已锁定)
GGUF quantized llama.cpp end-to-end demo4 分钟 3 秒
-
(已锁定)
Llama.cpp on AWS G5 demo4 分钟 20 秒
-
(已锁定)
-