高通转发了
Meta Llama 3.2 running on NPU ?? We’ve been working closely with the ONNX Runtime team + Qualcomm to bring NPU support to LM Studio! H/t to Matthew Clayton and Natalie Kershaw for pulling this off in record time. Thanks Manoj Khilnani Devang Aggarwal Manish Sirdeshmukh for the partnership. In the picture: Snapdragon NPU doing the hard work during a session demo at Microsoft Ignite in Chicago this evening. It’s currently an engineering build, and the team is working to get ready it for release soon, stay tuned.
Juan Fernando G.
20 小时前
Fantastic update
Technical Pathfinder
1 天前Oh wow! This is so cool! Can’t wait to run it on my TuringPi RK1 cluster!! ??