PyTorch

We’re excited to welcome Rebellions to the PyTorch Foundation as a General Member! ?? Rebellions is a South Korea-based semiconductor company specializing in the design and development of AI chips for data centers and edge devices. ???? We look forward to collaborating with Rebellions to drive innovation and strengthen the PyTorch ecosystem for developers worldwide. Announcement here: https://hubs.la/Q02Z79V90 “By integrating our hardware innovations with PyTorch, we’re building Native NPU support to accelerate diverse AI workloads.” said Hong-seok Kim, the Chief Software Architect at Rebellions. “We’re excited to contribute to the PyTorch community by community-driven initiatives and partnerships, advancing NPU architecture support for next-generation AI solutions. Together with the PyTorch community, we aim to pioneer new possibilities in AI acceleration and empower developers worldwide with efficient computing solutions.”

PyTorch leads the model training space, with 63% adoption rate ?? New research from The Linux Foundation, LF AI & Data Foundation & Cloud Native Computing Foundation (CNCF) shows how open source tools and frameworks play a critical role in #GenAI model building and inference. For more insights, download the research report on shaping the future of generative AI: https://lnkd.in/eGTGcFXT #OpenSource #AI #ML #PyTorch #GenAI #Inference #ModelBuilding

We are happy to announce the addition of knowledge distillation to torchtune, a PyTorch library for easily authoring, fine-tuning and experimenting with LLMs. Knowledge distillation is a technique for imparting knowledge from a larger teacher model to a smaller student model. This was a key step in Llama 3.2 pretraining. Check out how we can leverage knowledge distillation in post-training to distill Llama 3.1 8B to Llama 3.2 1B using torchtune: https://hubs.la/Q02YyqPP0

PyTorch is powering the most powerful financial LLMs explained Matt White, PyTorch Foundation Executive Director, today at the International Workshop on Multimodal Financial Foundation Models (MFFMs) at ACM, Association for Computing Machinery's International Conference on AI in Finance in NYC. #LLMs #AI #FinTech #PyTorch #Finance #MFFMs

PyTorch Expert Exchange Webinar: How does batching work on modern GPUs? with Finbarr Timbers, an AI researcher, who writes at Artificial Fintelligence and has worked at a variety of large research labs, including DeepMind and Midjourney Batch inference is the most basic optimization that you can do to improve GPU utilization. It is often overlooked and misunderstood because of how common it is. Here, we walk through why, exactly, batching works, and help you develop intuition for what exactly is going on inside your GPU.

We'll be live today in 1 hour ?? Find out how you can develop intuition for what exactly is going on inside your GPU

Batch inference is the most basic optimization that you can do to improve GPU utilization. It is often overlooked and misunderstood because of how common it is. AI researcher, Finbarr Timbers will walk through why, exactly, batching works, and help you develop intuition for what exactly is going on inside your GPU. Join us live on Wednesday at 10am PT for our next PyTorch Expert Exchange: https://hubs.la/Q02XNSDB0

The worldwide PyTorch community grows stronger every day ???????? Last week, Executive Director of PyTorch Foundation Matt White shared updates on PyTorch at Open Source Summit Japan ???? #OpenSource #AI #OSSummit #AIdev The Linux Foundation

Pair the vLLM engine with TorchServe to create a full-fledged #LLM serving solution for production ?? Find out how in our blog: https://hubs.la/Q02WxJQ20

Learn the inner workings of Triton, the hardware agnostic language for GPU programming and powering TorchInductor: https://hubs.la/Q02WlVXr0