Lightning AI

We're thrilled to see our CPO, Priya Shivakumar, featured in Capacity Media - a techoraco brand's latest article, "Women Leading the Charge in Open Source AI." Her leadership and vision are driving innovation and inclusivity in the AI community. Read more about her journey ?? https://bit.ly/4fYtCIi

Proof that a small, focused team with the right tools can achieve incredible things! Using the Lightning stack, Jina AI scaled their distributed infra and trained multiple embedding models - all with just 2 engineers and 1 intern. 2 tools you need to know about: Lightning Fabric Simplifies PyTorch by handling complex hardware logic, scaling strategies, and precision settings, letting you focus on building and training models with expert-level control and fewer errors. You retain control, but reduce surface are for errors and gain easy scaling. https://lnkd.in/d3JQfEpw Lightning AI Studio: Lightning Studio simplifies AI development by bringing the power of cloud GPUs to your local IDE with team-ready collaboration in one cohesive platform. Use it to prototype, train, and deploy AI models up to 80% faster, without ever worrying about infrastructure. https://lightning.ai/

Excited to see Solo Tech using LitServe to power on-device AI solutions! Their work highlights the flexibility of our open-source tools and demonstrates how AI can excel in privacy-focused, offline environments. Great to see these tools in action! Learn more about Solo: https://bit.ly/3CETpHu Use LitServe for your own projects: https://bit.ly/3Zi4kzK

Thunder sessions update ? Luca Antiga and Thomas Viehmann are still deep in the weeds debugging the HF Llama performance without cudagraphs. Rather than rush, they're taking the time to crack this for a proper session next week. Stay tuned during Thanksgiving break for the deep dive you deserve! ?? Until then catch up on our previous episodes: https://bit.ly/3ZkF8s0

Big news! Lightning AI has raised $50M to advance our mission of simplifying and scaling AI development for enterprises and developers. As mentioned in the linked TechCrunch article, we're making AI development as intuitive as it is powerful. A huge thank you to our investors Cisco Investments, J.P. Morgan, NVIDIA and K5 Global. Onward and upward ?? Read more ?? https://tcrn.ch/4hSkR4q

How do you build a LLM from Scratch? This is the key question that I discussed with Sebastian Raschka, PhD on the AI Stories Podcast! For those who still don’t him, Sebastian is a Senior Staff Research Engineer at Lightning AI and a bestselling book author. He recently released a new book: "Build A Large Language Model From Scratch". This is a technical conversation around LLMs, we cover various topics including:? ?? His new book: "How to Build A LLM From Scratch" (link in the comments) ?? Differences in architecture between GPT2 and more recent LLMs like Llama 3.1 ?? How to build high performing LLMs ?? How to train multimodal LLMs ?? Lightning AI, PyTorch Lightning and litgpt libraries to train, finetune & deploy LLMs ?? Long context windows vs RAG And much more ... What are you waiting for? Go and listen to our conversation on your favourite platforms ??: Youtube: https://lnkd.in/e4h9vWGS Spotify: https://lnkd.in/exCbPMis Apple Podcast: https://lnkd.in/eXpDrdxg Have you read Sebastian's book? Keen to get your thoughts in the comments! What other LLM books do you recommend? Please share them in the comments as well :)

Watch last week's Thunder Sessions episode where Luca Antiga and Thomas Viehmann enjoy a 3x speedup using CUDAGraphs and the Thunder CUDAGraph Transform. See the full episode here ?? https://bit.ly/4fUxYQG

Big thanks to Lightning AI for being a Silver Sponsor for NumHack! With their expertise in accelerating AI development, they’re empowering our participants to build and deploy impactful solutions with ease. We’re thrilled to have Lightning AI lighting the way for innovation at this year’s event! Don’t miss out on the chance to join NumHack! Connect with data enthusiasts, collaborate on impactful projects, and learn from industry experts. Register today and become part of a vibrant community driving innovation in data science and open source! Learn more at https://hubs.la/Q02Yyq1s0 #NumHack24 #AIForGood

Come meet the Lightning AI team at #AWSreInvent and learn: ? How to train your model lightning fast on Amazon Web Services (AWS) ? Pretrain LLMs and foundation models across 10k+ GPUs with zero setup. ? Serve models with 99.95% uptime ? What's to come from Lightning in '25 ?? Limited times available so book ASAP https://bit.ly/3O7rZMS

?? ???? ?????? ?????????????? ?????????????? ?????? ?????? ??????! Welcome to ACM, Association for Computing Machinery 5th International Conference on AI in Finance, #ICAIF'24. So excited and proud to have put together this stellar list of speakers for our workshop "???????? ?????????????????? ???? ????????????????????: ?????????????????? ????????-?????????? ???? / ???? ???????????? ???? ?????? ?????????????????? ????????????????". Our esteemed speakers: ? Dr. Jochen Papenbrock, NVIDIA ? Gaby Marano, Microsoft ? Dr Miquel Noguer i Alonso, AIFI - Artificial Intelligence Finance Institute ? Harry Mendell, Federal Reserve Bank of New York ? Subhabrata Das, PhD, JPMorganChase ? Shivendra Pandey, Trustly Don't miss the chance to attend this power-packed workshop! ?? Location: NYU Tandon School of Engineering, Brooklyn NY ? Date: November 15, 2024, 1 PM to 5 PM EST ? ??????????: Live presentation of the ???????? ???????????????? ????????????. Accepted paper details are listed on the website. ???? We are grateful to Lightning AI for sponsoring our workshop and helping us help the tech community. Robert Wood will demo Lightning AI's platform and share key insights about the platform with our #ICAIF community. cc: Dhagash Mehta, Ph.D., Yongjae Lee, Tucker Richard Balch