AI everywhere? Where are we going?
Saiyam Pathak
Principal Developer Advocate, Loft Labs | Founder, Kubesimplify and BuildSafe | CNCF TAG Sustainability lead
We all know that we have entered into the new era of AI. No matter what field we are in, we are thinking, talking, and working towards AI. I spoke to many founders and co-founders in the past few weeks, and they all are working on something related to AI. The wave is real; it's effective and it's more than just chatbots. The number of applications and research papers are rising in this field, creating really cool possibilities. So YES, we should have a basic knowledge of what is happening around us and what is happening within the products that we are using.
I have been learning a lot about Generative AI, its angle with cloud-native technologies, and how Kubernetes is making things easier. The Kubernetes community, along with other foundations in the cloud-native ecosystem, are working together to solve complex infrastructure challenges. Kubernetes has kind of become the de facto standard for running inference or conducting training via batch jobs that run for several days.
Did you know that OpenAI is the organization that published a blog about scaling Kubernetes nodes to 7,500? Hugging Face, Bloomberg, CERN, and Adobe all run on Kubernetes, which shows how significant it is in the AI ecosystem.
Kubernetes KEPs, like Dynamic resource allocation and Improved multi-NUMA alignment in the Topology Manager, show how invested the Kubernetes community is in order to use GPUs more efficiently.
All this demonstrates progress towards helping innovators innovate. This AI revolution is going to be even bigger, but that does not mean it's sidelining other developments, as there are innovations happening at all levels. For example, Wasm with WASI 0.2 is out, platform engineering is introducing more and more tools, and there are more enhancements in the Kubernetes ecosystem. AI is big and impactful and will continue to rise in terms of how we use it, but there will also be significant improvements and developments in other areas, including operating systems and open-source software projects.
What have I been upto?
I gave my talk at Civo Navigate happened last week in Austin. I was about Generative AI in Kubernetes era with Kubeflow and I showed an end to end demo of stable diffusion model running on Kubeflow. It was fun building the demo and learning along the way. With this I wanted to cover the basics of generative AI and Kubeflow with its cloud native angle.
I have a few sessions selected for KubeCon and WASM/IO so I will be there for both those conferences as well.
WASM IO sessions
KubeCon Sessions
Heating Pools with Cloud Power: A New Wave in Green Computing - Saiyam Pathak, Civo & Mark Bjornsgaard, Deep Green TechnologiesPAVILION 7 | LEVEL 7.3 | S06
Building a Tool to Debug Minimal Container Images in Kubernetes, Docker and ContainerD - Kyle Quest, Slim.AI & Saiyam Pathak, CivoPAVILION 7 | LEVEL 7.3 | S05
Sneakpeak of my demo, I will be giving similar talk again with enhanced demo at CNCF Chandigarh meetup on 10th March 2024.
What are your thoughts on GenAI in general and where it is going? Do comment.
领英推荐
Sponsored Content
Without the sponsors I won’t be able to give you an authentic newsletter with all the cool stuff, so please do check them out
Awesome Reads
Kubesimplify Updates
Wasm course hits 4k hits, keep learning WebAssmebly and share within your network.
We have written two new shiny blogs in past 2 weeks as well by Krish Gupta
Resources and Repos
Learn from X platform
So subscribe and share if you like this edition :)