Inside India’s Biggest Data Engineering Summit

AIM successfully concluded its third edition of the Data Engineering Summit in Namma Bengaluru, featuring leaders like Aman Gupta of boAt Lifestyle, Marshall Goldsmith , Srikanth Velamakanni of Fractal, Elaina Shekhter of EPAM, Jaydeep Deshpande (JD) of Google Cloud and Workspace, and others.?

The response to the event was unprecedented, with attendees expressing their enthusiasm and appreciation for the insightful discussions and innovative ideas shared.?

The event witnessed over 1,000 attendees, alongside 50+ speakers and leaders from the AI and analytics ecosystem, discussing the latest in software deployment architecture, AI/ML systems, data frameworks for business use cases and more.?

At the opening session, Genpact vice president Prasenjit Ghosh showcased how generative AI, particularly LLMs, is revolutionising data engineering by transforming unstructured data into structured formats.?

“LLMs are proving crucial for data engineers by automating tasks and transforming unstructured data into structured, usable formats, essentially revolutionising how we handle data processing and analysis,” he said during his presentation on GenAI for Data Engineering .

NoBroker data sciences and engineering director Zaher Abdul Azeez also threw light on the transformative potential of generative AI in customer care. He emphasised its unique capability to extract structured insights from unstructured customer conversations, paving the way for more personalised and efficient customer service.?

“GenAI gives us a broad spectrum of capabilities, letting us do a variety of language tasks unlike conventional NLP applications. It understands unstructured human conversations, turning customer interactions into a goldmine for businesses relying on customer experiences,” shared Azeez.?

Further, he demonstrated a voice-based chatbot that utilises GenAI for more interactive and context-aware customer service, suggesting that voice-based GenAI could be the future of customer care services.

Parmjeet Virdi and Aashima Kumar of Publicis Sapient also hosted an insightful session showcasing how they leverage generative AI to derive actionable business insights from vast customer data, significantly enhancing decision-making capabilities .

One of the most interesting and engaging sessions at DES 2024 was presented by Pavan Nanjundaiah of Tredence Inc. alongside Maggi, an interactive robot assistant, who gave us a glimpse of what the future of data engineering will look like.?

During his session, he emphasised that despite the rise of generative AI, data engineers remain crucial. He advocated for a shift towards integrating business understanding and AI innovations to secure their roles in the evolving landscape.

“AI is after your job, but it’s not replacing you yet,” said Nanjundaiah, stating that the role of data engineers is evolving , and one needs to focus on expanding their core skills, integrating AI to create and manage new solutions.?

Praveen Singh from PayU’s session was also quite interesting. He spoke at length about the transformational approach of viewing data as a product (DaaP) to enhance quality, accessibility, and strategic value to businesses.

The event also unveiled the world’s first AI life coach , developed in collaboration with Fractal and based on the expertise of renowned life coach Marshall Goldsmith , author of the New York Times bestseller and #1 Wall Street Journal Business Book, ‘What Got You Here Won’t Get You There’.

Lastly, the standup show by Ashwin Srinivas and the mentalist performance by Aakarsh Bhat took the audience on a rollercoaster of emotions, blending laughter with awe and leaving everyone thoroughly entertained.

All the videos of the Data Engineering Summit 2024 will be made available on our YouTube channel soon.

Congratulations to the winners of the Data Engineering Awards 2024. Check out the winners here >>>

Thanks to all sponsors for the grand success of DES 2024, especially Genpact , MathCo , Tiger Analytics , EPAM , Fractal , Snowflake , Intuit , Publicis Sapient , Tredence , AB InBev , Diggibyte , DoubleCloud , Enqurious , TalentNeuron , and ADaSci for their crucial support.?

Special thanks to the AIM team for their unwavering dedication and teamwork.

Best Firm for Data Scientists >>

[Best Firms for Data Scientists is one of India's biggest workplace certification platforms in data science. To nominate your organisation for the certification, you can fill out the form here .]

Top Stories of the Week >>?

Breaking the Taboo Around Pronouns in Indian Tech

As Pride Month commences, this piece delves into the ongoing resistance within the Indian tech industry towards embracing gender-neutral pronouns, spotlighting a contentious debate over inclusivity versus traditional norms. Check out the full story here.

Real Struggles of Bringing Robots from Simulation to Reality

“Robots need to be able to deal with uncertainty if they’re going to be useful to us in the future. They need to be able to deal with unexpected situations and that’s sort of the goal of a general purpose or multi-purpose robot, and that’s just hard,” said Robert Playter , CEO of Boston Dynamics, in an interview with Lex Fridman last year. He couldn’t have been more real in describing the difficulty in robotics.?

Read the full story here.?

People & Tech >>

Meet the Creator of Sanskriti Bench, Building Cultural AI for India with Hugging Face and GitHub

Looking at the dire need to build AI in India, by India, and for India, GreyOrange AI research scientist Guneet Singh Kohli went on a unique journey. He began working on Hugging Face’s Data is Better Together initiative in partnership with Daniel van Strien from Hugging Face and, as a first step, introduced Sanskriti Bench. Read more here.

AIM Nuggets >>?

• Apple recently introduced the denoising language model (DLM) to enhance ASR systems, using TTS-generated synthetic audio for training.?
• Microsoft recently introduced a new Copilot Telegram bot , allowing users to search, chat, and ask questions to an AI assistant for various purposes.
• Google recently announced the ‘Gemini API Developer Competition ,’ which promises to give away a custom electric DeLorean as the grand prize among a $1 million prize pool.
• Meta recently released an in-depth introduction to Vision-Language Models (VLMs) . This technique surpasses traditional CNNs in performance, alongside expanding capabilities in interpreting and generating complex visual and textual data.
• OpenAI hinted at releasing GPT-5 faster than expected , with a new Safety and Security Committee set to evaluate and establish safeguards within a 90-day window.
• Former Whirlpool managing director Vishal Bhola joined Nothing as president of India operations , bringing extensive global experience to spearhead the company's innovative expansion, including the launch of Phone (2a) with ChatGPT integration.
• HCLTech recently partnered with Arm to enhance AI workloads , utilising Arm Neoverse Compute Subsystems to develop custom silicon chips for improved data centre efficiency.
• UiPath CEO Rob Enslin recently resigned , citing personal reasons; co-founder Daniel Dines steps in as his replacement.
• Zscaler CEO Jay Chaudhry denied Broadcom acquisition rumours , affirming the company's independent leadership in the zero-trust security market.
• TCS and IIT-Bombay recently collaborated to develop India's first Quantum Diamond Microchip Imager. Read more here.?
• CtrlS Datacenters recently launched its new AI-ready data centre – Hyderabad DC3, located in the financial district of Gachibowli.
• Jivi MedX, a medical LLM developed by Indian startup Jivi, outperformed OpenAI's GPT-4 and Google’s Med-PaLM 2 on the Open Medical LLM Leaderboard, scoring 91.65 across nine benchmarks.?
• Agnikul Cosmos recently achieved a historic milestone with Agnibaan SOrTeD , marking India’s first launch from a private launchpad and showcasing the world's first 3D-printed single-piece engine.?
• TMRW, an Aditya Birla Venture, recently partnered with Google Cloud to revolutionise fashion with AI-driven image generation, enabling personalised T-shirt designs through Bewakoof.com .
• Zoho recently invested in Yali Aerospace , a drone startup based in Thanjavur, enabling emergency medical deliveries and boosting rural innovation in India.
• CoRover.ai , the creator of BharatGPT, aims for aggressive growth with an INR 100 crore project pipeline, ramping up hiring and focusing on revenue amid surging demand for its conversational AI solutions.
• QX Lab AI, a UAE-based startup with Indian-origin founders, launched Ask QX PRO in the UK. It’s a multimodal generative AI platform with advanced features rivalling OpenAI with special emphasis on data privacy and accessibility in over 120 languages.
• Bhashini in collaboration with Nasscom, has launched the “Be our Sahayogi ” program on National Technology Day to crowdsource multilingual AI problem statements.