Web AI Monthly #22: First ever Google Web AI Summit (join us), counting salmon in Chile, and $65,000 to be won for using new Chrome AI features??

Enjoy the content? Help me help you, by giving us a share with your colleagues in your weekly team updates to get more eyes on great work in the Web AI field.

Tag me (Jason Mayes) if you make something noteworthy for future editions - many of my readers work for top global tech companies or startups. We have subscribers ranging from decision makers (think C-level, VPs, and Directors) to folk on the frontlines using this stuff day to day (SWEs, web engineers and researchers). You never know who may see your creations.

?? Join us in-person for the 1st ever Google Web AI Summit!

It finally happened - I somehow convinced our 谷歌 VPs to let me go wild with my yearly internal Web AI summit that I've been running internally since 2022 so that you can attend too! Exciting.

If you're based in the bay area (or can travel there), join us in person (no live stream) on Friday October 18th at the Google Sunnyvale office by using the special code 51MOSS2B on the website! More details below.

Why attend?

I've curated a line up of around 20 presenters working in the field from 谷歌 , Hugging Face , 英特尔 , Microsoft, LangChain and many more in a 15 minute lightning talk format which should be fun and educational for all - with plenty of break times to check folks demos, network, or eat all the food and coffee I have ordered.

How do you sign up to attend IRL?

Glad you asked. Simply head on over to the official website here and use the following code to register while seats last: 51MOSS2B

Feel free to share with colleagues or friends who may want to go.

As mentioned this is IN PERSON only so please only register if you plan to come IRL. Else just subscribe to my posts on LinkedIn for when the video recordings go up after the show on YouTube.

A huge thank you to our presenters this year, some of which you can follow here on LinkedIn:

Charlie Gerard , James Bankoski , Charlie Ruan , Joshua Lochner , Jacob Lee , Moh Haghighat , Christopher Slee , Hugo Zanini , Kenji Baheux , Richard Stotz , Rob Kochman , Ruofei Du , Cory Grenier , Evgeny Peshkov , Thomas Steiner, PhD , Tyler Mullen , Yuriko Hirota , Kazunari Hara, Yu Lee, Aidan Nelson, David Li, and Rafael Cintron.

?? TensorFlow.js for industrial applications in Chile

This month I also met with IoT4Life SpA from Chile (thanks Milko Madariaga ) who are using Web AI in a rather interesting way - to count salmon at an industrial scale! Turns out salmon is one of the biggest exports of the country and keeping track of all those fish needed some object detection AI smarts.

At first glance it may seem simple to train an object detection model to recognize an object on a production line and count as it goes past a certain point, however there are a number of extra things you must account for in a production solution, like the conveyor belt reversing direction when there is a malfunction, or the sheer speed at which some of these conveyor belts can sometimes operate.

Web AI was chosen for this use case so that it was simple to maintain a real-time solution with custom hardware deployed to these industrial settings, while also having the ability to work entirely offline with regard the object detection part of the system for privacy reasons.

So next time you find yourself eating some salmon for lunch, TensorFlow.js may have had a part in getting that fish on your table! Pretty neat and of course I could see their application be applied to other production line systems too beyond just fish.

Check the video to see it in action. Keep up the great work! Reach out to them if you could re-use their work for your industry.

?? More LLMs this way come: Gemma 2 ported to web

Gemma 2 - 2B is running in a browser, thanks to the MLC folk, powered by WebLLM & WebGPU! Ported in less than 24 hours of Gemma 2 launch running 100% local on-device with Web AI. Amazing work by the MLC folk.

Thanks to Vaibhav Srivastav for the find check his tweet thread here:

Play with it yourself: https://huggingface.co/spaces/mlc-ai/webllm-simple-chat

?? New Web AI talks to watch

A number of great new talks were published since our last newsletter. Check them out on your next coffee break!

Building useful apps with small local LLMs

Learn about techniques using LangGraph.js to build with smaller LLMs, and some of the benefits to designing apps to work with OSS models, rather than always opting for the largest and most powerful in this talk by Jacob Lee from LangChain :

Web Apps of the Future With Web AI

AI is everywhere, but why should you care, as a web developer? Join Jason Mayes, Web AI Lead at Google, who presented his new talk at JSNation , to get you on track and take you through some of the latest machine learning models, tools, and frameworks you can use right in the browser via JavaScript to help you bring your creative web app ideas to life for almost any industry you may be working in.

By moving AI to the client side, there is no reliance on the server after the page load, bringing you benefits such as privacy, low latency, offline solutions, and lower costs which will be of growing importance as the field develops.

Seen a great Web AI talk? Tag me in it for next time!

?? World tour continues...

Thanks to everyone I met in Beijing, China at our final Google IO connect event - so many folk dropped by the booth or the presentations - was an incredible experience with an overwhelming number of people coming to pay us a visit during the event - Web AI is hot:

If you didn't manage to meet us at the prior 3 IO Connects, there is still a chance at some future events coming up...

DHAI Health & AI Innovation Summit - USA: Boston, 7th October

Website to learn more: https://worldbigroup.com/digital-health-summit-2024/

DevFest - The Premier AI Summit - Canada: Vancouver, 1st November

Hello Canadians! If you can get to Vancouver early November come join me at #DevFest!

Register here: https://gdg.community.dev/events/details/google-gdg-vancouver-presents-devfest-the-premier-ai-summit-in-vancouver/

?? $65,000 to be won just for using new Web AI features in Chrome - it pays to be working with AI in JS!

Announcing the Google Chrome Built-in AI Challenge starting this week!

Uncover the latest possibilities emerging with AI on the web and Gemini Nano in Chrome. Winners will be awarded one of many cash prizes totaling $65,000, get a chance to see their work featured on one of our Google channels, and speak to one of our judges to learn more about built-in AI.

The APIs can give you access to:?

• Create dynamic user prompts (Prompt API, Prompt API in Chrome Extensions)?
• Distill complex information into clear insights (Summarization API)
• Generate original, engaging text (Write API)
• Improve your content with alternative options (Rewrite API)

Please note: all of these tasks take place in the browser, using the models downloaded to your device without a need for server calls.

Huge kudos to Bradford Lee, Thomas Steiner, PhD, Natalia G., Kenji Baheux, André Bandarra, Dr. Sebastian Benz, and Alexandra Klepper for putting this on and judging the final entries.

Join the challenge today and help us shape the future of the web:

What are you waiting for? This is our moment as Web AI developers! Time to win some prizes for all your hard work.

Learn more and enter here: https://goo.gle/ChromeAIChallenge

See you next time!

If you're new to this space and want to learn Web AI, you can get started fast with my free Google Developers course here (no background in AI needed, just a love for JavaScript and curiosity for AI - I will teach you from zero). Or get inspired via my Show & Tell - I got you either way!

See you next time with even more great content and please do tag me (Jason Mayes ) if you make or find something for future editions - I need your help to find the latest and greatest news lovely #WebAI community as things are moving so fast!

Cheers!

Jason Mayes (that Web AI guy).