Announcing A New Book - Multi-Agent Systems with AutoGen!

I'm excited to announce a significant milestone in a project I've been working on: I'm writing a book? titled "Multi-Agent Systems with AutoGen"? published by Manning Publications Co. , and co-authored with AutoGen creator Chi Wang . As of today, the first chapters are available through Manning's Early Access Program (MEAP)!

You can pre-order the book now at https://mng.bz/eVP9.?

????Tip: Use the code 'mldibia' for a 50% discount, valid for the next two weeks until August 5th.

Recently, I've received numerous inquiries from software engineers, product developers, and engineering leaders about multi-agent systems. Common questions include how to build/configure them, when to use them, and how to integrate/deploy them in end-user applications. This book aims to address these questions and share insights gathered over the past year while contributing to the AutoGen open-source framework and developing tools like AutoGen Studio.

In this book, you'll learn about:

1. Core components of multi-agent systems and their implementation using tools like AutoGen and AutoGen Studio
2. User experience design guidelines for integrating multi-agent systems into end-user applications
3. Designing and building generic agents that solve problems by interacting with interfaces (e.g., carrying out actions on webpages, mobile apps, desktop apps)
4. Evaluating multi-agent systems using off-the-shelf benchmarks like GAIA, GPTQ, and SWEBench, as well as creating custom benchmarks
5. Optimizing performance through agent parameter tuning, small model fine-tuning, parallel processing, dedicated planning agents, and more
6. Deep dives into several use cases, such as multi-agent workflows for data analysis, customer service tasks, and creativity

Through Manning's Early Access Program, you'll receive the first chapters immediately and access a forum where Chi Wang and I can directly answer your questions. Later chapters will be released progressively.

While there are many ways to learn collaboratively about this growing and exciting field, we hope that reading this book and working through the code and experiments that accompany it will offer an engaging and effective learning experience. If you've enjoyed my previous writing style, explanations, and demos [see here, here, here, here], I believe you'll find "Multi-Agent Systems with AutoGen" equally compelling. It promises to be an interesting journey!

Why Write About Multi-Agent Systems?

The field of building autonomous or semi-autonomous multi-agent systems (enabled by generative AI models) is relatively new. As such, there are no perfect standards or well-known design patterns yet. We are essentially in a phase of learning through experimentation, discovering the right abstractions, building appropriate frameworks, and converging on effective protocols. This has been my experience while building AutoGen Studio - a widely used low-code/no-code UI for building and testing multi-agent workflows (with >21k downloads per month on PyPI).

Despite the field's nascence, there has been intense interest, with industry leaders like Andrew Ng mentioning agentic systems and multi-agent collaboration patterns as the next frontier for generative AI.

In my opinion, there are several reasons why multi-agent systems are important:

1. Solving new types of tasks (complex tasks): Some problems have defied automation or traditional software solutions so far. These problems are typically long-running, involve multiple steps that often require diverse expertise, necessitate planning/coordination across these steps, and frequently exist in dynamic environments. They often require human oversight to manage each step until successful completion. In the book, I refer to these as complex tasks. Example: Back-office staff that triage emails, scan for invoice attachments, extract data from each invoice, and enter them into four disparate internal systems.
2. Helping users save time: If we can successfully achieve the first point above, we can save a significant amount of human effort and reduce tedium. This is how organizations, through their products, generate revenue.
3. Creating disruptive new digital interfaces: Until now, we've had custom-tailored software for various tasks - an app for creating charts (e.g., matplotlib), a separate app for creating and editing documents (Word, Google Docs, etc.), a separate app for exercise and training etc. A truly sophisticated, general-purpose multi-agent system could accomplish all of this, adapting to provide the right interface given the user's context and the task at hand. This is could change how software developers build apps (see an excerpt diagram from the book below), how users consume these apps. All potentially disruptive, and worth careful discussions and experimentation.
4. Thinking through responsible AI considerations: Well, when systems can act on our behalf, the costs of interacting with these systems can change. Agents downloading files for us might be low cost. Agents canceling our meetings might be medium cost. Agents that can delete medical records - high cost. This means that we must devote careful discussion to understanding this space, finding the right language and structure to understand and minimize these costs.

To be clear, the best multi-agent systems we have today still fall short of fully realizing these three benefits. However, like every area of progress, what we have learned from current experimentation, coupled with rapid advancements in reasoning capabilities (and reducing costs), make this the right time to build and experiment!

Who is the Book For?

This book is ideal for you if you are:

• A software developer looking to expand your skills in AI-driven applications and leverage multi-agent systems for complex problem-solving
• An AI practitioner interested in understanding and applying multi-agent architectures within existing AI projects
• A system architect or engineer aiming to design more efficient and sophisticated AI solutions that require orchestration of multiple AI agents
• A technical product manager seeking a deeper understanding of multi-agent AI technologies to oversee the development of advanced AI features in products?
• A designer looking to create intuitive user interfaces that are based on a? multi-agent solution stack?

About the Authors

Victor Dibia

Principal Research Software Engineer, Microsoft Research

Victor Dibia (PhD) is a Principal Research Software Engineer at Microsoft Research, where he has contributed to projects like GitHub Copilot that serves millions of customers. He is the creator of LIDA, a widely used tool for automated visualizations using generative AI models, and AutoGen Studio , a low-code tool for prototyping multi-agent applications. Victor holds a PhD in Information Systems from City University of Hong Kong and an MSc in Computer Science from Carnegie Mellon University.?

• X
• LinkedIn

Chi Wang

Principal Researcher, Microsoft Research

Chi Wang (PhD) is a Principal Research Scientist at Microsoft Research. He is the creator of AutoGen , a fast-growing OSS project to enable next-gen AI applications via a multi-agent framework. Chi is also the author of FLAML , a fast library for automated machine learning and tuning that has been used in products such as Microsoft Azure, Microsoft 365, Microsoft Fabric, and Visual Studio. He holds a PhD in Computer Science from the University of Illinois at Urbana-Champaign.

• X
• LinkedIn

FAQs

• Is the book limited to AutoGen?

No. Across the book, the goal is to teach core principles and AutoGen is used as a tool to illustrate these principles. We expect that these principles can be implemented in any sufficiently expressive multi-agent framework

• Are there details on what the book will cover?

Yes! Full list of proposed chapter content is here https://multiagentbook.com/book/

• Can I use multiple models with the agents described in the book?

Yes! AutoGen natively supports multiple generative AI model providers - OpenAI , Microsoft Azure OpenAI, 谷歌 gemini models, Anthropic , Cohere etc. Ofcourse, you can use local models from Hugging Face via endpoints provided by tools such as vllm, Ollama , lmstudio etc.

• Is there a discount code for the book?

Yes! You can pre-order the book from Manning Publications using the code mldibia for a 50% discount. This offer ends August 5.

• Is there a GitHub repository for the book?

Yes! The GitHub repository for the book is available at victordibia/multiagent-systems-with-autogen. Take a look, open issues, and share your thoughts!

• I found some errors in the book, Can I report them?

Yes, thank you so much! Please report any errors you find in the book to the authors via the Manning Livebook Page

So - How Do I Stay Updated on Book Progress, Links?

I have created a one-stop location to make this easy - https://multiagentbook.com/. This page will triage updates on things like new chapters, example code, interactive demos, faqs, references and relevant links.

• Multi-Agent book website - https://multiagentbook.com/
• Pre-Order on Manning.com - Multi-Agent Systems with AutoGen on Manning.com

Acknowledgements

None of this work would be possible without all the engaged maintainers and contributors to the AutoGen OSS project (many of them my colleagues) ! Thank you!

I really hope you join us along this journey!!

Victor, Chi.

#multiagent #multiagentsystems #agents #AI #MachineLearning #AutoGen #AIEngineering #SoftwareDevelopment #TechBook #AIResearch