AIOS: The First LLM Agent Operating System

What's New

AIOS (LLM Agent Operating System) is a new agent orchestration framework that embeds large language models into operating systems, creating an OS with a "brain" that can "understand".

AIOS is designed for optimal resource allocation, facilitating context switches, concurrent execution, tool services for agents, access control, and providing a rich toolkit for developers.

AIOS is based on several key agents that orchestrate the others. It consists of:

• ?an Agent Scheduler for prioritizing agent requests,?
• a Context Manager for managing interaction context,?
• a Memory Manager for short-term memory,?
• a Storage Manager for long-term data retention,?
• a Tool Manager for managing external API tools,?
• and a Access Manager for enforcing privacy and access control policies.

Those agents communicate with the AIOS SDK in an interactive mode, along with non-LLM tasks coming from the OS Kernel (with the Process scheduler, the memory manager, etc). This architecture allows AIOS to integrate complex AI functionalities into traditional operating systems, enabling the development of more intelligent, responsive, and efficient applications that can leverage the full power of LLMs alongside conventional OS resources and capabilities.

Why This Matters

This approach is a shift in the way we interact with machines with agents deployed at the Operating System level that accomplish complex tasks. This trend is also demonstrated by Apple's ReALM models capable of understanding not only conversation, but also on-screen and background jobs information. This a new era of intelligent computing.?

?? News

• [2024-04-05] ??? AIOS codebase has been updated to add shell simulator, rapid API calls, and pre-commit test cases. Please see CONTRIBUTE for how to test your contributions and create pull requests.
• [2024-04-02] ?? AIOS Discord Community is up. Welcome to join the community for discussions, brainstorming, development, or just random chats!
• [2024-03-25] ?? Our paper AIOS: LLM Agent Operating System is released and AIOS repository is officially launched!
• [2023-12-06] ?? After several months of working, our perspective paper LLM as OS, Agents as Apps: Envisioning AIOS, Agents and the AIOS-Agent Ecosystem is officially released.

GET THE CODE