Microsoft Intros Open Source Multi-Agent AI System

Microsoft researchers have unveiled a new open source multi-agent AI system, aimed to help enterprises automate complex tasks typically requiring human intervention.

Named Magnetic-One, the project is designed to handle a wide range of complex, open-ended tasks on the web and in file-based environments. Microsoft said the new system will allow AI agents to not only converse with users, but also execute complex multi-step tasks — a leap for AI evolution, according to the company.

"It's the difference between generative AI recommending dinner options to agentic assistants that can autonomously place your order and arrange delivery," wrote Microsoft researchers. "It's the shift from summarizing research papers to actively searching for and organizing relevant studies in a comprehensive literature review."

Similar to Salesforce's Agentforce, Magnetic-One uses a multi-agent system to automate and execute tasks. At the center of the system is an "Orchestrator" agent that manages and coordinates four specialized agents:  WebSurfer, FileSurfer, Coder, and ComputerTerminal. Each agent is responsible for a specific function, including web navigation, file handling, coding, and command-line operations. The Orchestrator dynamically assigns subtasks, monitors progress, and adapts its strategy as needed to complete complex tasks with minimal human input.

 

[Click on image for larger view.] Figure 1. Magnetic-One's multi-agent model.

"The Orchestrator plans, tracks progress, and re-plans to recover from errors, while directing specialized agents to perform tasks like operating a web browser, navigating local files, or writing and executing Python code," wrote researchers with Microsoft AI.

Microsoft is initially releasing Magnetic-One as an open source project for researchers and developers. Although the system demonstrates strong generalist capabilities, it remains below human-level performance and may still encounter errors. As agentic systems become more capable, risks such as unintended actions or potential misuse could increase, said Microsoft.

Recognizing that agentic AI is still in its early stages, Microsoft is counting on the public to help address these challenges and ensure that future systems are both effective and secure through usage. To support this, the company is also introducing AutoGenBench, an evaluation tool designed to rigorously test agentic tasks with built-in controls to minimize unwanted side effects through repetition and isolation.

"AutoGenBench facilitates agentic evaluation and allows adding new benchmarks. Using AutoGenBench, we can evaluate Magnetic-One on a variety of benchmarks," wrote Microsoft. "Our criterion for selecting benchmarks is that they should involve complex multi-step tasks, with at least some steps requiring planning and tool use, including using web browsers to act on real or simulated webpages. We consider three benchmarks in this work that satisfy this criterion: GAIA, AssistantBench, and WebArena."

Magnetic-One is available for download here.

About the Author

Chris Paoli (@ChrisPaoli5) is the associate editor for Converge360.

Featured

  • person signing a bill at a desk with a faint glow around the document. A tablet and laptop are subtly visible in the background, with soft colors and minimal digital elements

    California Governor Signs AI Content Safeguards into Law

    California Governor Gavin Newsom has officially signed off on a series of landmark artificial intelligence bills, signaling the state’s latest efforts to regulate the burgeoning technology, particularly in response to the misuse of sexually explicit deepfakes. The legislation is aimed at mitigating the risks posed by AI-generated content, as concerns grow over the technology's potential to manipulate images, videos, and voices in ways that could cause significant harm.

  • abstract image of fragmented, floating geometric shapes with holographic lock icons and encrypted code, set against a dark, glitchy background with intersecting circuits and swirling light trails

    Education Sector a Top Target for Mobile Malware Attacks

    Mobile and IoT/OT cyber threats continue to grow in number and complexity, becoming more targeted and sophisticated, according to a new report from Zscaler.

  • An abstract depiction of a virtual reality science class featuring two silhouetted figures wearing VR headsets

    University of Nevada Las Vegas to Build VR Learning Hub for STEM Courses

    A new immersive learning center at the University of Nevada, Las Vegas is tapping into the power of virtual reality to support STEM engagement and student success. The institution has partnered with Dreamscape Learn on the initiative, which will incorporate the company's interactive VR platform into introductory STEM courses.

  • Campus Technology Product Award

    Call for Entries: 2024 Campus Technology Product Awards

    The entry period for the 2024 Campus Technology Product Awards is now open.