AdvertiseDonate
Latest20 Labour MPs Pay 9,600 Pounds for Leadership Training
ChicagoMilwaukeeMadisonFort WayneIndianapolisToledoDetroitCincinnati
News Locall · 330 North Wabash Avenue Suite 23rd Floor, Chicago, IL 60611
Tech · AI

AI Panel Outperforms Doctors in Clinical Simulations

A new multi-agent diagnostic system achieved higher accuracy than human generalists on complex cases, prompting Microsoft to accelerate its healthcare AI roadmap.

By Gabriel Serrano ·

Illustration for: AI Panel Outperforms Doctors in Clinical Simulations
Illustration generated for this article, not a news photograph.

For patients facing difficult medical diagnoses, a new study suggests that artificial intelligence may soon offer a more reliable second opinion than individual generalist physicians. A diagnostic system developed by Microsoft correctly identified complex conditions in simulated scenarios significantly more often than human doctors working alone. While these cases are typically managed by specialists in practice, the results indicate a potential shift in how routine and borderline complex cases are triaged and evaluated in the near future.

The development follows a rapid expansion of AI in healthcare over the past few years. Microsoft AI CEO Mustafa Suleyman joined the company in 2024, bringing his experience from previous ventures in clinical AI. His vice president of health, Dominic King, followed shortly after. This year, Microsoft published findings in the journal Science, positioning itself alongside Google and OpenAI as a leader in medical diagnostic capabilities.

The system, known as MAI-DxO, functions by coordinating multiple AI agents that simulate a panel of doctors. These agents interact with patient data, order necessary tests, and debate potential diagnoses. In simulations using difficult cases from the New England Journal of Medicine, the system was correct 83 percent of the time. By comparison, primary care doctors and general internists, when working individually with standard reference materials, were correct only 36 percent of the time.

Analysis of the results indicates that much of the performance boost comes from using more powerful underlying AI models. Microsoft tested the orchestration system with models from various providers, including OpenAI, Google, Anthropic, Meta, and DeepSeek. The highest accuracy scores were achieved when the system utilized OpenAI’s GPT-5 and GPT-5.5 models. While the orchestration layer added incremental gains, the gap between weaker and stronger base models remained larger than the improvement provided by the multi-agent structure.

Cost efficiency was also a key metric. Using GPT-5 alone on complex cases cost approximately $8,400 per case with 78.9 percent accuracy. The DxO system reduced this cost by about $3,000 while raising accuracy by roughly four points. However, for emergency department cases, the system offered little improvement in either cost or accuracy over the base models. The orchestration proved most beneficial for complex cases and when paired with less capable AI models.

Microsoft is currently collaborating with the Mayo Clinic to train a healthcare-specific foundation model, with a release expected next year. Suleyman predicts that by 2027, the company will be on the verge of a breakthrough in streaming highly accurate predictions about how medical records might unfold. He views this foresight as a critical tool for clinicians. Additionally, a new partnership with Beth Israel Deaconess Medical Center in Boston will evaluate the system’s clinical reasoning across various hospital settings, including emergency and urgent care environments.

In these real-world evaluations, patients will receive standard care while consenting participants also interact with the AI system. Microsoft plans to compare the AI’s recommendations against those of human doctors. The company aims to move beyond simple benchmarking and integrate these tools directly into clinical workflows. Suleyman stated that Microsoft intends to lead the market in medical clinical decision support products over the next few years, viewing this focus as a key differentiator for its AI efforts.

More Tech · Report a business · Got a Story?

Get News Locall in your inboxLocal news, all in one place. Free, a few times a week, unsubscribe any time.

Related stories

Get News Locall in your inboxLocal news, all in one place. Free, a few times a week, unsubscribe any time.