A new survey released by Carta Healthcare, a leading provider of AI-powered clinical data abstraction solutions, shows that hospitals and health systems prefer AI models that combine technology with medical expertise.
Healthcare executives want AI to support physicians rather than replace them, according to the results of the November 2025 AI in Hospitals & Health Systems market survey. Because “hybrid intelligence” integrates technology with human and clinical experience, it is the superior and preferable approach, according to every significant finding.
Health system executives were surveyed by Reaction Data regarding their opinions of AI model types, adoption obstacles, and the function of human oversight in clinical workflows. In high-stakes healthcare settings, respondents repeatedly stated that autonomous, “black box” AI is dangerous and inadequate, but AI combined with knowledgeable human validation is thought to be safer, more accurate, and more effective.
Majority Cite Risks of Autonomous AI; Human Oversight Seen as Essential
Respondents expressed strong skepticism toward fully autonomous AI.
- 62.5% identified “misinterpretation of data” as the top risk when AI operates without human oversight—a concern with direct implications for patient safety and data reliability.
- Only 12.5% of organizations reported that autonomous AI has delivered the most value in their work to date.
By contrast,
- 75% of respondents rely on “human validation” to ensure AI outputs are clinically relevant and trustworthy.
- Another 75% rated clinician involvement in AI design and deployment as “critically important,” underscoring the expectation that AI must work with clinicians, not independently of them.
Hybrid Intelligence Emerges as the Superior and Preferred Model
Fifty percent of respondents also stated clearly that AI “should augment human decision-making,” compared to a minority who view it as a tool for task replacement.
“The survey makes clear what we’ve long believed: good AI is not good enough,” stated Brent Dover, CEO of Carta Healthcare. “Healthcare leaders aren’t looking for a magic switch to automate healthcare. They want a force multiplier—AI that respects clinical expertise, demands human validation, and integrates seamlessly into existing workflows. The winning strategy is about building a better team where AI provides the speed and scale, while humans provide the judgment and care.”
Disclaimer:
The information contained in this article is for educational and informational purposes only and is not intended as a health advice. We would ask you to consult a qualified professional or medical expert to gain additional knowledge before you choose to consume any product or perform any exercise.
