Effects of Agent-assisted, LLM-assisted and Traditional Workflows on Diagnosis and Management Planning at Admission
Effects of Agent-assisted, LLM-assisted and Traditional Workflows on Diagnosis and Management Planning at Admission: A Randomized Controlled Trial
- Clinical Decision Support Systems
- Diagnostic Reasoning
- Artificial Intelligence (AI)
At a glance
- Phase
- Phase not stated
- Study type
- Interventional
- Sponsor
- Second Affiliated Hospital, Zhejiang University, School of Medicine
- Enrolment target
- 180
- Started
- 6 September 2026
- Main results due
- December 2026
- Study sites
- 1
- Registry updated
- 28 September 2026
Can you take part?
- Aged 18 years and over.
- Open to any sex.
- Healthy volunteers can take part.
These are the headline rules only. Every study has a longer list, and whether you are eligible is decided by the research team at the site — never by this page.
Read the full eligibility criteria
Inclusion Criteria * Hold a Medical Practitioner Qualification Certificate and/or Medical License, or be a recognized standardized resident physician; able to independently read electronic medical records, laboratory and imaging reports on an HIS. * Currently engaged in clinical work in internal medicine or surgery at one of the 15 participating hospitals. * Able to complete the case assessment in one continuous hour without breaks. * Able to participate remotely under video proctoring, with a stable internet connection and a working camera. * Voluntarily agree to participate and sign the informed consent form, including the declaration not to use unauthorized AI tools during the assessment. * Have not participated in case drafting, review, rubric development, or any activity that may leak the reference standard. Exclusion Criteria * Have previously accessed the official test cases or reference standard of this study. * Unable to complete the training module, qualification test, or all experimental tasks. * Have conflicts of interest, e.g. participation in developing core algorithms of the tested system. * Unwilling to comply with remote proctoring, including keeping the camera on throughout. * Judged unsuitable by the investigators.
What this study is about
In the sponsor’s own words, from the registry.
The goal of this clinical trial is to evaluate whether AI-assisted workflows improve physicians' admission diagnosis and management planning performance on standardized simulated inpatient cases, among practicing internal medicine and surgery physicians across all seniority levels and across three tiers of the Chinese healthcare system.
The main questions it aims to answer are:
* Does the Agent-assisted workflow yield better structured admission diagnosis and management planning scores than standalone LLM assistance? * Does the Agent-assisted workflow outperform the traditional workflow without AI tools? Researchers will compare three parallel groups (traditional workflow group, LLM-assisted group, Agent-assisted group) to determine whether the Agent tool can improve diagnostic accuracy and efficiency.
The goal of this clinical trial is to evaluate whether AI-assisted workflows improve physicians' admission diagnosis and management planning performance on standardized simulated inpatient cases, among practicing internal medicine and surgery physicians across all seniority levels and across three tiers of the Chinese healthcare system.
The main questions it aims to answer are:
* Does the Agent-assisted workflow yield better diagnosis and management planning scores than the LLM-assisted workflow? * Does the Agent-assisted workflow yield better diagnosis and management planning scores than the conventional workflow without AI assistance? Researchers will compare three parallel groups (traditional workflow group, LLM-assisted group, Agent-assisted group) to determine whether the agent tool can improve diagnostic and management planning performance and efficiency.
Participants will:
* Be recruited from 15 hospitals in China and participate remotely under video proctoring * Be randomly assigned to one of the three fixed workflows, with randomization stratified by hospital tier, specialty and seniority * Work through 6 anonymized simulated HIS admission cases and complete as many as they can. * Submit structured answers for each case covering principal diagnosis, secondary diagnoses, differential diagnoses, diagnostic justification, next diagnostic or therapeutic steps, consultation and referral decisions, and diagnostic confidence. * Have their operation logs and time consumption recorded automatically by the study platform. * Complete a post-session questionnaire after submitting all cases.
Study sites(1)
2nd Affiliated Hospital, School of Medicine, Zhejiang University
Hangzhou, Zhejiang, China
Recruiting
Showing 1 of 1 sites. 1 of the 1 site on this study is recruiting right now — a site can stop enrolling while the study as a whole is still open.
Source: ClinicalTrials.gov record NCT07760051. Trialion does not run this study, is not paid to refer anyone to it, and cannot enrol you. Eligibility is always decided by the research team at the site.
Not the right study?
Answer three questions and see the studies recruiting near you, in plain language.
Find a study for me