Artificial Intelligence (AI)NCT06775938
ChatGPT Versus Physical Medicine and Rehabilitation Residents
An observational study of Artificial Intelligence (AI) and Resident Education, run by Sisli Hamidiye Etfal Training and Research Hospital at 1 site in Turkey (Türkiye).
Trial summary
The aim of this study was to assess the performance of ChatGPT on examinations administered to physical medicine and rehabilitation (PMR) residents. Read more about this study
- Who is it for?
- Any age
- Conditions the study is for
- Artificial Intelligence (AI), Resident Education
- What is being tested?
- resident exam
- How many people
- 314 participants
- Where
- 1 siteTurkey (Türkiye)
- Study dates
- 1 Jan 2025to 10 Jan 2025
- Phase
- Observational
- Are there results?
- None posted in the registry
Key requirements
Who can take part, as listed by the sponsor. Only the study team can confirm whether you are eligible, so take this list to your doctor.
- Ages Any age
- All sexes
- No healthy volunteers
- Child, Adult, Older adult
Study population: The study used exam questions taken by the majority of residents enrolled in the PMR specialization training program held throughout Turkey in May 2024. These exam questions were selected from a pool of questions developed by lecturers affiliated with the PMR departments of hospitals affiliated with the University of Health Sciences. The exam questions were structured to cover four different difficulty levels.
Who may be able to join
- Physical medicine and rehabilitation residents exam results in May 2024
Who cannot join
- -
Trial locations and contacts
1 site in 1 country.
Turkey (Türkiye)1 site
Şişli Hamidiye Etfal Training and Research Hospital
Istanbul, Sarıyer
About this study
Official title: Can Artificial Intelligence Take Place of Physical Medicine and Rehabilitation Physicians?: ChatGPT Versus Physical Medicine and Rehabilitation Residents
The aim of this study was to assess the performance of ChatGPT on examinations administered to physical medicine and rehabilitation (PMR) residents.
Read the detailed description
These exams for resident physicians are annual exams administered throughout the training period, which constitute a fundamental component of the training process towards becoming a PMR physician. In this study, we evaluated the performance of ChatGPT in these exams, made separate assessments for each training year, and compared the results of ChatGPT with the results of residents who passed the same exam.
- Conditions
- Artificial Intelligence (AI), Resident Education
- Being tested
- resident exam
- Keywords
- Artificial Intelligence, ChatGPT, Educational Technology, Physical and Rehabilitation Medicine, Rehabilitation
What participants receive
What participants receive. In a randomised study each person is assigned to one group by chance.
resident examOther
Resident exam in May 2024.
| Study group | Role | What they receive |
|---|---|---|
| Physical medicine and rehabilitation residents | The residents enrolled in the PMR specialization training program held throughout Turkey in May 2024 Receives: Other: resident exam | |
| ChatGPT | A new user was created for the free version of the ChatGPT-4o application, and a series of questions belonging to four distinct education levels were posed to it, one by one. For each question, ChatGPT was instructed to select only one option out of five. Receives: Other: resident exam |
What is being measured
The primary outcome is the main question the study is designed to answer.
The comparison of resident exam results and ChatGPT answers to the same questions
In May 2024, the exam results of residents in training and research hospitals affiliated with the Health Sciences University across Türkiye will be compared with the answers and rankings given by ChatGPT to the same questions. ChatGPT accuracy rate and response time to questions will be determined. The minimum score to be obtained from this exam is 0 and the maximum score is 100.
Measured: through study completion, an average of 10 days
Timeline
From the start of the study to its completion; the mark is today. Estimated dates are the sponsor’s plan.
- First posted15 Jan 2025
- Study start1 Jan 2025
- Primary completion10 Jan 2025
- Study completion10 Jan 2025
Resources
- Official record on ClinicalTrials.govThe registry entry this page is built from, with its full change history.
- Publications (1)Papers the sponsor has linked to this study.
- Other trials for Artificial Intelligence (AI)Studies of the same condition, open and under way.
- What the trial phases meanHow a treatment moves from first tests in people to approval.
More details
For doctors and researchers: how the study is designed, who runs it, and its registry IDs.
Study design
- Study type
- Observational
- Observational model
- Other
- Time perspective
- Cross-sectional
- Enrolment
- 314 participants (actual)
Sponsor and investigators
- Lead sponsor
- Sisli Hamidiye Etfal Training and Research Hospital
- Sponsor type
- University, hospital or other
- Responsible party
- Principal investigator, Selda Çiftci, Sisli Hamidiye Etfal Training and Research Hospital
IDs, dates and publications
- ClinicalTrials.gov ID
- NCT06775938
- Sponsor's protocol ID
- 31.12.2024-2873
- Status last verified
- Jan 2025
- First submitted
- 2 Jan 2025
- Last updated
- 15 Jan 2025
- Results posted
- No
- Data monitoring committee
- No
- FDA-regulated drug
- No
- FDA-regulated device
- No
- Individual data sharing
- Undecided
Publications
Ayyildiz A, Inceoglu SC, Kuran B, Ones K. Artificial intelligence versus physical medicine and rehabilitation residents: Can ChatGPT compete in clinical exam performance? PM R. 2026 Jan;18(1):52-59. doi: 10.1002/pmrj.70032. Epub 2025 Oct 3.
PubMed 41041823
Study at a glance
From the registry record, last updated by the sponsor on 15 Jan 2025. Recruitment status is as the sponsor reported it: confirm with the study team.
- Official title
- Can Artificial Intelligence Take Place of Physical Medicine and Rehabilitation Physicians?: ChatGPT Versus Physical Medicine and Rehabilitation Residents
- ClinicalTrials.gov ID
- NCT06775938
- Acronym / sponsor ID
- 31.12.2024-2873
- Conditions
- Artificial Intelligence (AI), Resident Education
- Keywords
- Artificial Intelligence, ChatGPT, Educational Technology, Physical and Rehabilitation Medicine, Rehabilitation
- Study type
- Observational
- Recruitment status
- Completed
- Enrolment
- 314 participants (actual)
- Lead sponsor
- Sisli Hamidiye Etfal Training and Research HospitalUniversity, hospital or other
- Study start
- 1 Jan 2025 (actual)
- Primary completion
- 10 Jan 2025 (actual)
- Study completion
- 10 Jan 2025 (actual)
- First posted
- 15 Jan 2025 (actual)
- Results
- Not posted in the source record
Clinical summary
The research question as the sponsor registered it. This describes what the study plans to test, not what it found.
The aim of this study was to assess the performance of ChatGPT on examinations administered to physical medicine and rehabilitation (PMR) residents.
Detailed description
These exams for resident physicians are annual exams administered throughout the training period, which constitute a fundamental component of the training process towards becoming a PMR physician. In this study, we evaluated the performance of ChatGPT in these exams, made separate assessments for each training year, and compared the results of ChatGPT with the results of residents who passed the same exam.
Study design
- Observational model
- Other
- Time perspective
- Cross-sectional
- Number of arms
- 2
| Arm | Type | Receives |
|---|---|---|
| Physical medicine and rehabilitation residents | – | Other: resident examThe residents enrolled in the PMR specialization training program held throughout Turkey in May 2024 |
| ChatGPT | – | Other: resident examA new user was created for the free version of the ChatGPT-4o application, and a series of questions belonging to four distinct education levels were posed to it, one by one. For each question, ChatGPT was instructed to select only one option out of five. |
Who may qualify
- Sex
- All
- Healthy volunteers
- Not accepted
- Age groups
- Child, Adult, Older adult
- Study population
- The study used exam questions taken by the majority of residents enrolled in the PMR specialization training program held throughout Turkey in May 2024. These exam questions were selected from a pool of questions developed by lecturers affiliated with the PMR departments of hospitals affiliated with the University of Health Sciences. The exam questions were structured to cover four different difficulty levels.
Key inclusion criteria (1 listed)
- Physical medicine and rehabilitation residents exam results in May 2024
Key exclusion criteria (1 listed)
- -
Eligibility is decided by the study team after screening; this overview does not establish that a patient qualifies. Full inclusion and exclusion criteria.
Interventions
| Intervention | Type | Arms |
|---|---|---|
| resident examResident exam in May 2024. | Other | ChatGPT, Physical medicine and rehabilitation residents |
Primary outcome
The comparison of resident exam results and ChatGPT answers to the same questions
Time frame: through study completion, an average of 10 days
In May 2024, the exam results of residents in training and research hospitals affiliated with the Health Sciences University across Türkiye will be compared with the answers and rankings given by ChatGPT to the same questions. ChatGPT accuracy rate and response time to questions will be determined. The minimum score to be obtained from this exam is 0 and the maximum score is 100.
Results and safety
The study is completed, but results are not available in the source record. That does not mean the treatment did or did not work.
Research links
- Official record on ClinicalTrials.govLast updated by the sponsor 15 Jan 2025.
- Derived from this study: PubMed 41041823Ayyildiz A, Inceoglu SC, Kuran B, Ones K. Artificial intelligence versus physical medicine and rehabilitation residents: Can ChatGPT compete in clinical exam performance? PM R. 2026 Jan;18(1):52-59. doi: 10.1002/pmrj.70032. Epub 2025 Oct 3.
- Individual participant dataSharing planned: Undecided
Related trials for Artificial Intelligence (AI)
RecruitingObservational study
AI-powered ECG Analysis Using Willem™ Software in High-risk Cardiac Patients (WILLEM)
Cardiomyopathies, Cardiac Arrest
Recruiting
Managing Premyopia in Chinese Children Using Artificial Intelligence Assisted Defocus Incorporated Multiple Segments Based Spectacle Lens: a Randomized Controlled Clinical Trial
Pre-myopia, Myopia
Not yet recruitingObservational study
AI-assisted Tracheal Intubation in Children
Intubation
Recruiting
AI-assisted Home-based Intervention for ADHD Children
ADHD - Attention Deficit Disorder With Hyperactivity, ADHD - Combined Type
Not yet recruiting
AI Smart Glasses Feedback for Intubation Training in Medical Students
Intubation, Intratracheal, Medical Education
Referral and contact
AzTrials does not enrol participants or take referrals. Contact the study team or a site listed below; they decide who can take part. This study is not recruiting at the moment.
The record lists no contact. Use the official record to reach the sponsor.
1 site in 1 country: see every site and its status.
Questions about this trial
What is this clinical trial studying?
An observational study of Artificial Intelligence (AI) and Resident Education, run by Sisli Hamidiye Etfal Training and Research Hospital at 1 site in Turkey (Türkiye).
The full registered description is in the About this study section and the official record.
Who may be eligible to take part?
The sponsor lists 1 inclusion and 1 exclusion criteria. Eligibility is decided by the study team after screening, so read the full criteria and contact a listed site.
Is this clinical trial currently recruiting?
The record says: finished, as of the sponsor's last update on 15 Jan 2025. Status can change between updates, so confirm with the study contact before making plans.
Where is the study taking place?
The record lists 1 site in Turkey (Türkiye). Whether a site is taking part right now should be confirmed with that site. See every site.
What are the possible benefits and risks?
They depend on the study and the treatment, and no study can promise a benefit. The study team explains the known risks during informed consent, before anyone joins; the record itself does not list them.
Are results available for this study?
The study is completed, but results are not available in the source record. That does not mean the treatment did or did not work.
How can a doctor refer a patient or contact the research team?
The record lists no contact. The official record names the sponsor, who can be asked directly. AzTrials does not enrol participants or take referrals.
What does the primary outcome measure?
The comparison of resident exam results and ChatGPT answers to the same questions (time frame: through study completion, an average of 10 days). It is what the study was designed to measure, not a finding.
Where can I read the original study information?
On the ClinicalTrials.gov record for NCT06775938, which also lists 1 linked publication.
Does a listing mean the treatment is approved or proven to work?
No. A listing means the study is registered. It does not show that the treatment is safe, works, or is approved by a regulator.
How often is this information updated?
AzTrials copies changed records from ClinicalTrials.gov every night and reloads the whole registry every week. The sponsor last updated this record on 15 Jan 2025.