ChatGPT for Educational Activities in Health Sciences Students

(AIHSS Trial)

Overseen By Dahlia Kairy, PhD

Age: 18+

Sex: Any

Trial Phase: Academic

Sponsor: Carleton University

Disqualifiers: Unable to provide informed consent

No Placebo Group All trial participants will receive the active study treatment (no placebo)

Compensation: Varies

Number of Visits: 2

What You Need to Know Before You Apply

What is the purpose of this trial?

This trial aims to compare traditional online learning tools with ChatGPT to determine which is more helpful for completing assignments. Participants will use either ChatGPT or regular online resources to finish their work and then provide feedback on their experience. The goal is to understand how effectively ChatGPT assists students in learning. Health science students enrolled in the Chronic Health Conditions and Disability course are well-suited for this trial. As an unphased study, this trial offers students a unique opportunity to explore innovative learning tools and contribute to educational advancements.

Do I need to stop my current medications to join the trial?

The trial protocol does not specify whether you need to stop taking your current medications.

What prior data suggests that ChatGPT is safe for educational activities in health sciences students?

Research has shown that ChatGPT, the tool tested in this trial, is generally well-received in educational settings. In one study, 92% of participants found AI tools like ChatGPT helpful for learning, indicating that most users have positive experiences. However, another study suggested caution when using ChatGPT for safety-related information, as experts should verify it.

ChatGPT is an AI-based chat tool, not a drug or medical device, so it doesn't share the same safety concerns. Its safety involves ensuring the accuracy and reliability of the information it provides. Overall, evidence suggests that ChatGPT is well-accepted as a learning tool, but users should remain aware of its limitations. ^{1 2 3 4 5}

Why are researchers excited about this trial?

Researchers are excited about this trial because it explores how artificial intelligence, specifically ChatGPT, can be used as a tool for health sciences students. Unlike traditional online tools, which offer static information, ChatGPT provides dynamic, interactive assistance, potentially enhancing learning by simulating a conversational partner. This trial aims to uncover insights into how AI can transform educational experiences by making learning more engaging and personalized. By comparing AI with conventional methods, researchers hope to better understand AI's role in improving educational outcomes in the health sciences.

What evidence suggests that using ChatGPT is effective for educational activities in health sciences students?

Research has shown that ChatGPT can enhance student learning. In this trial, participants in the Artificial Intelligence (ChatGPT) Group will use ChatGPT to complete assignments. Studies have found that ChatGPT increases student engagement and interest in learning. It also improves grades and thinking skills while making learning feel easier. Additionally, health sciences students have reported positive feedback about ChatGPT, noting its ease of use and effectiveness in their studies. These findings suggest that ChatGPT could be a valuable tool for students to complete assignments and enhance their learning experience. ^{2 6 7 8 9}

Who Is on the Research Team?

Mirella Veras, PhD

Principal Investigator

Carleton University

Are You a Good Fit for This Trial?

This trial is for health science students enrolled in the HLTH 3503 course, focusing on Chronic Health Conditions and Disability for Fall 2023. Participants must be able to give informed consent. Those who cannot provide this consent are excluded.

Inclusion Criteria

Health Science students

Must be registered for the course Chronic Health Conditions and Disability (HLTH 3503), Fall 2023.

Exclusion Criteria

Unable to provide informed consent

Timeline for a Trial Participant

Screening

Participants are screened for eligibility to participate in the trial

1-2 weeks

Intervention Phase 1

Participants in Group A use ChatGPT for assignments, while Group B uses traditional online tools

6 days

1 visit (virtual)

Wash-out Period

A wash-out period to minimize carryover effects before crossover

1 week

Intervention Phase 2

Participants switch interventions: Group A uses traditional tools, Group B uses ChatGPT

6 days

1 visit (virtual)

Follow-up

Participants complete post-intervention questionnaires to assess usability and perceptions

1 week

What Are the Treatments Tested in This Trial?

Interventions

• ChatGPT

Trial Overview The study is testing the effectiveness of ChatGPT as an educational tool against usual online resources. It's a crossover randomized control trial where students are randomly placed into two groups: one using ChatGPT and another with standard materials.

How Is the Trial Designed?

Group I: Artificial Intelligence (ChatGPT) Group Experimental Treatment 1 Intervention

Participants in Group A will be assigned to utilize ChatGPT as their tool to complete assignments. They will be given a period of six days to utilize artificial intelligence through ChatGPT for assignment completion. Along with the assignment instructions, participants will receive an ethical guideline and specific guidelines on how to effectively utilize ChatGPT. Once the intervention period is concluded, participants will be given a 24-hour window to complete a survey that assesses the usability of the technology. The survey aims to gather valuable feedback on the participants' experience and perception of using ChatGPT for their assignments. In addition, participants in Arm 1 will also be asked to fill out a survey regarding their perception of using artificial intelligence (AI) as an assistance tool to complete their assignments. This survey aims to gather insights into their thoughts, opinions, and attitudes towards utilizing AI in the learning process

Group II: Traditional Online tools Group Active Control 1 Intervention

Group B will serve as the control group in this study. Participants in this group will receive instructions on how to complete the assignment using traditional online tools available on the internet, without the use of artificial intelligence. They will have a timeframe of six days to complete the assignment using these conventional tools. Similar to participants in Arm 1, they will also be required to fill out a survey on technology usability, providing feedback on their experience with the online tools.

Who Is Running the Clinical Trial?

Carleton University

Lead Sponsor

Trials

3

Recruited

170+

Université de Montréal

Collaborator

Trials

223

Recruited

104,000+

Published Research Related to This Trial

ChatGPT provided correct answers to 71.9% of questions about obstructive sleep apnea, indicating it can be a useful tool for patient education, regardless of the type of prompting used.

Prompting for statistics and references significantly improved the quality of responses, with 96.1% of those answers including references, while patient-friendly prompts resulted in simpler language suitable for patients, maintaining an acceptable grade level for medical information.

NCBI (Pubmed)

pubmed.ncbi.nlm.nih.gov

Evaluating ChatGPT responses on obstructive sleep apnea for patient education. Campbell, DJ., Estephan, LE., Mastrolonardo, EV., et al.[2023]

Citations

1. nature.com nature.com/articles/s41599-025-04787-y

The effect of ChatGPT on students' learning performance, ... Their results indicate that ChatGPT can effectively enhance students' behavioral, cognitive, and emotional engagement in learning activities.

2. sciencedirect.com sciencedirect.com/science/article/pii/S0360131524002380

Does ChatGPT enhance student learning? A systematic ... Overall, ChatGPT improves academic performance, affective-motivational states, and higher-order thinking propensities; it reduces mental effort and has no ...

3. pmc.ncbi.nlm.nih.gov pmc.ncbi.nlm.nih.gov/articles/PMC11748239/

Health profession students' perceptions of ChatGPT in ... Among the surveyed students, 86.2% were familiar with ChatGPT, with generally positive perceptions as reflected by a mean score of 4.04 (SD = ...

4. researchprotocols.org researchprotocols.org/2023/1/e51873/

Usability and Efficacy of Artificial Intelligence Chatbots ... This study aims to provide details on the study protocol and the methods used to investigate the usability and efficacy of ChatGPT, a large language model.

5. cureus.com cureus.com/articles/401183-exploring-the-challenges-and-opportunities-of-chatgpt-in-university-teaching-for-health-sciences-a-narrative-review

Exploring the Challenges and Opportunities of ChatGPT in ... This study assessed ChatGPT-3.5's usability and perceived effectiveness among health sciences students through a mixed-methods crossover RCT. ...

6. pmc.ncbi.nlm.nih.gov pmc.ncbi.nlm.nih.gov/articles/PMC10709780/

Usability and Efficacy of Artificial Intelligence Chatbots ... This study aims to provide details on the study protocol and the methods used to investigate the usability and efficacy of ChatGPT, a large language model.

7. pmc.ncbi.nlm.nih.gov pmc.ncbi.nlm.nih.gov/articles/PMC10048148/

ChatGPT Utility in Healthcare Education, Research, and ... ChatGPT is an artificial intelligence (AI)-based conversational large language model (LLM). The potential applications of LLMs in health care education, ...

8. sciencedirect.com sciencedirect.com/science/article/pii/S0925753523001868

The risks of using ChatGPT to obtain common safety- ... The study highlights the need for caution when using ChatGPT for safety-related information and expert verification, as well as the need for ethical ...

9. actascientific.com actascientific.com/ASAG/pdf/ASAG-09-1467.pdf

Role of ChatGPT in Enhancing Safety Science Higher ... Ninety-two percent (92%) felt that AI tools were practical and useful in student learning in OSH/IH, p-value <0.001. When asked if the tools ...