Voice-Based AI for Suicide Risk Assessment

Overseen By Roisin Slevin, BS

Age: 18+

Sex: Any

Trial Phase: Academic

Sponsor: Lyssn.io, Inc.

Disqualifiers: Stage 2 participants

No Placebo Group All trial participants will receive the active study treatment (no placebo)

Compensation: Varies

Number of Visits: Unknown

50 Participants Needed

What You Need to Know Before You Apply

What is the purpose of this trial?

This trial tests a new AI tool called LyssnCrisis, designed to train crisis call center workers in assessing suicide risk. The goal is to enhance call-takers' skills by providing performance feedback through AI, potentially improving their ability to assist people in crisis. The study will compare traditional methods with the AI tool to determine which is more effective. Employees at Protocall Services, Inc. are eligible to participate, unless they participated in a previous stage of the research. As an unphased trial, this study offers participants the opportunity to contribute to innovative solutions in mental health support.

Will I have to stop taking my current medications?

The trial information does not specify whether you need to stop taking your current medications.

What prior data suggests that this AI-based tool is safe for training call-takers in suicide risk assessment?

Research has shown that the LyssnCrisis tool uses voice-based AI to assess suicide risk during crisis calls. This AI analyzes speech and language patterns to identify potential risk factors. As a software tool, not a drug or medical device, LyssnCrisis poses no physical risk.

Studies have found that the AI enhances how call-takers evaluate suicide risk without directly interacting with callers. Therefore, the tool does not present safety concerns in the traditional sense, as it does not impact the body or health of participants. Instead, it aids call-takers by providing feedback on their assessment skills.

Overall, LyssnCrisis is considered safe for use in training and support, given its purpose and application. ^{1 2 3 4 5}

Why are researchers excited about this trial?

Researchers are excited about LyssnCrisis because it leverages voice-based AI to assess suicide risk, offering a significant advancement over traditional methods. Unlike standard care, which relies heavily on human judgment, this AI tool provides real-time feedback and support to call-takers, potentially increasing the accuracy and consistency of risk assessments. By integrating AI technology, LyssnCrisis can enhance the quality of intervention and support for individuals in crisis, making it a promising development in mental health care.

What evidence suggests that the LyssnCrisis tool is effective for suicide risk assessment?

Research has shown that LyssnCrisis, a voice-based AI tool, can help counselors assess suicide risk during crisis calls. In this trial, some call-takers will use LyssnCrisis, which employs machine learning models to spot signs of suicide risk by examining conversation content. These models have successfully identified risk-related statements in many crisis calls. This suggests that LyssnCrisis could enhance call-takers' ability to recognize and respond to individuals at risk of suicide, thereby making crisis counseling services more effective. Meanwhile, participants in the services-as-usual (SAU) arm will continue with regular supervision and feedback without AI intervention during the initial phase. ^{1 2 4 5 6}

Who Is on the Research Team?

David C Atkins, PhD

Principal Investigator

Lyssn.io, Inc.

Are You a Good Fit for This Trial?

This trial is for call-takers employed at Protocall Services, Inc. It aims to train them in suicide risk assessment skills using a new AI tool called LyssnCrisis, designed to enhance their ability to help callers with self-harm or suicidal tendencies.

Inclusion Criteria

I work at Protocall Services, Inc.

Timeline for a Trial Participant

Screening

Participants are screened for eligibility to participate in the trial

2-4 weeks

Baseline

Call-takers undergo a 4-week baseline period of services-as-usual (SAU) where LyssnCrisis operates in the background without providing feedback.

4 weeks

Intervention

Call-takers are randomly assigned to either continue SAU or begin receiving feedback with LyssnCrisis for 12 weeks.

12 weeks

Follow-up

Participants are monitored for the acceptability, appropriateness, and feasibility of the intervention, as well as call-taker crisis counseling fidelity.

4 weeks

What Are the Treatments Tested in This Trial?

Interventions

• LyssnCrisis

Trial Overview The study tests 'LyssnCrisis', an AI-based feedback tool for crisis counselors. The goal is to see if it can improve training and the quality of support provided by call-takers dealing with clients at risk of suicide or self-harm.

How Is the Trial Designed?

Group I: Lyssn Crisis Experimental Treatment 1 Intervention

To compare LyssnCrisis to SAU, researchers will use a standard randomized design in which call-takers will have services-as-usual (SAU) and LyssnCrisis phases. All call-takers will start with a 4-week baseline period of SAU where LyssnCrisis is operating in the background, but does not provide AI feedback on suicide risk assessment. Lyssn team members will on-board and train the participating call-takers on the Lyssn software (i.e., reviewing calls, sharing and accessing calls for supervision), using a similar method used in the pilot field trial. After a 4-week baseline phase, call-takers will be randomly assigned to continue SAU or begin feedback with LyssnCrisis (LC) for 12 weeks. LC arm participants will have access to LyssnCrisis feedback tools for the duration of the 12 week period and will receive onboarding support for LyssnCrisis fidelity feedback tools.

Group II: Services As Usual Active Control 1 Intervention

To compare LyssnCrisis to SAU, researchers will use a standard randomized design in which call-takers will have services-as-usual (SAU) and LyssnCrisis phases. All call-takers will start with a 4-week baseline period of SAU where LyssnCrisis is operating in the background, but does not provide AI feedback on suicide risk assessment. Lyssn team members will on-board and train the participating call-takers on the Lyssn software (i.e., reviewing calls, sharing and accessing calls for supervision), using a similar method used in the pilot field trial. After a 4-week baseline phase, call-takers will be randomly assigned to continue SAU or begin feedback with LyssnCrisis (LC) for 12 weeks. Participants in the SAU arm will continue services-as-usual for an additional 12-week period,where participants receive ProtoCall's regular supervision and feedback. Following this period (16 total weeks of SAU), SAU arm participants will receive LyssnCrisis for 12 weeks.

Who Is Running the Clinical Trial?

Lyssn.io, Inc.

Lead Sponsor

Trials

4

Recruited

2,500+

ProtoCall Services, Inc.

Collaborator

Trials

1

Recruited

50+

Published Research Related to This Trial

A systematic review of 87 studies using artificial intelligence and machine learning found that these technologies can achieve over 90% accuracy in predicting suicidal behaviors, indicating their potential for improving risk detection.

Despite the promising accuracy, the studies varied widely in methodology and outcomes, highlighting the need for standardized approaches in future research to effectively utilize AI/ML in suicide prevention.

NCBI (Pubmed)

pubmed.ncbi.nlm.nih.gov

Artificial Intelligence and Suicide Prevention: A Systematic Review of Machine Learning Investigations. Bernert, RA., Hilberg, AM., Melia, R., et al.[2023]

The development of AI-based suicide risk screening tools is crucial for identifying individuals at high risk of suicide, but many existing systems do not incorporate established suicide theories, which could enhance their effectiveness.

A proposed approach includes creating a standardized dataset for speech and language assessments to improve the accuracy of AI systems in detecting suicide risk, distinguishing between factors leading to suicidal thoughts versus actual attempts.

NCBI (Pubmed)

pubmed.ncbi.nlm.nih.gov

Suicide risk detection using artificial intelligence: the promise of creating a benchmark dataset for research on the detection of suicide risk. Parsapoor Mah Parsa, M., Koudys, JW., Ruocco, AC.[2023]

A clinical trial involving 60 adolescents (30 suicidal and 30 nonsuicidal) demonstrated that machine learning can effectively differentiate between the conversations of suicidal and nonsuicidal individuals.

This technology could potentially improve the consistency of care provided by mental health professionals by offering objective insights into adolescents' emotional states, which may lead to better treatment outcomes.

NCBI (Pubmed)

pubmed.ncbi.nlm.nih.gov

A Controlled Trial Using Natural Language Processing to Examine the Language of Suicidal Adolescents in the Emergency Department. Pestian, JP., Grupp-Phelan, J., Bretonnel Cohen, K., et al.[2018]

The study developed machine learning models using Danish registry data from 1995 to 2018 to predict non-fatal suicide attempts and suicides after psychiatric discharge, achieving a high predictive accuracy for attempts (ROC-AUC of 0.85) and moderate accuracy for suicides (ROC-AUC of 0.71).

The results highlight the importance of treating suicide and non-fatal suicide attempts as separate outcomes, as the predictors for each differed, and the ensemble models showed fair performance across different sexes and ages, suggesting they could be more reliable for clinical use than simpler models.

NCBI (Pubmed)

pubmed.ncbi.nlm.nih.gov

Prediction models of suicide and non-fatal suicide attempt after discharge from a psychiatric inpatient stay: A machine learning approach on nationwide Danish registers. Nielsen, SD., Christensen, RHB., Madsen, T., et al.[2023]

The computer-automated version of the Columbia-Suicide Severity Rating Scale (eC-SSRS) demonstrated comparable or superior reliability to traditional assessments in measuring suicidal ideation and behaviors among 20 participants, indicating its potential effectiveness for monitoring suicidality.

Participant feedback was generally positive regarding the eC-SSRS, supporting its feasibility for use in clinical settings, although further research with larger and more diverse samples is necessary to confirm these findings.

NCBI (Pubmed)

pubmed.ncbi.nlm.nih.gov

Feasibility and validation of a computer-automated Columbia-Suicide Severity Rating Scale using interactive voice response technology. Mundt, JC., Greist, JH., Gelenberg, AJ., et al.[2013]

A study involving 379 participants used machine learning to analyze both verbal and nonverbal markers of suicidal thoughts, achieving up to 85% accuracy in classifying individuals into suicidal, mentally ill but not suicidal, or control groups.

This research highlights the potential of advanced technology in improving suicide assessment and prevention strategies by integrating linguistic and vocal characteristics.

NCBI (Pubmed)

pubmed.ncbi.nlm.nih.gov

A Machine Learning Approach to Identifying the Thought Markers of Suicidal Subjects: A Prospective Multicenter Trial. Pestian, JP., Sorter, M., Connolly, B., et al.[2022]

An online monitoring tool for tracking depressive symptoms, suicidality, and side effects was developed and found to be user-friendly by young participants, who completed it multiple times.

Both clients and clinicians reported the tool as useful, although clinicians suggested it could be shortened for better integration into clinical practice, indicating a need for further research on its implementation.

NCBI (Pubmed)

pubmed.ncbi.nlm.nih.gov

Development and pilot testing of an online monitoring tool of depression symptoms and side effects for young people being treated for depression. Hetrick, SE., Dellosa, MK., Simmons, MB., et al.[2015]

Machine learning models for predicting suicide-related outcomes (ideation, attempts, and deaths) showed a strong overall performance with a pooled AUC of 0.86, indicating they are more effective than traditional prediction methods.

The models demonstrated good sensitivity (66%) and specificity (87%), suggesting that while they can accurately identify individuals at risk, there is still room for improvement, particularly in reducing bias in future studies.

NCBI (Pubmed)

pubmed.ncbi.nlm.nih.gov

The performance of machine learning models in predicting suicidal ideation, attempts, and deaths: A meta-analysis and systematic review. Kusuma, K., Larsen, M., Quiroz, JC., et al.[2022]

The study evaluated the effectiveness of combining the Columbia Suicide Severity Rating Scale (C-SSRS) with a machine learning model (VSAIL) to predict suicide attempts (SA) and suicidal ideation (SI) in a cohort of 120,398 patient visits, showing that the combined model significantly outperformed both individual assessments in predicting risk.

The ensemble model achieved higher accuracy metrics, with an area under the receiver operating curve (AUROC) of 0.874-0.887 for SA and 0.869-0.879 for SI, indicating that integrating clinician assessments with machine learning can enhance suicide risk detection and improve patient outcomes.

NCBI (Pubmed)

pubmed.ncbi.nlm.nih.gov

Integration of Face-to-Face Screening With Real-time Machine Learning to Predict Risk of Suicide Among Adults. Wilimitis, D., Turer, RW., Ripperger, M., et al.[2022]

This study analyzed 281 telephone calls to telehealth services to classify suicide risk using artificial intelligence, achieving a remarkable accuracy of 99.85% in identifying imminent risk versus low risk based on voice biomarkers.

The research identified 11 key voice biomarkers that effectively differentiate between low and imminent suicide risk, with models tailored for men and women, highlighting the potential for real-time risk assessment in mental health services.

NCBI (Pubmed)

pubmed.ncbi.nlm.nih.gov

Using Voice Biomarkers to Classify Suicide Risk in Adult Telehealth Callers: Retrospective Observational Study. Iyer, R., Nedeljkovic, M., Meyer, D.[2022]

Citations

1. pmc.ncbi.nlm.nih.gov pmc.ncbi.nlm.nih.gov/articles/PMC11530329/

Machine Learning based evaluation of Suicide Risk ... Of 97,028 caller statements, 2,315 (2.4%) were rated as about suicide risk. Of those 2,315 statements, 1,139 (49%) specifically mentioned ...

2. clinicaltrials.gov clinicaltrials.gov/study/NCT06299384

The Use of Voice-Based AI in 988 Crisis Counseling LyssnCrisis is an AI-based coding and feedback tool for implementation in crisis counseling settings, training counselors (call-takers) in suicide risk ...

3. withpower.com withpower.com/trial/phase-suicide-and-self-harm-3-2024-82793

Voice-Based AI for Suicide Risk Assessment This research study focuses on developing an AI-based, coding and feedback tool ("LyssnCrisis") for implementation in a nationally utilized crisis call center.

4. pmc.ncbi.nlm.nih.gov pmc.ncbi.nlm.nih.gov/articles/PMC10076638/

A machine learning approach to identifying suicide risk ... NLP-based models can detect the suicide risk of text-based crisis encounters from the encounter's content.

5. lyssn.io lyssn.io/the-science/academic-papers/

Lyssn Academic papers Machine Learning-Based Evaluation of Suicide Risk Assessment in Crisis Counseling Calls Zac E Imel1, Brian Pace1, Brad Pendergraft1, Jordan Pruett1, Michael ...

6. lyssn.io lyssn.io/using-natural-language-processing-to-detect-suicide-risk/

Using Natural Language Processing to detect suicide risk We sat down with Zac Imel, Lyssn's Chief Science Officer, to discuss the use of AI in suicide prevention.