Behavioral EconomicsNCT05121675
Investigating How Incentives Impact Engagement With an Online Mental Health Application (Neuroflow)
A study testing Neuroflow app: Mental health and wellbeing resources for adults in people with Behavioral Economics and Gifts, Financial, run by University of Pennsylvania at 1 site in United States.
Trial summary
The purpose of the study is to understand how incentives (either points alone or points that can be exchanged for gift certificates) encourage engagement with an online mental health app (Neuroflow) for University students. Read more about this study
- Who is it for?
- Ages 18 years and olderHealthy volunteers can take part
- Conditions the study is for
- Behavioral Economics, Gifts, Financial, Point
- What is being tested?
- Neuroflow app: Mental health and wellbeing resources for adults
- Type of treatment
- Lifestyle or therapy programme
- Could I receive a placebo?
- No, everyone receives an active treatment
- How many people
- 107 participants
- Where
- 1 siteUnited States
- Study dates
- 15 Nov 2021to 15 May 2022
- Phase
- Interventional
- Are there results?
- Yes, posted in the registrySummary in the doctors' view
Key requirements
Who can take part, as listed by the sponsor. Only the study team can confirm whether you are eligible, so take this list to your doctor.
- Ages 18 years and older
- All sexes
- Healthy volunteers accepted
- Adult, Older adult
Who may be able to join
- The target population for this study are college students either at the University of Pennsylvania or other US universities. Participants will be included if they have a smartphone and are willing to download and use the Neuroflow app throughout the duration of the study
Who cannot join
- Does not own a smartphone capable of downloading the NeuroFlow application or is unwilling to download and use the Neuroflow app throughout the duration of the study.
Trial locations and contacts
1 site in 1 country.
United States1 site
University of Pennsylvania
Philadelphia, Pennsylvania, 19104
About this study
The purpose of the study is to understand how incentives (either points alone or points that can be exchanged for gift certificates) encourage engagement with an online mental health app (Neuroflow) for University students. Overall, the hope of this study is to help the investigators understand how best to support mental health and wellness in university students.
Read the detailed description
As mental health awareness and intervention has gained more traction throughout the years, applications - such as NeuroFlow - have emerged in an effort to facilitate aid to those who are unable to afford or access alternative mental health care methods. However, over 95% of mental health and wellness applications have not actually been studied. Additionally, a large portion examines user adoption of various mental health applications based on different factors, leaving a gap in research regarding client engagement and interest post-installation. Thus, despite promises, applications for promoting mental health often do not achieve their intended goals due to lack of sufficient client engagement/interest. In order to address this discrepancy, the use of financial incentives and other incentives from the field of behavioral economics may help. As an application, NeuroFlow embeds behavioral economic principles to increase motivation and engagement with the application (such as personalized pop-up notification reminders and app gamification including points accrual for activity completion and celebratory messages for meeting points thresholds) and also provides financial incentives whereby points accrued can be redeemed into gift cards for popular outlets such as Amazon. However, it is not clear if this financial incentive increases engagement or has knock-on effects for mental health and wellbeing over and above the behavioral economics incentives per se. In this study, the investigators will conduct a pilot two-arm randomized controlled trial where the investigators will examine the effect of a treatment group (NeuroFlow app with behavioral economics and financial incentives vs. NeuroFlow app with behavioral economics incentives only) on application engagement and mental health and wellbeing (anxiety and depression symptoms, sleep, self-regulation and wellbeing). The purpose of this study is to gain an understanding of how incentives encourage participation and engagement with an online mental health platform, NeuroFlow.
This study is a two-arm pilot randomized controlled trial to assess differences in user retention and usage rates associated with two incentive structures within the NeuroFlow app (I.e., general structure versus financial compensation). The investigators will assess user engagement with utilization data (ie., daily, weekly, and monthly active users) and measures of the total number of activity counts completed by a user. After consenting to participate in the study, participants will be randomly assigned to use Neuroflow either with points only or with points and the opportunity to exchange those points for gift cards. In both conditions, participants will begin by completing a consent form and a brief questionnaire with their contact information, which will be used to grant them access to the Neuroflow platform.
In both recruitment methods, participants will be required to sign up for a 15 minute check in and check out meeting before and after the trial to answer participant questions regarding the app/app set up or concerns about the consent form. Furthermore, a Qualtrics survey will also be dispersed to participants to be taken during this time along with an initial baseline assessment (to be administered in the NeuroFlow app).
Baseline and post-app usage Qualtrics survey links will also be sent with measures (Generalized anxiety disorder (GAD), Patient Health Questionnaire (PHQ), World Health Organization- Five Well-Being Index (WHO-5), and Difficulties in Emotion Regulation Scale (DERS)) to participants in order to assess differences in user retention.
In both conditions, participants will use the Neuroflow app throughout the duration of the 4-week study (28 days). Participants will be sent a push notification each day through the app to complete their daily activities, which could include surveys, videos, or skill-based practice materials.
With the collaboration of the Neuroflow team, the usage metrics of the app will be pulled after the end of the study. The user metrics of interest are identifying factors that include first name, last name, gender, age, date of birth, and the applicable assignments to each participant - care team manager and behavioral health specialist. Additionally, the first and last score, first and last date, and time between the first and last assessment dates for the measures of interest (PHQ-9, GAD-7, WHO-5, DERS). Furthermore, the total activity number and the total activity rate across all measures will be collected. No additional data from or about participant phone usage or activities will be pulled as part of the study other than the usage metrics specified above, specific to Neuroflow.
- Conditions
- Behavioral Economics, Gifts, Financial, Point
- Being tested
- Neuroflow app: Mental health and wellbeing resources for adults
- Medical subject headings
- Gift Giving
What participants receive
What participants receive. In a randomised study each person is assigned to one group by chance.
Neuroflow app: Mental health and wellbeing resources for adultsBehavioural
The NeuroFlow app delivers resources on resilience training, mindfulness-based strategies and cognitive behavioral therapy to adults looking to support their mental health and wellbeing. The specific "journey" (i.e., content such as activities, videos, trackers, and journaling) is tailored to individuals based on depression and anxiety screeners administered upon signing up to the app.
| Study group | Role | What they receive |
|---|---|---|
| App with behavioral economics + financial incentives | Experimental | NeuroFlow uses behavioral economics reminders, gamification, and fun, motivating messages to encourage use. It also includes financial incentives so users can earn redeemable points accrued for activity completion for gift cards at popular outlets (e.g., 1000 points which is the maximum per month = $10 gift card). Receives: Behavioral: Neuroflow app: Mental health and wellbeing resources for adults |
| App with behavioral economics incentives only | Active comparator | NeuroFlow uses behavioral economics reminders, gamification, and fun, motivating messages to encourage use. including points accrued for activity completion. This version of the app does not have financial incentives. Receives: Behavioral: Neuroflow app: Mental health and wellbeing resources for adults |
What is being measured
The primary outcome is the main question the study is designed to answer.
Engagement (Percentage of Daily check-in Activities)
User engagement will be measured as the percentage of daily check-in activities (number completed out of the total number of activities assigned)
Measured: Throughout 28-day trial (averaged)
Secondary outcomes (4)
Generalized Anxiety Disorder (GAD-7)
Change from pre-trial to post-trial score in anxiety. Scores range from 0 to 21. Higher scores = higher symptoms of anxiety.
Measured: Baseline and post-trial, up to 28 days
Patient Health Questionnaire (PHQ-8)
Change from pre-trial to post-trial score in depression. Scores range from 0-24. Higher scores = higher symptoms of depression.
Measured: Baseline and post-trial, up to 28 days
World Health Organization (WHO-5)
Change from pre-trial to post-trial score in wellbeing. Scores range from 0-100 (raw score is multiplied by 4). Higher scores = higher wellbeing.
Measured: Baseline and post-trial, up to 28 days
Difficulties Emotion Regulation Scale (DERS)
Change from pre-trial to post-trial score in emotion regulation difficulties. Scores range from 36-180. Higher scores = greater problems with emotion regulation.
Measured: Baseline and post-trial, up to 28 days
Timeline
From the start of the study to its completion; the mark is today. Estimated dates are the sponsor’s plan.
- First posted16 Nov 2021
- Study start15 Nov 2021
- Primary completion15 Apr 2022
- Study completion15 May 2022
Resources
- Official record on ClinicalTrials.govThe registry entry this page is built from, with its full change history.
- Posted resultsParticipant flow, outcome measures and adverse events reported by the sponsor.
- Publications (3)Papers the sponsor has linked to this study.
- Other trials for Behavioral EconomicsStudies of the same condition, open and under way.
- More trials run by University of PennsylvaniaThe sponsor's other registered studies.
- What the trial phases meanHow a treatment moves from first tests in people to approval.
More details
For doctors and researchers: how the study is designed, who runs it, and its registry IDs.
Study design
- Study type
- Interventional
- Phase
- Phase N/A
- Primary purpose
- Supportive care
- Allocation
- Randomised
- Intervention model
- Parallel groups
- Model description
- Participants will be randomized to one of the two arms. The participants getting the app with behavioral economics incentives only will be enrolled at the same time as the participants getting the app with behavioral economics + financial incentives.
- Masking
- Single blind
- Who is masked
- Participant
- Enrolment
- 107 participants (actual)
Sponsor and investigators
- Lead sponsor
- University of Pennsylvania
- Sponsor type
- University, hospital or other
- Collaborators
- NeuroFlow
- Responsible party
- Sponsor
- Investigators
- Heather Nuske, Principal investigator, Penn Medicine
IDs, dates and publications
- ClinicalTrials.gov ID
- NCT05121675
- Sponsor's protocol ID
- 849894
- Status last verified
- Aug 2024
- First submitted
- 2 Nov 2021
- Last updated
- 12 Aug 2024
- Results posted
- Yes, on ClinicalTrials.gov
- Data monitoring committee
- No
- FDA-regulated drug
- No
- FDA-regulated device
- No
- Individual data sharing
- No
Publications
Huang HY, Bashir M. Users' Adoption of Mental Health Apps: Examining the Impact of Information Cues. JMIR Mhealth Uhealth. 2017 Jun 28;5(6):e83. doi: 10.2196/mhealth.6827.
PubMed 28659256Huckvale K, Nicholas J, Torous J, Larsen ME. Smartphone apps for the treatment of mental health conditions: status and considerations. Curr Opin Psychol. 2020 Dec;36:65-70. doi: 10.1016/j.copsyc.2020.04.008. Epub 2020 May 4.
PubMed 32553848Lecomte T, Potvin S, Corbiere M, Guay S, Samson C, Cloutier B, Francoeur A, Pennou A, Khazaal Y. Mobile Apps for Mental Health Issues: Meta-Review of Meta-Analyses. JMIR Mhealth Uhealth. 2020 May 29;8(5):e17458. doi: 10.2196/17458.
PubMed 32348289
Study at a glance
From the registry record, last updated by the sponsor on 12 Aug 2024. Recruitment status is as the sponsor reported it: confirm with the study team.
- Official title
- Investigating How Incentives Impact Engagement With an Online Mental Health Application (Neuroflow)
- ClinicalTrials.gov ID
- NCT05121675
- Acronym / sponsor ID
- 849894
- Conditions
- Behavioral Economics, Gifts, Financial, Point
- Study type
- Interventional
- Recruitment status
- Completed
- Enrolment
- 107 participants (actual)
- Lead sponsor
- University of PennsylvaniaUniversity, hospital or other
- Collaborators
- NeuroFlow
- Study start
- 15 Nov 2021 (actual)
- Primary completion
- 15 Apr 2022 (actual)
- Study completion
- 15 May 2022 (actual)
- First posted
- 16 Nov 2021 (actual)
- Results
- Posted 12 Aug 2024
Clinical summary
The research question as the sponsor registered it. This describes what the study plans to test, not what it found.
The purpose of the study is to understand how incentives (either points alone or points that can be exchanged for gift certificates) encourage engagement with an online mental health app (Neuroflow) for University students. Overall, the hope of this study is to help the investigators understand how best to support mental health and wellness in university students.
Detailed description
As mental health awareness and intervention has gained more traction throughout the years, applications - such as NeuroFlow - have emerged in an effort to facilitate aid to those who are unable to afford or access alternative mental health care methods. However, over 95% of mental health and wellness applications have not actually been studied. Additionally, a large portion examines user adoption of various mental health applications based on different factors, leaving a gap in research regarding client engagement and interest post-installation. Thus, despite promises, applications for promoting mental health often do not achieve their intended goals due to lack of sufficient client engagement/interest. In order to address this discrepancy, the use of financial incentives and other incentives from the field of behavioral economics may help. As an application, NeuroFlow embeds behavioral economic principles to increase motivation and engagement with the application (such as personalized pop-up notification reminders and app gamification including points accrual for activity completion and celebratory messages for meeting points thresholds) and also provides financial incentives whereby points accrued can be redeemed into gift cards for popular outlets such as Amazon. However, it is not clear if this financial incentive increases engagement or has knock-on effects for mental health and wellbeing over and above the behavioral economics incentives per se. In this study, the investigators will conduct a pilot two-arm randomized controlled trial where the investigators will examine the effect of a treatment group (NeuroFlow app with behavioral economics and financial incentives vs. NeuroFlow app with behavioral economics incentives only) on application engagement and mental health and wellbeing (anxiety and depression symptoms, sleep, self-regulation and wellbeing). The purpose of this study is to gain an understanding of how incentives encourage participation and engagement with an online mental health platform, NeuroFlow.
This study is a two-arm pilot randomized controlled trial to assess differences in user retention and usage rates associated with two incentive structures within the NeuroFlow app (I.e., general structure versus financial compensation). The investigators will assess user engagement with utilization data (ie., daily, weekly, and monthly active users) and measures of the total number of activity counts completed by a user. After consenting to participate in the study, participants will be randomly assigned to use Neuroflow either with points only or with points and the opportunity to exchange those points for gift cards. In both conditions, participants will begin by completing a consent form and a brief questionnaire with their contact information, which will be used to grant them access to the Neuroflow platform.
In both recruitment methods, participants will be required to sign up for a 15 minute check in and check out meeting before and after the trial to answer participant questions regarding the app/app set up or concerns about the consent form. Furthermore, a Qualtrics survey will also be dispersed to participants to be taken during this time along with an initial baseline assessment (to be administered in the NeuroFlow app).
Baseline and post-app usage Qualtrics survey links will also be sent with measures (Generalized anxiety disorder (GAD), Patient Health Questionnaire (PHQ), World Health Organization- Five Well-Being Index (WHO-5), and Difficulties in Emotion Regulation Scale (DERS)) to participants in order to assess differences in user retention.
In both conditions, participants will use the Neuroflow app throughout the duration of the 4-week study (28 days). Participants will be sent a push notification each day through the app to complete their daily activities, which could include surveys, videos, or skill-based practice materials.
With the collaboration of the Neuroflow team, the usage metrics of the app will be pulled after the end of the study. The user metrics of interest are identifying factors that include first name, last name, gender, age, date of birth, and the applicable assignments to each participant - care team manager and behavioral health specialist. Additionally, the first and last score, first and last date, and time between the first and last assessment dates for the measures of interest (PHQ-9, GAD-7, WHO-5, DERS). Furthermore, the total activity number and the total activity rate across all measures will be collected. No additional data from or about participant phone usage or activities will be pulled as part of the study other than the usage metrics specified above, specific to Neuroflow.
Study design
- Primary purpose
- Supportive care
- Allocation
- Randomised
- Intervention model
- Parallel groups
- Masking
- Single blind (participant)
- Number of arms
- 2
- Model description
- Participants will be randomized to one of the two arms. The participants getting the app with behavioral economics incentives only will be enrolled at the same time as the participants getting the app with behavioral economics + financial incentives.
| Arm | Type | Receives |
|---|---|---|
| App with behavioral economics + financial incentives | Experimental | Behavioral: Neuroflow app: Mental health and wellbeing resources for adultsNeuroFlow uses behavioral economics reminders, gamification, and fun, motivating messages to encourage use. It also includes financial incentives so users can earn redeemable points accrued for activity completion for gift cards at popular outlets (e.g., 1000 points which is the maximum per month = $10 gift card). |
| App with behavioral economics incentives only | Active comparator | Behavioral: Neuroflow app: Mental health and wellbeing resources for adultsNeuroFlow uses behavioral economics reminders, gamification, and fun, motivating messages to encourage use. including points accrued for activity completion. This version of the app does not have financial incentives. |
Who may qualify
- Ages
- 18 years and older
- Sex
- All
- Healthy volunteers
- Accepted
- Age groups
- Adult, Older adult
Key inclusion criteria (1 listed)
- The target population for this study are college students either at the University of Pennsylvania or other US universities. Participants will be included if they have a smartphone and are willing to download and use the Neuroflow app throughout the duration of the study
Key exclusion criteria (1 listed)
- Does not own a smartphone capable of downloading the NeuroFlow application or is unwilling to download and use the Neuroflow app throughout the duration of the study.
Eligibility is decided by the study team after screening; this overview does not establish that a patient qualifies. Full inclusion and exclusion criteria.
Interventions
| Intervention | Type | Arms |
|---|---|---|
| Neuroflow app: Mental health and wellbeing resources for adultsThe NeuroFlow app delivers resources on resilience training, mindfulness-based strategies and cognitive behavioral therapy to adults looking to support their mental health and wellbeing. The specific "journey" (i.e., content such as activities, videos, trackers, and journaling) is tailored to individuals based on depression and anxiety screeners administered upon signing up to the app. | Behavioural | App with behavioral economics + financial incentives, App with behavioral economics incentives only |
Primary outcome
Engagement (Percentage of Daily check-in Activities)
Time frame: Throughout 28-day trial (averaged)
User engagement will be measured as the percentage of daily check-in activities (number completed out of the total number of activities assigned)
4 secondary outcomes
Generalized Anxiety Disorder (GAD-7)
Time frame: Baseline and post-trial, up to 28 days
Patient Health Questionnaire (PHQ-8)
Time frame: Baseline and post-trial, up to 28 days
World Health Organization (WHO-5)
Time frame: Baseline and post-trial, up to 28 days
Difficulties Emotion Regulation Scale (DERS)
Time frame: Baseline and post-trial, up to 28 days
Results and safety
Loading the posted results from ClinicalTrials.gov…
Research links
- Official record on ClinicalTrials.govLast updated by the sponsor 12 Aug 2024.
- Posted resultsParticipant flow, baseline, all outcome measures and adverse events.
- Background: PubMed 28659256Huang HY, Bashir M. Users' Adoption of Mental Health Apps: Examining the Impact of Information Cues. JMIR Mhealth Uhealth. 2017 Jun 28;5(6):e83. doi: 10.2196/mhealth.6827.
- Background: PubMed 32553848Huckvale K, Nicholas J, Torous J, Larsen ME. Smartphone apps for the treatment of mental health conditions: status and considerations. Curr Opin Psychol. 2020 Dec;36:65-70. doi: 10.1016/j.copsyc.2020.04.008. Epub 2020 May 4.
- Background: PubMed 32348289Lecomte T, Potvin S, Corbiere M, Guay S, Samson C, Cloutier B, Francoeur A, Pennou A, Khazaal Y. Mobile Apps for Mental Health Issues: Meta-Review of Meta-Analyses. JMIR Mhealth Uhealth. 2020 May 29;8(5):e17458. doi: 10.2196/17458.
- Individual participant dataSharing planned: No
Related trials for Behavioral Economics
Active, not recruiting
Intervention to Address Disparate Mental Health Consequences of COVID-19 Pandemic on Latinx and African Newcomers
Mental Health Issue, Mental Health Disorder
Not yet recruiting
Examining the Relationship Between Ongoing Alcohol Use, Suicidal Thoughts and Behaviors and Related Constructs, and Behavioral Economic Decision-Making.
Alcohol Use Disorder (AUD), Suicidal Ideation
Active, not recruiting
Economic Empowerment and Health Promotion of Uganda Grandmother-caregivers.
Financial Burden, Health Behavior
Not yet recruiting
Penn Family Screening for Familial Hypercholesterolemia (NHLBI R33) Trial 3
Familial Hypercholesterolemia
Not yet recruiting
Small Monetary Incentives for Digital Cognitive Training Adherence in Community-Dwelling Older Adults
Cognitive Decline, Dementia Prevention
Referral and contact
AzTrials does not enrol participants or take referrals. Contact the study team or a site listed below; they decide who can take part. This study is not recruiting at the moment.
Heather Nuske principal investigator
Penn Medicine
1 site in 1 country: see every site and its status.
Questions about this trial
What is this clinical trial studying?
A study testing Neuroflow app: Mental health and wellbeing resources for adults in people with Behavioral Economics and Gifts, Financial, run by University of Pennsylvania at 1 site in United States.
The full registered description is in the About this study section and the official record.
Who may be eligible to take part?
The sponsor lists 1 inclusion and 1 exclusion criteria. Eligibility is decided by the study team after screening, so read the full criteria and contact a listed site.
Is this clinical trial currently recruiting?
The record says: finished, as of the sponsor's last update on 12 Aug 2024. Status can change between updates, so confirm with the study contact before making plans.
Where is the study taking place?
The record lists 1 site in United States. Whether a site is taking part right now should be confirmed with that site. See every site.
What are the possible benefits and risks?
They depend on the study and the treatment, and no study can promise a benefit. The study team explains the known risks during informed consent, before anyone joins; the record itself does not list them.
Are results available for this study?
Yes. Results are posted in the registry (first posted 12 Aug 2024). A summary is in the For doctors view, and the full results are on ClinicalTrials.gov.
How can a doctor refer a patient or contact the research team?
The record lists no contact. The official record names the sponsor, who can be asked directly. AzTrials does not enrol participants or take referrals.
What does the primary outcome measure?
Engagement (Percentage of Daily check-in Activities) (time frame: Throughout 28-day trial (averaged)). It is what the study was designed to measure, not a finding.
Where can I read the original study information?
On the ClinicalTrials.gov record for NCT05121675, which also lists 3 linked publications.
Does a listing mean the treatment is approved or proven to work?
No. A listing means the study is registered. It does not show that the treatment is safe, works, or is approved by a regulator.
How often is this information updated?
AzTrials copies changed records from ClinicalTrials.gov every night and reloads the whole registry every week. The sponsor last updated this record on 12 Aug 2024.