
Project DAPHNE received INSPIRE Research Challenge Grant
11/2023
Happy to announce that we are one of the 16 recipients of INSPIRE Research Challenge grants from WCRF International in partnership with the American Institute for Cancer Research and Wereld Kanker Onderzoek Fonds. We will use our chatbot DAPHNE(c), an intelligent chatbot, to address social and mental health needs in real-time for families of children with cancer. This is a collaborative work by Skeens Lab and Intelligent Futures Research Lab at Nationwide Children's Hospital. Link for more details.

AMIA 2023 Annual Symposium
10/2023
We will be presenting two of our latest research from the Intelligent Futures Research Lab at Nationwide Children's Hospital at AMIA 2023: An AI-based Embodied Conversational Agent (DAPHNE) for Social Needs Identification and Resource Allocation in At-risk Neighborhoods and assessment and integration of a clinical conversation summarization (digital scribe) pipeline. For more information, please visit AMIA webpage.

Artificial intelligence in healthcare: Complementing, not replacing, doctors and healthcare providers
07/2023
My latest viewpoint is about the ongoing discussion on "AI replacing doctors". Main takeaways are (1) AI is not here to replace doctors but to augment their roles and improve healthcare efficiency; (2) With the human-in-the-loop concept, AI and healthcare providers' collaboration for optimal patient outcomes is essential; (3) The successful adoption of AI in healthcare organizations extends beyond personal choice—it requires a systematic, organizational approach. Open access paper available here.

HIMSS 2023: "It Speaks, It Listens, It's Your Daily Voice Assistant - Leveraging Voice Technology in Health and Wellness"
04/2023
I will be joining the Open Voice Network panel talk at the upcoming HIMSS23: "It Speaks, It Listens, It's Your Daily Voice Assistant - Leveraging Voice Technology in Health and Wellness" [Monday, April 17th @ 12:45 PM CT]. Voice technology is transforming the healthcare industry. We will discuss the current use of voice technology, and conversational AI in the healthcare industry, including medical practice, healthcare operations, remote patient monitoring, and health management.

Guest lecture on "Operationalizing and Implementing Generative Pretrained Language Models & Large Language Models in Healthcare" at Centre for Digital Health Interventions
04/2023
Generative pretrained transformer models and large language models are the popular AI/ML solutions in the market. However, questions regarding the implementation and operability in health care, clinical practice, and research remain unanswered. In this lecture, we will review these models and their capabilities and address considerations for the implementation and operationalization in healthcare and clinical practice.

Building Bridges to Better Health: A Primary Health Care Challenge
03/2023
Our team has been selected as one of the 15 Phase 2 winners of HRSA Building Bridges to Better Health: A Primary Health Care Challenge! We are thrilled to be recognized for our innovative solution to address social needs by an intelligent conversational agent designed for screening and resource sharing.

Extracting Medical Information from Free-text and Unstructured Patient-Generated Health Data using Natural Language Processing Methods: A Feasibility Study with Real-world Data
02/2023
Unstructured PGHD provides a new and untapped layer in patient health records which can inform decision-making and support remote monitoring and self-care. In this paper, we share the new research findings and preliminary results for the customizable information extraction (IE) NLP model focused on extracting a broad range of clinical information from unstructured PGHD in low-resource settings, especially as it relates to chronic disease management. The full paper (open-access) is available at JMIR.

Design and Evaluation Challenges of Conversational Agents (CA) in Healthcare and Wellbeing
12/2022
There is a significant increase in research, development, and commercial implementations & interest in designing and evaluating CAs. In our study, we identify key design, development, and evaluation challenges of CAs in healthcare and well-being research. The focus is on the very recent projects with their emerging challenges. The full paper (open-access) is available at JMIR.

4th Annual Health Data Science Symposium at Harvard
11/2022
I will be participating health data science symposium at Harvard (Nov 3-5), having a chance to learn more about digital phenotyping, using active and passive data in research, hands-on data analysis practice, and listening/networking with brilliant researchers in this field. I will present our work on unstructured PGHD and voice, which is positioned uniquely as having features of active and passive data.

Healthcare Needs To Be “Vocal”! Towards a Future of Self-Management and Remote Patient Monitoring with Voice Technology in the Loop
10/2022
I will be at the Voice Summit 2022 this October, speaking about the evidence and future of voice technologies and conversational AI in self-management, RPM, and healthcare at the Open Voice Network healthcare track (Oct 12th).

“It takes a Village... to “raise” Ethical AI in Pediatrics”
09/2022
The use of artificial intelligence (AI) in child health research and clinical practice has steadily increased. In this paper, we propose three considerations to orient pediatric teams with diverse stakeholders leveraging AI solutions to advance child health equity. It is available at The Lancet Child and Adolescent Health. An author copy is available here.

Current State of Mobile Apps Owned by Large Pediatric Hospitals in the U.S.: A Review of Google Play and Apple App Stores
08/2022
We aimed to understand the current state of hospital-owned mobile apps provided by large pediatric hospitals via a systematic search on Google Play and Apple App Store platforms. Based on the most common features, these apps were designed to help improve accessibility for patients and families in terms of finding providers, scheduling appointments, and accessing patient resources. Open-access available at JMIR Pediatrics and Parenting

Medical text prediction and suggestion using generative pre-trained transformer models with dental medical notes
06/2022
Isn't it nice to have Google or Microsoft predicting our next words and suggestions while typing our emails? What if healthcare providers can use similar predictive models while taking clinical notes? In our study, we evaluated generative pre-trained transformer models (GPT) with more than 370,000 free-text electronic medical records to understand the performance of GPT models in text prediction with the medical notes taken. The paper is available at Methods of Information in Medicine. Open access author's copy is here.

Prevalence of Sensitive Terms in Clinical Notes: Observational study using natural language processing techniques
05/2022
With the increased sharing of electronic health information as required by the 21st Century Cures Act, there is an increased risk of breaching patient or parent/guardian confidentiality. The prevalence of sensitive terms in clinical notes is not known. The aim of our study is to define sensitive terms that represent documentation of content that may be private and determine the prevalence and characteristics of provider notes that contain sensitive terms. Open access available at JMIR Med Informatics.

Join me at ATA 2022
04/2022
This May, I will be presenting our study “Remote patient monitoring (RPM) through the narratives: Leveraging speech and free - text patient-generated health data in shared clinical decision making and telehealth practice” at ATA 2022 conference in Boston. Here is the link for the agenda and details about the conference.

Considerations for Conducting Bring Your Own "Device" (BYOD) Clinical Studies
04/2022
Despite the rapid increase in using DHTs for clinical and healthcare research, BYOD use in clinical trials is limited, and regulatory guidance is still evolving. In this article, we offer recommendations for the design and deployment of BYOD models in clinical research. Open access available at the Journal of Digital Biomarkers.

43rd Annual meeting of Society of Behavioral Medicine
04/2022
This year at SBM 2022, our team is presenting 2 of our studies: “It’s a hustle” Can we use digital health interventions for stress management among low-income families with young children" & "Personal medical diaries meet AI: Feasibility of using medical notes to improve remote care during the pandemic". The abstracts will be available in the Annals of Behavioral Medicine.

Socio-technical Factors Impacting Patients’ Adoption of Mobile Health Tools: Systematic Literature Review and Narrative Synthesis
04/2022
mHealth tools have been promising healthcare technology that may contribute to cost savings, better access to care, and enhanced clinical outcomes; however, it is important to ensure their acceptance and adoption in order to harness this potential. Patient adoption has been recognized as a key challenge that requires further exploration. This review systematically investigates the literature to understand the factors impacting patients’ adoption of mHealth tools, by considering socio-technical factors (from technical, social, and health perspectives). Open access is available at JMIR mHealth uHealth.

“Hey Siri, help me take care of my child”: A feasibility study with caregivers of children with special healthcare needs (CSHCN) using voice interaction and automatic speech recognition in remote care management”
02/2022
We conducted a pre-post study with a voice-enabled medical note-taking app in a real world setting with caregivers (parents, family members) of children with special healthcare needs (CSHCN) to understand feasibility and effectiveness of voice interaction and automatic speech recognition (ASR) for medical note-taking at home. Our paper is available open-access at Frontiers in Public Health.

Operationalizing and implementing pretrained large AI linguistic models in the United States healthcare system: An outlook of GPT-3 as a service
02/2022
We investigated one of the most popular AI tools (GPT-3) and discussed its use in clinical practice as-a-service model. One of the most popular AI or NLP models have been GPT-3, which has been utilized widely in the industry, such as, to build QnA mechanisms, chatbots, writing essays or translations. Their implementation in clinical practice could be challenging. We summarized considerations for implementation and operations in clinical practice. We illustrated our case with an example of triage chatbot and note summarization mechanism. Available at JMIR Medical Informatics.

Telehealth visits patient satisfaction studies: a survey development and model validation
01/2022
"Rapid Development of a Telehealth Patient Satisfaction Survey Using a Multi-Stakeholder Approach" and "Identifying the Factors Influencing Patients’ Telehealth Visit Satisfaction: Survey Validation Through a Structural Equation Modeling Approach" are available at the journal of Telemedicine and eHealth. (author copy available at RG)
In these studies, we explained our proposed telehealth patient satisfaction survey, and assessed factors influencing satisfaction through the proposed conceptual model of TPSM.
Announcements (archive)
Call for Papers
Frontiers in Public Health
Special issue on voice technology and CAs
We invite you to submit your papers for an upcoming issue at Frontiers in Public Health: "voice technology and conversational agents in health care delivery". Frontiers in Public Health is one of the leading public health journals in the field (with IF 3.7). 30 September 2021 is manuscript submission due date. Link for details.
A NLP pipeline to synthesize patient- generated notes toward improving remote care and chronic disease management: a cystic fibrosis case study
JAMIA Open
09/2021
Patient-generated health data (PGHD) are important for tracking and monitoring out of clinic health events and supporting shared clinical decisions. Unstructured text as PGHD (eg, medical diary notes and transcriptions) have rich information through narratives which can be critical to better understand a patient’s condition. In our manuscript, we propose a NLP supported data synthesis pipeline for unstructured PGHD, focusing on children with special healthcare needs (CSHCN), and demonstrate it with a case study on cystic fibrosis (CF). Open access paper is available at JAMIA Open
Unjust: the health records of youth with personal /family justice involvement in a large pediatric health system
Health and Justice
08/2021
We searched 2.3m pediatric patients for cohorts with involvement in correctional system, enhancing our queries with an NLP tool DeepSuggest.~51k patients found likely to have personal or family involvement with the justice system. Concerning rates on substance use & mental health issues: 66% cannabis-related diagnoses 52% trauma-related diagnoses 48% stress-related diagnoses 38% psychotic disorder diagnoses 33% suicidal-related disorders The study is open-access available. For the highlights of the study, you can check Pediatrics Nationwide interview.
Can we use commercial mobile apps instead of research mobile apps in healthcare research?
Frontiers Public Health
07/2021
How could the research utilize the benefits of commercial apps to create sustainable and impactful research app and generate better research outcomes? In this commentary, research app and commercial app were compared, the use of commercial app in mobile health research and implementations were discussed, and finally the future implementations were envisioned. Link
ATA 2021 Annual Conference presentation on Telehealth
06/2021
We presented our telehealth patient satisfaction and telehealth visit cancellation and rescheduling studies at ATA annual conference 2021.Presentation video is available online here.
AMIA CIC 2021 - AHRQ care transition challenge panelist
05/2021
I will be a panelist at AMIA Clinical Informatics Conference 2021 with AHRQ Care Transition Challenge prize recipients. Our project, DigaMedico, addressed language barrier in medical communications for parents of CSHCN. Join our conversation May 20th, 2:30PM (ET). I will be discussing about our project, DigaMedico, which an EHR integrated mobile app to auto-translate written communications between caregiver/patient and provider. This project is open for collaboration! We would like to further improve, investigate and disseminate our study and improve Non-English speaking patient/caregiver health communications
Feasibility of a Voice-Enabled Medical Diary App (SpeakHealth) for Caregivers of Children With Special Health Care Needs and Health Care Providers: Mixed Methods Study
JMIR Formative Research
05/2021
We developed and tested a voice-enabled Mobile App for parents to conveniently keep track of health events, medications and symptoms at home for their kids with special healthcare needs. Available open access here.
Study introduction video: https://vimeo.com/479099070
Using Neural Networks to Suggest Related Keywords for a Comprehensive Search of Clinical Notes. ACI Open
3/2021
A large amount of clinical data is stored in clinical notes that frequently contain spelling variations, typos, local practice-generated acronyms, synonyms, and informal words. We developed and tested an AI assistant search mechanism (“DeepSuggest”) that interactively offers suggestions to improve queries and search results. Paper will be available soon at ACI Open, open access available here.
Delivering Perinatal Health Information via a Voice Interactive App (SMILE): Mixed Methods Feasibility Study. JMIR FR
3/2021
We conducted a real world testing and feasibility study among pregnant and new moms using pediatric podcasts through voice interactive SMILE app for perinatal education/intervention. We also collected voice feedback about podcast episodes, which added richness to the results. Our findings are available in our paper in this link.
Clinical Advice by Voice Assistants on Postpartum Depression: Cross-Sectional Investigation Using Apple Siri, Amazon Alexa, Google Assistant, and Microsoft Cortana
JMIR mHealth uHealth
1/2021
How do voice assistants perform when you ask a question about postpartum depression? In our latest study published at JMIR mHealth uHealth, we looked for responses to this question, and our findings are quite surprising. More in this link.
Documented Reasons of Cancellation and Rescheduling of Telehealth Appointments During the Pandemic
Telemedicine and e-health
Interview about voice assistants use in healthcare during COVID19 at Politico
​
11/2020
​
I was interviewed by Politico's eHealth reporter, Mohana Ravindranath, about the potential of voice assistants in healthcare delivery during the pandemic. Newsletter link:
Our study and comments were also highlighted in the Future Pulse newsletter of Politico:
Readiness for voice assistants to support healthcare delivery during a health crisis and pandemic
Nature Digital Medicine
08/2020
​
Are we ready to use voice assistants (VA) in healthcare delivery during pandemic? In this commentary at NPJ Digital Medicine, we discussed the readiness for VA and envision the post-pandemic use. Open access available at this link.
​
Behind the paper and brief details about the paper were shared in NPJ community blogpost.
The Role of Health Care Voice Assistants During a Pandemic and Beyond
11/2020
​
Check out our interview at Pediatrics Nationwide on voice assistants in healthcare during pandemic. Follow the link below for the full interview.
Detecting Screams From Home Audio Recordings to Identify Tantrums: Exploratory Study Using Transfer Machine Learning
JMIR FR
06/2020
​
Can we detect tantrum using audio recordings collected at home?
In this feasibility study, we trained and tested our scream-detection model with publicly available data. The results are promising and need further investigation. Next step: testing with clinically relevant data and real world implementation.
Available open access at https://formative.jmir.org/2020/6/e18279/
A scoping review of patient-facing behavioral health interventions with voice assistants
Translational Behavioral Medicine
08/2020
​
Our recent review paper is available now at Translational Behavioral Medicine: “A scoping review of patient-facing, behavioral health interventions with voice assistant (VA) technology targeting self-management and healthy lifestyle behaviors”. Full paper is available at this link.
Medical translation assistant for non-English speaking caregivers of CSHCN: A scalable and interoperable mobile app
JMIR RP
09/2020
​
Our research protocol which received AHRQ Challenge prize earlier this year has been published in JMIR Research Protocols. It is open-access available at this link.

New paper - J of Child Neurology
Evaluation of an Activity Tracker to Detect Seizures Using Machine Learning
07/2020
​
We tested Fitbit Charge 2 to detect seizures in pediatric setting. 40 pediatric patients enrolled, and 12 patients had a total of 53 epileptic seizures. Conclusion is as expected and validating the literature: Use of the Fitbit is not well suited to detect epileptic seizures compared to EEG collected through medical-grade devices.
Full paper is available at this link.

Our team is one of the phase 1 winners of AHRQ's Digital Solutions to Support Care Transitions Challenge
06/2020
​
Happy to announce that our team is one of the phase 1 winners of AHRQ's Digital Solutions to Support Care Transitions Challenge with our solution proposal: An integrated medical translation app for non-English speaking caregivers of CSHCN. Our proposal is available at this link.

Pediatric Digital Health Hackathon at Nationwide Children's Hospital
01/2020
​
We completed our first Pediatric Digital Health Hackathon at Nationwide Children's Hospital yesterday. It was a great experience with participation of researchers, engineers, scientists, clinicians, industry partners and SBIR advisors. Happy to be part of the team who won the hackathon with the idea of using voice assistants in dental practice

Connected Health 2019 at Boston
10/2019
​
We were at Connected Health 2019 to present our initial results of our HIMSS Dev Challenge winner project: "Look to the future and SMILE: Feasibility of interactive voice assistant to support maternal infant health". Details available at iProceedings at JMIR.

We won HRSA MCHB Care Coordination Challenge Phase 2!
09/2019
​
As the winner of Phase 1, we developed and tested a new voice-first and AI powered diary app for caregivers having kids with medical complexities. Now, we are happy to announce that we won the phase 2 prize and will carry on our project to the next stage.
_edited_edited.png)
New blog post on Pediatrics Nationwide on digital health ecosystem
07/2019
​
Do we need an app or a digital ecosystem for managing chronic conditions among teens and caregivers? Here is my recent blog post featured at Pediatrics Nationwide. It is highlighting our study with families and their digital needs for self management.
https://pediatricsnationwide.org/2019/07/12/not-an-app-we-need-a-digital-health-ecosystem/

Hey Google, Siri and Alexa, How Do We Bring Voice Technology Into Health Care?
04/2019
​
Check out our interview at Pediatrics Nationwide on voice assistants in healthcare. We mentioned on our current projects and discussed about the potential implementations. Follow the link below for the full interview.

Voice Technology: Can it Help Me Take Better Care of Myself and My Baby?
01/2019
​
Our blog post on HIMSS is available now. We discussed the the value of voice technology in healthcare. We further explained the use of voice assistants and its potential impact on underserved populations. Follow the link below to read full post.
https://www.himss.org/news/voice-technology-can-it-help-me-take-better-care-myself-and-my-baby

Phase 1 prize of HRSA MCHB's challenge
01/2019
​
Our team at Nationwide Children's Hospital has been one of the recipients of Phase 1 prize of U.S. Health Resources and Services Administration (HRSA) The Maternal and Child Health Bureau (MCHB)'s care coordination for children with special health care needs (CSHCN) challenge.
​

1st place winner @ HIMSS Developer Challenge
01/2019
​
Our team received the 1st place award at HIMSS developer challenge with our Alexa solution for stress management to reduce infant mortality among underserved communities. Thanks to our RISI R&D team at Nationwide Children's Hospital and Lisa Militello at The Ohio State University.