Cog-TiPRO: Iterative Prompt Refinement with LLMs to Detect Cognitive Decline via Longitudinal Voice Assistant Commands
Kristin Qi, Youxiang Zhu, Caroline Summerour, John A. Batsis, Xiaohui Liang Early detection of cognitive decline is crucial for enabling interventions that can slow neurodegenerative disease progression. Traditional diagnostic approaches rely on labor-intensive clinical assessments, which are impractical for frequent monitoring. Our pilot study investigates voice assistant systems (VAS) as non-invasive tools for detecting cognitive…
Unveil Multi-Picture Descriptions for Multilingual Mild Cognitive Impairment Detection via Contrastive Learning
Kristin Qi, Jiali Cheng, Youxiang Zhu, Hadi Amiri, Xiaohui Liang Detecting Mild Cognitive Impairment from picture descriptions is critical yet challenging, especially in multilingual and multiple picture settings. Prior work has primarily focused on English speakers describing a single picture (e.g., the `Cookie Theft’). The TAUKDIAL-2024 challenge expands this scope by introducing multilingual speakers and…
- Cog-TiPRO: Iterative Prompt Refinement with LLMs to Detect Cognitive Decline via Longitudinal Voice Assistant Commands
- Unveil Multi-Picture Descriptions for Multilingual Mild Cognitive Impairment Detection via Contrastive Learning
- Xiaohui gave a talk on “Early Detection of Cognitive Decline Using Voice Assistant”
- PhD student Rishank will participate I2SEED program
- Two PhD students will present posters at the New England NLP (NENLP) workshop on April 11, 2025
- Enhancing Perspective-Aware Summarization with Prompt Optimization and Supervised Fine-Tuning (NAACL/CL4Health 2025)
- Adversarial Text Generation using Large Language Models for Dementia Detection (EMNLP 2024)
- Exploiting Longitudinal Speech Sessions via Voice Assistant Systems for Early Detection of Cognitive Decline (HealthCom 2024)
- Exploiting Privacy Preserving Prompt Techniques for Online Large Language Model Usage (GLOBECOM 2024)
- Analyzing Multimodal Features of Spontaneous Voice Assistant Commands for Mild Cognitive Impairment Detection (INTERSPEECH 2024)
- Student joins Eve as a summer intern
- Annual a2 National Symposium
- Using Voice Assistant Systems to Improve Dietary Recall Among Older Adults: Perspectives of Registered Dietitians
- Publishing VAS Phase I Dataset
- KDD and SOUPS attendance
- Evaluating Picture Description Speech for Dementia Detection using Image-text Alignment (Multimodal KDD 2023)
- VPASS: Voice Privacy Assistant System for Monitoring In-home Voice Commands (SOUPS poster + PST 2023)
- ICC and ICASSP attendance
- (Related) A comprehensive systematic review on mobile applications to support dementia patients
- Early Detection of Cognitive Decline using Voice Assistant Commands (ICASSP 2023)
- Exploiting Relevance of Speech to Sleepiness Detection via Attention Mechanism (ICC 2023)
- More Data, Better Accuracy? An Empirical Study on Few-shot Speech-based Dementia Detection (SoCal 2022)
- Dr. Liang delivered a Keynote Speech in IEEE International Conference on Universal Village
- (Related) Should Alexa diagnose Alzheimer’s?: Legal and ethical issues with at-home consumer devices
- Towards Interpretability of Speech Pause in Dementia Detection using Adversarial Learning (INTERSPEECH 2022)
- AGS Presidential Poster Award
- Phase II update
- Patient Perceptions of Using Voice-Based Dietary Assessment Tools Among Older Adults
- Domain-aware Intermediate Pretraining for Dementia Detection with Limited Data
- Two papers accepted by “IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP)” 2022
- A Bibliograph of Speech-based Dementia Detection
- Speech Tasks Relevant to Sleepiness Determined with Deep Transfer Learning
- Towards Interpretability of Speech Pause in Dementia Detection using Adversarial Learning
- “Evaluating Voice-Assistant Commands for Dementia Detection” has been accepted by Computer Speech & Language
- Dr. Liang is organizing Symposium on e-Health at IEEE International Conference on Communications (ICC) 2022
- “WavBERT: Exploiting Semantic and Non-semantic Speech using Wav2vec and BERT for Dementia Detection” has been accepted by INTERSPEECH 2021
- Collaborative Research with SondeHealth
- Privacy Concerns Among Older Adults Using Voice Assistant Systems
- (Related) Speech for predicting car accidents and medical Alexa
- The ADReSSo 2021 Challenge
- Group meeting on March 19, 2021
- (Related) News of Smart Speaker
- Exploring Deep Transfer Learning Techniques for Alzheimer’s Dementia Detection
- Research Update on March 8
- Medical Monitor Meeting on Oct. 26, 2020
- Team meeting on Sept. 11, 2020
- Dr. John A. Batsis moved to UNC
- The ADReSS 2020 Challenge
- Dr. Aleksandra C. Stark joined our team
- In-lab evaluation at DH
- Press
- Flyer and Tear-off
- Project
Follow My Blog
Get new content delivered directly to your inbox.
CogVox 