In this program, the investigators will develop novel multimodal neural-behavioral-physiological monitoring tools (software and hardware), and machine learning models for mental states within social processes and beyond. The tools consist of a multimodal skin-like wearable sensor for physiological and biochemical sensing; a conversational virtual human platform to evoke naturalistic social processes; audiovisual affect recognition software; synchronization tools; and machine learning methods to model the multimodal data. The investigators will demonstrate the tools in healthy subjects without neural recordings and in patients with drug-resistant epilepsy who already have intracranial EEG (iEEG) electrodes implanted based on clinical criteria for standard monitoring to localize seizures, which is unrelated to our study.
Study Type
INTERVENTIONAL
Allocation
NA
Purpose
BASIC_SCIENCE
Masking
NONE
Enrollment
90
The participants will perform a social interaction with the virtual human agent platform to assess mental states.
Healthy participants will immerse one hand in cold water for less than 3 minutes, while physiological data will be collected by the new wearable sensor from the other hand.
Rancho Los Amigos National Rehabilitation Center
Downey, California, United States
RECRUITINGUniversity of Southern California
Los Angeles, California, United States
RECRUITINGPositive and Negative Affect Schedule (PANAS)
Momentary self-reports of the Positive and Negative Affect Schedule (PANAS) will be administered in a tablet-based application, which measures momentary positive and negative affect. These self-reports return scores indicative of momentary mental state. Self-reports are obtained intermittently from the participants.
Time frame: 7-10 days
Visual Analog Scale (VAS)
Momentary self-reports of the Visual Analog Scale (VAS) of depression, anxiety, and energy will be administered in a tablet-based application. These are fast self-reports to indicate the affect level along a line from none to prominent. These self-reports return scores indicative of momentary mental state. Self-reports are obtained intermittently from the participants.
Time frame: 7-10 days
Hamilton Depression Rating Scales (HAMD-6)
Momentary self-reports of Hamilton Depression Rating Scales (HAMD-6) will be administered in a tablet-based application, which is widely used to measure the severity of the depressive state. These self-reports return scores indicative of momentary mental state. Self-reports are obtained intermittently from the participants.
Time frame: 7-10 days
Hamilton Anxiety Rating Scales (HAM-A)
Momentary self-reports of Hamilton Anxiety Rating scales (HAM-A) will be administered in a tablet-based application, which is widely used to measure the severity of the anxiety state. These self-reports return scores indicative of momentary mental state. Self-reports are obtained intermittently from the participants.
Time frame: 7-10 days
Immediate Mood Scalar (IMS)
Momentary self-reports of the Immediate Mood Scalar (IMS) will be administered in a tablet-based application, which measures depression and anxiety severity. These self-reports return scores indicative of momentary mental state. Self-reports are obtained intermittently from the participants.
Time frame: 7-10 days
Fear of Negative Evaluation Brief
Momentary self-reports of Fear of Negative Evaluation Brief will be administered in a tablet-based application. These self-reports return scores indicative of momentary mental state. Self-reports are obtained intermittently from the participants.
Time frame: 7-10 days
Physiological measurements - heart rate variability (HRV)
Heart rate variability will be collected from each participant by using either commercial systems or the new wearable sensor.
Time frame: 7-10 days
Physiological measurements - skin conductance (SC)
Skin conductance will be collected from each participant by using either commercial systems or the new wearable sensor.
Time frame: 7-10 days
Physiological measurements - cortisol level
Cortisol level will be collected from each participant by using either commercial systems or the new wearable sensor.
Time frame: 7-10 days
Neural measurements
In epilepsy patients who already have intracranial EEG recordings for their standard clinical monitoring (unrelated to this study), we will also obtain iEEG activity measurements. EEG power will be the main focus of the analysis, but the raw signal will also be analyzed.
Time frame: 7-10 days
This platform is for informational purposes only and does not constitute medical advice. Always consult a qualified healthcare professional.