Technology 4 Mental Health

Link List
The Technology 4 Mental Health (T4MH) research group studies:
- Science, technology, engineering, and mathematics (STEM) for feedback control design and signal processing for electronic treatment methods to improve mental health (e.g., apps, machine learning, algorithms).
- Adaptive/personalized treatment, which we view as a "brain prosthetic."
- Promote desigmatization, awareness, and acceptance of "mental differences."
Introductory
Seminars, Conference:
- "Mathematics, Technology, and Mental Illness," K. Passino, Seminar, OSU Mathematical Biosciences Institute, April 19, 2018:
- "Technology, Poverty, and Mental Illness," Cleveland State University and Case Western Reserve University consortium forum, Cleveland, OH, Oct. 4, 2018.
- "Can Feedback Control Attenuate Mental Illness?" Controlo Conference: 14th International Conference on Automatic Control and Soft Computing, Braganca, Portugal, Plenary talk, Virtual, July 2, 2020.
Feedback Control Approach
Science, Technology, Engineering, and Mathematics (STEM)-based Feedback Control for Treatment of Mental Illness
- Feedback control system perspective
- Sensors for biosignals: EEG, ECG/HRV, etc.
- Actuators; Light, sound (e.g., music), smell, etc.
- Computer algorithms, on-line machine learning, adaptation, and feedback control for individual/group personalization and robustness



Process and Controller (each by itself):
- Inputs
- Outputs
- Dynamics
- Disturbances
- Uncertainty
- Modeling (e.g., ODEs, stochastic models)
Basic System (process and controller) Properties:
- Controllability
- Observability
- Stability
- Real-time/frequency domain properties/constraints
Specifications (closed-loop properties, "design objectives"):
- Stability, tracking
- Disturbance rejection
- Performance
- Robustness
Design:
- Construct the controller to generate inputs to the process so that the goals are met.
- Can construct a controller if it is implemented in technology, but at times use the feedback control system to model a feedback loop in the human body (e.g., an interconnected neurosystem).
- For technology, the process of control design results in a control algorithm that can be implemented (e.g., via a virtual reality system or in Matab by gathering biosignals and generating inputs such as music or video).
- Control algorithm implemented in a computer is a brain prosthetic.
Progress:
Intelligent Control: For a more comprehensive treatment of control design methodology, with or without a mathematical model and one that is connected to biological and technological systems, see the book by Passino, Biomimicry for Optimization, Control, and Automation.
Cooperation: Network-based views of social supports for a patient, or neural processes leading to emergent pattern/behavior, often benefit from a distributed and networked view that incorporates cooperation.
- Individual/group controlled immersive environments
- Sensors from above, actuators from above, and more
- Office/home adaptive treatment environment
- K. Passino, Seminar at Colorado School of Mines, 4/24/18, "Design of Psychophysical Ambience: Taking Off Your Virtual Reality Headset"

3D adaptive sound control:
- Experiment for sound volume/frequency control.
- Experiment in volume control for sound/music reproduction.
- 3D surround sound (being installed now)

2D adaptive light arrays progress ("smart lights"):
- Experiments in our Distributed Dynamical Systems Laboratory (see also iSTEM)
- Koroglu M.T., and Passino K.M., "Illumination Balancing Algorithm for Smart Lights," IEEE Trans. on Control Systems Technology, Vol. 22, No. 2, pp. 557-567, March 2014.
- Jose Velasquez and Kevin M. Passino, "Fuzzy Fault Tolerant Control for Smart Lights," Journal of Intelligent and Fuzzy Systems, Vol. 28, No. 6, pp. 2605-2620, 2015.
- Wilfredo Alfonso, Jose J. Velasquez, Kevin M. Passino, Eduardo F. Caicedo, "A Honeybee Social Foraging Algorithm for Feedback Control of Smart Lights," Engineering Applications of Artificial Intelligence, Vol. 48, pp. 13-31, 2016.


3D adaptive light arrays (in progress):
- Wireless lighting, zigbee-controlled LED bulbs
- Synchronized with sound (e.g., music)


2D/3D adaptive temperature control arrays progress (on a planar grid):
- Experiment in our Distributed Dynamical Systems Laboratory (and laboratory assignment in ECE 5557)
- Quijano N., Gil A.E., Passino K.M., “Experiments for Dynamic Resource Allocation, Scheduling, and Control,” IEEE Control Systems Magazine, Vol. 25, No. 1, pp. 63-79, Feb. 2005.
- Quijano N., Andrews, B.W., Passino K.M., "Foraging Theory for Multizone Temperature Control," IEEE Computational Intelligence Magazine, Vol 1, No. 4, pp. 18-27, Nov. 2006.
- Quijano N., Passino K.M., "The Ideal Free Distribution: Theory and Engineering Application," IEEE Trans. on Systems, Man, and Cybernetics, Vol. 37, No. 1, pp. 154-165, Feb. 2007.
- Quijano, Nicanor, Passsino, Kevin M., "Honey Bee Social Foraging Algorithms for Resource Allocation: Theory and Application," Engineering Applications of Artificial Intelligence, Vol. 23, pp. 845-861, 2010


Illness, Suffering, Technology Helpers
Bipolar Spectrum Disorders (BD-I, MDD, etc.):
- Mathematical modeling of dynamics
- Stability analysis, feedback control design, optimization-based analysis
- Preliminary report:
- K. Passino, "A Dynamical Model of Mood Disorders for Psychoeducation: Preliminary Results", Seminar, OSU Dept. Psychiatry, Dec. 2, 2015
- Hugo Gonzalez Villasanti and Kevin M Passino, “Modeling and Analysis of Mood Dynamics in the Bipolar Spectrum,” IEEE Trans. Computational Social Systems, Vol. 7, No. 6, pp. 1335-1344, Dec. 2020.
Feedback Control for Depression (in progress):
- Sense via EEG, frontal alpha asymmetry (used in neurofeedback for depression), and HR/HRV, and modulate sound and light (perhaps current in the future, induced vibrations of the vagus nerve externally).
- Develop feedback controllers, learning methods ("on-line machine learning").
Adolescent Depression and Anxiety (App development):
- With Prof Scottye Cash, College of Social Work, and the student organization "Code 4 Community" led by Megan Knox.
- Funded by the Battelle Engineering, Technology, and Human Affairs endowment.
- An assistant/information source for adolescents with depression and anxiety, particularly at Star House (for homeless youth).
- App programming/development.
Methods for individual/group stress reduction:
- Sensors: HRV, EEG
- Inputs: Music, light, VR, adaptive ambience
- Strategy: (i) feedback control of light/sound at individual/room level; (ii) VR: Mindfulness, gratitude, guided imagery
Stress Reduction with Music Modulation
- Focus on individuals.
- Sensor: PPG, compute HRV (SDNN)
- Input: Tempo-modulated music, via feedback of stress
- Controller: Proportional-integral (PI)
- Results: Feedback control reduces stress during a type of Stroop test, where music or no-music results in increases in stress.
Identifying Child Isolation in a Preschool Classroom
- Isolation seems to occur due to choices by a child (move away from group, draw inward) or due to exclusion by other children. Each may cause stress in the child.
- Computer vision approaches to detect and identify cases where children are isolated by physical distances.
- Results: Use of an isolation/social clustering score, some validation that it succeeded.
Adaptive Ambience for the Classroom:
- College of Engineering / Schoenbaum Famiy Center collaboration, focus on preschool classrooms, toxic stress due to childhood trauma
- Funded by the Battelle Engineering, Technology, and Human Affairs endowment.
- Sense child HRV (watches), algorithmic computations (controller), and modulation of ambient light and sound for stress reduction. Also, sense child voice and location (see above).
- In progress, led by Dr. Hugo Gonzalez Villasanti at SFC, Crane Research Ctr.
PTSD:
- Understanding symptoms, prevalence, treatment methods, and neuroscience
- Research on novel treatment methods based on coordinated sound/light modulation.
- In collaboration with McKayla Tassy, neuroscience major
Attention science, ADHD:
- Dynamics, modeling, analysis, control
- Stress reduction via attention training/mindfulness
- ADHD: Training based on feedback control, sensing focus via signal processing of EEG, control of graphics on a computer screen
Focus: Addiction:
- Modeling, analysis, and technological intervention design for social (binge) drinking, especially for college-aged students.
- A systems and control theoretic approach to understand group drinking.
Individual Drinking (in progress):
- Estimation of BAC (level of intoxication) from phone data and a biosensor.
- Technology implementation
Publications on Social Binge Drinking:
- Luis Felipe Giraldo, Kevin M. Passino, and John D. Clapp, "Modeling and Analysis of Group Dynamics in Alcohol-Consumption Environments," IEEE Transactions on Cybernetics, Vol. 47, No. 1, pp. 165-176, January 2017.
- Luis Felipe Giraldo, Kevin M. Passino, John D. Clapp, and Danielle Ruderman, “Dynamics of Metabolism and Decision Making During Alcohol Consumption: Modeling and Analysis,” IEEE Transactions on Cybernetics, Vol. 47, No. 11, pp. 3955-3966, Nov. 2017.
- Clapp, J. D., Madden, D. R., Gonzalez Villasanti, H. J., Giraldo, L. F., Passino, K. M., Reed, M. B., & Fernandez Puentes, I. (In press). A System Dynamics Model of Drinking Events: Multi-Level Ecological Approach. Systems Research and Behavioral Science.
- Gonzalez Villasanti, H. J., Passino, K. M., Clapp, J. D., Madden, D. R., "A Control-Theoretic Assessment of Interventions During Drinking Events," To appear, IEEE Trans. on Cybernetics, 2018.
Poverty and Suffering:
- Poverty alleviation and "human development" per the UN definitions.
- Not necessarily a mental health connection, but a general well-being issue with a frequent connection to suffering and stress.
Humanitarian Engineering: Advancing Technology for Sustainable Development:
Publications on Feedback Control for Poverty Alleviation:
- Hugo Gonzalez Villasanti and Kevin M. Passino, “Feedback Controllers as Financial Advisors for Low-Income Individuals,” IEEE Trans. on Control Systems Technology, Vol. 25, No. 6, pp. 2194-2201, Nov. 2017.
- Luis Felipe Giraldo and Kevin M. Passino, “Dynamics of Cooperation in a Task Completion Social Dilemma,” PLOS ONE, Vol. 12, No. 1, Jan. 26, 2017 (a study of community participation principles).
- Cooperative management of community technology, see book.
- Hugo Gonzalez Villasanti, Felipe Giraldo, Kevin M Passino, “Feedback Control Engineering for Cooperative Community Development,” IEEE Control Systems Magazine, June 2018.
- Other: Computational analysis of democracy/wealth distribution, nonlinear stability analysis of poverty traps and technology diffusion, sensitivity and optimality analysis of models of economic growth for choosing development investment strategies; see book.
Team
Faculty/Clinicians:
- Dr. Ted Beauchaine, OSU Dept. Psychology (past)
- Dr. Daniel Strunk, OSU Dept. Psychology (past)
- Dr. Emre Ertin, Dept. Electrical and Computer Engineering, OSU
- Dr. John Clapp, School of Social Work, Univ. of Southern California (past)
- Dr. Matt Lewis, Advanced Computing Center for the Arts and Design (ACCAD), OSU
- Dr. Scottye Cash, OSU College of Social Work
Schoenbaum Family Center (SFC) Initiative:
- Dr. Laura Justice, Director, SFC, and Dr. Hugo Gonzalez: Crane Center for Early Childhood Research and Policy at the Schoenbaum Family Center; Anneliese Johnson, MS, Principal, Oliva Diaz Melgarejo, ATT, Lead Teacher, Preschool; Sophie Rogers School for Early Learning at the Schoenbaum Family Center, OSU College of Education and Human Ecology.
- Dr. Shelby Spare Werner, Bethel Olentangy Psychological Services, Columbus.
Student Organizations:
- OSU "Code 4 Community," Dept. Computer Science and Engineering
Jiaqi Zheng

- Light control from computers (e.g. via Matlab)
- iOS app for control of light and sound for ambience
Kevin Everson

- EEG for sensing brain waves
- Music/sound modulation for emotion and stress regulation
Morgan Ketchum

- Interface coding/design for ADHD training
- Interface to EEG
Katerine Guerrero Montero (Visiting Scholar, Univ. Pont. Javeriana, Cali, Colombia)

- Network theory, homophilic networks
- Application: Brain connectivity modeling and analysis
Andrés Pantoja (Visiting Professor, Fulbright, Univ. de Nariño, Colombia)

- Heart rate variability sensor, sound/music modulation
- Feedback control strategies for stress reduction
Sarah Matthiesen

- Heart rate variability sensor, color light control
- Feedback control strategies for stress reduction
Evan Hamamoto

- Real-time estimation of frontal alpha asymmetry from EEG data
- Feedback control for alpha symmetrty using music and light modulation
Jack Davidson (Summer visitor from Rose-Hulman Institute of Technology, IN)

- Hardware/software for feedback control for depression
- Design and implement wireless (bluetooth) device for controlling current applied at the skin to effect frontal lobe alpha-asymmetry.
McKayla Tassy

- Neuroscience, behavioral and systems
- PTSD, treatment
Locke Wang

- Stress reduction, heart rate variability
- HRV-modulated virtual reality for stress reduction
Zhimin Chen

- Training for ADHD
- Feedback contro methods, machine learning
Eugene No
- Feedback control for depression
- Use of HRV and EEG signals, modulated music
Feifan Jia

- Natural language processing, real-time
- Child language processing to text, use of cloud services
Zhenghao Zhao

- Stress reduction, heart rate variability
-
HRV-modulated virtual reality for stress reduction
Agnibh Dey

- Estimating focus level from EEG signals
- ADHD training
Andrew Fu

- ECG for heart rate and heart rate variability sensing, automatic modulation of music teatures for stress reduction
- Application to group stress reduction in a preschool classroom at the OSU Schoenbaum Family Center
Joseph ("Joey") Chiu

- People location, velicty, and acceleration tracking
- Application to location tracking of children in a preschool classroom at the OSU Schoenbaum Family Center
Zhongjun Hu

- Signal processing and analysis of heart rate variability and stress
- Implementation and testing of feedback controllers for stress control
Haifan Zhang

- Signal processing for heart rate variability data for a group of children/teachers in a classroom
- Statistical analysis of relations between stress and child characteristics (via CBQ)
Sri Harini Balaji

- Signal processing and analysis for HRV
- Feedback control of stress by modulating tempo of music
Conference
Sponsors
- "Penetrating the classroom social network for children with language impairment via peer-mediated intervention," National Institutes of Health, L. Justice, PI, 2020-2023
- "Adaptive Ambience Technology in the Preschool Classroom for Children Exposed to Trauma," Battelle Engineering, Technology, and Human Affairs Endowment Award
- "MindUp! A Mental Health App to Support Homeless Youth’s Mental Health," Battelle Engineering, Technology, and Human Affairs Endowment Award
- OSU Dept. Electrical and Computer Engineering
- OSU Provost's Office