Project number
25041
Organization
Kidney ADVANCE Project - NIH/ACABI
Offering
ENGR498-F2024-S2025
Demand for primary health care is increasing as the population ages. Fewer medical doctors are available per patient, and the extensive manual data entry required by current electronic health record systems results in less time for meaningful patient interactions. Since a diagnosis is often determined by careful observation of verbal and nonverbal cues, these shorter appointment times can result in missed diagnoses. Therefore, a system that automates observation and documentation to enhance
diagnostic accuracy and improve clinical efficiency provides value.
The team’s solution to this problem is a portable kit equipped to capture and record both visual and auditory data. Integrated software processes the data and provides suggestions for diagnosis. To do this, the audio analysis system first distinguishes speech between the clinician and patient, analyzes speech for diagnostic clues, and assesses the patient’s emotions based on verbal cues. Next, facial analysis detects any abnormalities in facial structure and determines the patient’s predominant emotions throughout a visit. Finally, the motion analysis takes in video of the patient’s movement during the visit and analyzes their gait, speed and sit-to-stand values. After recording and analysis, the system transfers the data into a final report with a summary of findings. The kit can accomplish this during the patient’s visit, allowing the physician to take this information into account while forming a diagnosis.
diagnostic accuracy and improve clinical efficiency provides value.
The team’s solution to this problem is a portable kit equipped to capture and record both visual and auditory data. Integrated software processes the data and provides suggestions for diagnosis. To do this, the audio analysis system first distinguishes speech between the clinician and patient, analyzes speech for diagnostic clues, and assesses the patient’s emotions based on verbal cues. Next, facial analysis detects any abnormalities in facial structure and determines the patient’s predominant emotions throughout a visit. Finally, the motion analysis takes in video of the patient’s movement during the visit and analyzes their gait, speed and sit-to-stand values. After recording and analysis, the system transfers the data into a final report with a summary of findings. The kit can accomplish this during the patient’s visit, allowing the physician to take this information into account while forming a diagnosis.