Scientists have developed an automated personal-computer system that can help people enhance their social interaction skills. The programme called MACH, or “My Automated Conversation coacH” has been developed by researchers at Massachusetts Institute of Technology (M.I.T) mainly to help those who suffer from social phobia linked to autism.
It uses a computer-generated face that simulates a conversation. Using a standard web camera, MACH scans facial expressions, listens carefully to patterns of speech, and reads behavioural cues. It keeps track of weak language, like utterances of ’Mmm’, ‘Uhh’, and ‘Basically’ and provides feedback about how effectively the user has been communicating.
The software plays back a video of their speech, alongside charts monitoring intonation, head movements, and other coded gestures.
“MACH must appear and behave humanlike, adapting its behaviours to changes in the interaction,” researchers said in their paper to be presented at UbiComp conference in Zurich this month.
To achieve that level of realism, the animation of the virtual coach incorporates arm and posture movements, facial expressions, gaze behaviour and lip synchronisation.
The software was constructed over two years and tested on 90 M.I.T undergraduates seeking to improve their self-presentation in front of prospective employers, New Yorker magazine reported.
The team’s paper stated that MACH led to a significant improvement in social interaction, based on a before-and-after evaluation of subjects by a professional career counsellor.
Beyond job interviews, the programme could be useful for helping people with social phobia linked to autism- the root of the project - as well as public speaking or even dating, according to Ehsan Hoque, who led the research.
While the prototype runs locally on computers, Mr. Hoque, who is now at the University of Rochester, would like to make it widely available online, which he said would take between six months and a year for two or three engineers to develop.
