Conversation is never just about the words you say - everything from the tone and volume, to body language and gaze are just as important.
These non-verbal communication signals can be easily misinterpreted, even more so for people with anxiety or Asperger’s. This prompted a team at Massachusetts Institute of Technology to build a smartwatch app that detects the mood behind a conversation.
How does it work? Well, we start with an algorithm created by researchers Tuka Alhanai and Mohammad Mahdi Ghassemi - which is built into a Samsung Simband fitness tracker for this research.
It can analyse speech and tone (all of which was recorded with an iPhone 5S), crunch that data and detect what the person is feeling for every five seconds of conversation, essentially telling the user whether that piece of dialogue was happy or sad.
This info was paired with what else could be taken via the various sensors on the fitness band - heart rate, skin temperature, fidgeting movements, etc.
To test this, subjects wore the band and were asked to tell a story, inflecting different emotions throughout. Overall, this algorithm was able to determine the correct emotion with 83% accuracy.
While this AI is rough around the edges - making basic conclusions such as long-drawn-out monotonous conversation meaning sad - it’s clear the team are really onto something here.
“Imagine if, at the end of a conversation, you could rewind it and see the moments when the people around you felt the most anxious,” says graduate student Tuka Alhanai. “Our work is a step in this direction, suggesting that we may not be that far away from a world where people can have an AI social coach right in their pocket.”
Findings will be presented at next week’s Association for the Advancement of Artificial Intelligence (AAAI) conference in San Francisco - but you can get a look at this tech in action just below.
In a world of ugly fitness trackers, can the Misfit Phase back up its seriously good looks with the capability to track your daily life goals? Find out in my review...
Ten years on from the original, Apple announced three phones - iPhone 8, iPhone 8 Plus and iPhone X. Which one should you buy?
After ten years of iPhone, Apple is set to take the biggest leap forward in design, specs and price. Here are eight of the rumours that I’m pretty sure will be reality.
So you’ve made the decision to jump into the world of PC gaming… You’ve made the right call, but it’s dangerous to go alone – take this guide to spec your monster for play through perfection!
It looks like I ruffled some feathers with my previous post about why people should just let the headphone jack die - with many of you voicing your own opinions in the comments. This has been a great dialogue to see, and I've picked some to respond to.
Can we please just realise that the headphone jack is outdated and should have been killed off a while ago?
As a human, you will experience highs and lows in life – success, failure, love, loss and much more. How do we cope with turbulent times? Well, let me be the one to say the answer is not inspirational memes.
Watching one YouTuber react to Jake Paul and his dad taking part in kissing competition by kissing the same 18-year-old girl made me realise one thing – YouTube is fucked beyond repair.
Radio listeners are dropping off a cliff, and it’s obvious the world is turning to podcasting for their audio-based entertainment – the democratising platform that is slowly (but surely) being led by Anchor.
Self-driving cars are the future, but are humans ready for them? The answer is a resounding “no,” and you shouldn’t expect to see them for a long time…
I am the Founder and Editor-in-chief of New Rising Media. You can follow me on Twitter @MrJasonEngland.