When Artificial Intelligence goes psycho

MIT researchers explain potential dangers of biased data in machine learning

June 12, 2018 11:06 pm | Updated 11:06 pm IST - San Francisco

Researchers have named the psychopathic AI Norman.

Researchers have named the psychopathic AI Norman.

No, it’s not a new horror film. It’s Norman: also known as the first psychopathic Artificial Intelligence, just unveiled by U.S. researchers.

The goal is to explain in layman’s terms how algorithms are made, and to make people aware of AI’s potential dangers.

Norman “represents a case study on the dangers of Artificial Intelligence gone wrong when biased data is used in machine learning algorithms,” according to the prestigious Massachusetts Institute of Technology (MIT). Pinar Yanardag, Manuel Cebrian and Iyad Rahwan, part of an MIT team, added: “There is a central idea in machine learning: the data you use to teach a machine learning algorithm can significantly influence its behaviour.”

“So when we talk about AI algorithms being biased or unfair, the culprit is often not the algorithm itself, but the biased data that was fed to it,” they said via email.

Hence the idea of creating Norman, which was named after the psychopathic killer Norman Bates in the 1960 Alfred Hitchcock film Psycho .

Scary results

Norman was “fed” only with short legends describing images of “people dying” found on the Reddit internet platform.

The researchers then submitted images of ink blots, as in the Rorschach psychological test, to determine what Norman was seeing and compare his answers to those of traditionally trained AI. The results are scary, to say the least: where traditional AI sees “two people standing close to each other,” Norman sees in the same spot of ink “a man who jumps out a window.”

And when Norman distinguishes “a man shot to death by his screaming wife,” the other AI detects “a person holding an umbrella.”

0 / 0
Sign in to unlock member-only benefits!
  • Access 10 free stories every month
  • Save stories to read later
  • Access to comment on every story
  • Sign-up/manage your newsletter subscriptions with a single click
  • Get notified by email for early access to discounts & offers on our products
Sign in

Comments

Comments have to be in English, and in full sentences. They cannot be abusive or personal. Please abide by our community guidelines for posting your comments.

We have migrated to a new commenting platform. If you are already a registered user of The Hindu and logged in, you may continue to engage with our articles. If you do not have an account please register and login to post comments. Users can access their older comments by logging into their accounts on Vuukle.