People trust human-generated profiles more than artificial intelligence-generated profiles, particularly in online marketplaces, reveals a study in which researchers sought to explore whether users trust algorithmically optimised or generated representations.
The research team conducted three experiments, particularly in online marketplaces, enlisting hundreds of participants on Amazon Mechanical Turk to evaluate real, human-generated Airbnb profiles. When researchers informed them that they were viewing either all human-generated or all AI-generated profiles, participants didn’t seem to trust one more than the other. They rated the human and AI-generated profiles about the same.
That changed when participants were informed they were viewing a mixed set of profiles. Users then distrusted the ones they believed to be machine-generated.
“Participants were looking for cues that felt mechanical versus language that felt more human and emotional,” said Maurice Jakesch, a doctoral student in information science at Cornell Tech in America. “The more participants believed a profile was AI-generated, the less they tended to trust the host, even though the profiles they rated were written by the actual hosts.”
“We’re beginning to see the first instances of artificial intelligence operating as a mediator between humans, but it’s a question of: Do people want that?”
The study suggests that there are ways to design AI communication tools that improve trust for human users. “Design and policy guidelines and norms for using AI-mediated communication is worth exploring now,” said Ms. Jakesch.
