UI & Claim ID: A_2012

Interactive Fact-checker Interface (Participant View):

Claim: Covid vaccine could alter your DNA

News Source Source Reputation (Interactive) News Article Headline (links) Stance of Article Towards Claim (Interactive)
www.forbes.com
Unreliable
Mixed
Reliable
Value: 1.0
Covid-19 Vaccines Can't Alter Your DNA, Here's Why
Deny
Neutral
Support
Value: -1.0
www.health.gov.au
Unreliable
Mixed
Reliable
Value: 1.0
Is it true? Can COVID-19 vaccines alter my DNA?
Deny
Neutral
Support
Value: -1.0
www.gavi.org
Unreliable
Mixed
Reliable
Value: 0.0
Will an mRNA vaccine alter my DNA?
Deny
Neutral
Support
Value: -1.0
www.cdc.gov
Unreliable
Mixed
Reliable
Value: 1.0
Understanding mRNA COVID-19 Vaccines
Deny
Neutral
Support
Value: -1.0
www.bbc.com
Unreliable
Mixed
Reliable
Value: 1.0
Vaccine rumours debunked: Microchips, 'altered DNA' and more
Deny
Neutral
Support
Value: -1.0

Predicted Correctness

True (0%)
False (0%)



Navigation: Change Interface or See a Different Claim


About


GitHub

Click the link below to access the data used for conducting the user study.

Abstract

We conducted a lab-based eye-tracking study to investigate how interactivity of an AI-powered fact-checking system affects user interactions. A within-subject experiment was conducted, where participants used an interactive and a non-interactive version of a mock AI fact-checking system, and rated their perceived correctness of COVID-19 related claims. We collected web-page interactions, eye-tracking data, and mental workload using NASATLX. We found that the presence of the affordance of interactively manipulating the AI system’s prediction parameters affected users' dwell times, and eye-fixations on AOIs, but not mental workload. In the interactive system, participants spent the most time evaluating claims' correctness, followed by reading news. This promising result shows a positive role of interactivity in a mixed-initiative AI-powered system.

Publications

Previous and current contributors

  • Matthew Lease
  • Anubrata Das
  • Li Shi
  • Nilavra Bhattacharya
  • Jacek Gwizdka
  • Brent Biglin
  • An Thanh Nguyen
  • Aditya Kharosekar
  • Saumyaa Krishnan
  • Siddhesh Krishnan
  • ChiaHui Liu
  • Shravan Ravi
  • Alex Swearingen
  • Elizabeth Tate
  • Jyothi Keshavan Vinjumur
  • Byron Wallace