UI & Claim ID: A_1006

Interactive Fact-checker Interface (Participant View):

Claim: Disposable medical face masks can be reused

News Source Source Reputation (Interactive) News Article Headline (links) Stance of Article Towards Claim (Interactive)
www.umass.edu
Unreliable
Mixed
Reliable
Value: 1.0
Urgent Research Shows Face Masks Can Be Safely Reused by Pandemic Medical Workers
Deny
Neutral
Support
Value: 1.0
www.fda.gov
Unreliable
Mixed
Reliable
Value: 1.0
Shortages of Face Masks, Surgical Masks, and Respirators During the COVID-19 Pandemic
Deny
Neutral
Support
Value: -0.5
apnews.com
Unreliable
Mixed
Reliable
Value: 1.0
FDA: N95 masks, now plentiful, should no longer be reused
Deny
Neutral
Support
Value: -1.0
news.err.ee
Unreliable
Mixed
Reliable
Value: 1.0
Tartu researchers prove disposable masks can be reused
Deny
Neutral
Support
Value: 1.0
www.narayanahealth.org
Unreliable
Mixed
Reliable
Value: 0.0
KNOW ABOUT PROPER USAGE, DISPOSAL AND REUSE OF MASK
Deny
Neutral
Support
Value: 0.0

Predicted Correctness

True (0%)
False (0%)



Navigation: Change Interface or See a Different Claim


About


GitHub

Click the link below to access the data used for conducting the user study.

Abstract

We conducted a lab-based eye-tracking study to investigate how interactivity of an AI-powered fact-checking system affects user interactions. A within-subject experiment was conducted, where participants used an interactive and a non-interactive version of a mock AI fact-checking system, and rated their perceived correctness of COVID-19 related claims. We collected web-page interactions, eye-tracking data, and mental workload using NASATLX. We found that the presence of the affordance of interactively manipulating the AI system’s prediction parameters affected users' dwell times, and eye-fixations on AOIs, but not mental workload. In the interactive system, participants spent the most time evaluating claims' correctness, followed by reading news. This promising result shows a positive role of interactivity in a mixed-initiative AI-powered system.

Publications

Previous and current contributors

  • Matthew Lease
  • Anubrata Das
  • Li Shi
  • Nilavra Bhattacharya
  • Jacek Gwizdka
  • Brent Biglin
  • An Thanh Nguyen
  • Aditya Kharosekar
  • Saumyaa Krishnan
  • Siddhesh Krishnan
  • ChiaHui Liu
  • Shravan Ravi
  • Alex Swearingen
  • Elizabeth Tate
  • Jyothi Keshavan Vinjumur
  • Byron Wallace