DISCLAIMER: This is a research prototype, shared online only to demonstrate a potential user-interface and transparent AI model framework for explainable fact-checking. The results provided by this research prototype may be incorrect, and users are encouraged to consult other resources and services to meet their trusted fact-checking needs.
News Source | Source Reputation (Interactive) | News Article Headline (links) | Stance of Article Towards Claim (Interactive) |
---|---|---|---|
www.cochrane.org |
Unreliable
Mixed
Reliable
|
Is chloroquine or hydroxychloroquine useful in treating people with COVID-19, or in preventing infection in people who have been exposed to the virus? |
Deny
Neutral
Support
|
victr.vumc.org |
Unreliable
Mixed
Reliable
|
COVID-19 FAQ for the Community |
Deny
Neutral
Support
|
www.medicalnewstoday.com |
Unreliable
Mixed
Reliable
|
WHO 'strongly' against hydroxychloroquine use for COVID-19 prevention |
Deny
Neutral
Support
|
www.nih.gov |
Unreliable
Mixed
Reliable
|
Hydroxychloroquine doesn't benefit hospitalized COVID-19 patients |
Deny
Neutral
Support
|
jamanetwork.com |
Unreliable
Mixed
Reliable
|
Misguided Use of Hydroxychloroquine for COVID-19 |
Deny
Neutral
Support
|
We conducted a lab-based eye-tracking study to investigate how interactivity of an AI-powered fact-checking system affects user interactions. A within-subject experiment was conducted, where participants used an interactive and a non-interactive version of a mock AI fact-checking system, and rated their perceived correctness of COVID-19 related claims. We collected web-page interactions, eye-tracking data, and mental workload using NASATLX. We found that the presence of the affordance of interactively manipulating the AI system’s prediction parameters affected users' dwell times, and eye-fixations on AOIs, but not mental workload. In the interactive system, participants spent the most time evaluating claims' correctness, followed by reading news. This promising result shows a positive role of interactivity in a mixed-initiative AI-powered system.