Birds of a feather don't fact-check each other: Partisanship and the evaluation of news in Twitter's Birdwatch crowdsourced fact-checking program

Jennifer Allen, Cameron Martel, David G Rand
2022 CHI Conference on Human Factors in Computing Systems  
There is a great deal of interest in the role that partisanship, and cross-party animosity in particular, plays in interactions on social media. Most prior research, however, must infer users' judgments of others' posts from engagement data. Here, we leverage data from Birdwatch, Twitter's crowdsourced fact-checking pilot program, to directly measure judgments of whether other users' tweets are misleading, and whether other users' free-text evaluations of thirdparty tweets are helpful. For both
more » ... sets of judgments, we fnd that contextual features -in particular, the partisanship of the usersare far more predictive of judgments than the content of the tweets and evaluations themselves. Specifcally, users are more likely to write negative evaluations of tweets from counter-partisans; and are more likely to rate evaluations from counter-partisans as unhelpful. Our fndings provide clear evidence that Birdwatch users preferentially challenge content from those with whom they disagree politically. While not necessarily indicating that Birdwatch is inefective for identifying misleading content, these results demonstrate the important role that partisanship can play in content evaluation. Platform designers must consider the ramifcations of partisanship when implementing crowdsourcing programs. CCS CONCEPTS • Human-centered computing → Empirical studies in collaborative and social computing; Social media; • Information systems → Crowdsourcing.
doi:10.1145/3491102.3502040 fatcat:3gimurufpbamdhdtt4eudh6dym