Beyond the Medium: Rethinking Information Literacy through Crowdsourced Analysis

Olga Boichak, Jordan Canzonetta, Niraj Sitaula, Brian McKernan, Sarah Taylor, Patricia G.C. Rossini, B. A. Clegg, Kenski K, Rosa Martey, Nancy McCracken, Carsten Oesterlund, Roc Myers, James E. Folkestad, Jennifer Stromer-Galley

Research output: Chapter in Book/Entry/PoemConference contribution

171 Scopus citations


Information literacy encompasses a range of information evaluation skills for the purpose of making judgments. In the context of crowdsourcing, divergent evaluation criteria might introduce bias into collective judgments. Recent experiments have shown that crowd estimates can be swayed by social influence. This might be an unanticipated effect of media literacy training: encouraging readers to critically evaluate information falls short when their judgment criteria are unclear and vary among social groups. In this exploratory study, we investigate the criteria used by crowd workers in reasoning through a task. We crowdsourced evaluation of a variety of information sources, identifying multiple factors that may affect individual's judgment, as well as the accuracy of aggregated crowd estimates. Using a multi-method approach, we identified relationships between individual information assessment practices and analytical outcomes in crowds, and propose two analytic criteria, relevance and credibility, to optimize collective judgment in complex analytical tasks.
Original languageEnglish (US)
Title of host publicationProceedings of the 51st Hawaii International Conference on System Sciences
Number of pages10
StatePublished - 2019


Dive into the research topics of 'Beyond the Medium: Rethinking Information Literacy through Crowdsourced Analysis'. Together they form a unique fingerprint.

Cite this