Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

The reader as subjective entropy: a novel analysis of multimodal readability

The reader as subjective entropy: a novel analysis of multimodal readability The purpose of this study was to explore the viability of transinformation analysis as a multimodal readability metric. A novel approach was called for, considering that existing and established readability metrics are strictly used to measure linguistic complexity. Yet, the corpus of multimodal literature continues to grow, along with the need to understand how non-linguistic modalities contribute to the complexity of the reading experience.Design/methodology/approachIn this exploratory study, think aloud screen recordings of eighth-grade readers of the born-digital novel Inanimate Alice were analyzed for complexity, along with transcripts of post-oral retellings. Pixel-level entropy analysis served as both an objective measure of the document and a subjective measure of the amount of reader information attention. Post-oral retelling entropy was calculated at the unit level of the word, serving as an indication of complexity in recall.FindingsFindings confirmed that transinformation analysis is a viable multimodal readability metric. Inanimate Alice is an objectively complex document, creating a subjectively complex reading experience for the participants. Readers largely attended to the linguistic mode of the story, effectively reducing the amount of information they processed. This was also evident in the brevity and below average complexity of their post-oral retellings, which relied on recall of the linguistic mode. There were no significant group differences among the readers.Originality/valueThis is the first study that uses entropy to analyze multimodal readability. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Journal of Documentation Emerald Publishing

The reader as subjective entropy: a novel analysis of multimodal readability

Hovious, Amanda S.; O'Connor, Brian C.
Journal of Documentation , Volume 79 (2): 16 – Mar 6, 2023
Download PDF
16 pages

Loading next page...
 
/lp/emerald-publishing/the-reader-as-subjective-entropy-a-novel-analysis-of-multimodal-dHEF9KrNWg

References (26)

Publisher
Emerald Publishing
Copyright
© Emerald Publishing Limited
ISSN
0022-0418
DOI
10.1108/jd-04-2022-0094
Publisher site
See Article on Publisher Site

Abstract

The purpose of this study was to explore the viability of transinformation analysis as a multimodal readability metric. A novel approach was called for, considering that existing and established readability metrics are strictly used to measure linguistic complexity. Yet, the corpus of multimodal literature continues to grow, along with the need to understand how non-linguistic modalities contribute to the complexity of the reading experience.Design/methodology/approachIn this exploratory study, think aloud screen recordings of eighth-grade readers of the born-digital novel Inanimate Alice were analyzed for complexity, along with transcripts of post-oral retellings. Pixel-level entropy analysis served as both an objective measure of the document and a subjective measure of the amount of reader information attention. Post-oral retelling entropy was calculated at the unit level of the word, serving as an indication of complexity in recall.FindingsFindings confirmed that transinformation analysis is a viable multimodal readability metric. Inanimate Alice is an objectively complex document, creating a subjectively complex reading experience for the participants. Readers largely attended to the linguistic mode of the story, effectively reducing the amount of information they processed. This was also evident in the brevity and below average complexity of their post-oral retellings, which relied on recall of the linguistic mode. There were no significant group differences among the readers.Originality/valueThis is the first study that uses entropy to analyze multimodal readability.

Journal

Journal of Documentation – Emerald Publishing

Published: Mar 6, 2023

Keywords: Transinformation analysis; Information theory; Entropy; Multimodal readability

There are no references for this article.