
One of the first things an instructional designer may learn and follow is Mayer’s principles of multimedia learning. Observing these guidelines is somewhat akin to pledging allegiance to the field of instructional design.
One of the most frequently quoted principles is the modality principle: People learn more deeply from pictures and spoken words than from pictures and printed words. The rationale is that graphics and printed text both require visual processing, which can overload working memory. Therefore, replacing printed text with narration can distribute processing demands across both visual and auditory channels, lightening the cognitive load.
But the modality principle is not a universal law. Researchers, including Mayer, have identified a number of factors that influence the modality effect. Depending on the learner, the material’s complexity, and how instruction is presented, the advantage of narration may weaken, disappear, or even reverse.
Understanding these nuances will help learning professionals make more informed design decisions. Here are six conditions in which the modality effect may fail to provide benefit and could even detract from learning.
1. When learners cannot access spoken information
The modality principle cannot be applied without an accessible alternative when learners cannot access audio. For learners who are deaf or hard of hearing, essential spoken information must be available in an accessible form, such as captions or transcripts.
2. When learners control the pace
Instructional pacing is an important boundary condition that influences the modality effect. Early research used system-paced presentations in which learners could not control the duration or speed of delivery. In those conditions, narration can reduce competition for visual processing resources. However, when learners can control the pace they may pause, re-read, examine a graphic, or navigate between sections. Under those conditions, the modality effect may disappear or reverse in favor of printed text.
3. When learners cannot easily understand spoken information
Written text may make unfamiliar words easier to recognize and review at their own pace for learners who are not fluent in the language of instruction. It is important to provide alternatives to narration rather than assuming spoken explanations will benefit everyone.
4. When the spoken explanation is complex or long
When listening to spoken explanations, learners must retain earlier information while processing what comes next. As text length and grammatical complexity increase, a spoken presentation can detract from learning. Long narrated explanations overload working memory because auditory information is transient. For lengthy or complex explanations, consider presenting essential information in writing so learners can review it as needed.
5. When the material has low element interactivity
Element interactivity occurs when a person must learn and process multiple pieces of information at the same time because they depend on each other. High element interactivity increases working memory demands. In general, the modality effect is greater when materials have high element interactivity. The modality effect tends to be smaller when materials have low element interactivity.
6. When the explanation includes unfamiliar specialized terms, symbols, or is needed for future reference.
Another boundary condition occurs when an explanation uses technical or specialized terms or the information will serve as a reference. Seeing these in writing can support accurate identification and repeated inspection. Mayer explicitly identifies this as a situation where printed words may be appropriate.
Conclusion
The modality principle is a foundational concept in multimedia learning. Understanding the conditions that influence its effect can help learning professionals determine when spoken narration is likely to benefit learners and when it has no advantage. Consider these questions during analysis and design to ensure the modality principle will assist learning.
- How much prior knowledge do learners have?
- How many interacting elements must they process?
- Can learners control the pace and revisit information?
- Does the explanation contain information that needs repeated inspection?
- What accessibility and language supports are needed?
See Applying Richard Mayer’s Cognitive Theory of Multimedia Learning.
References
- Clark, R. C., & Mayer, R. E. (2011). E-Learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia Learning (3rd ed.). San Francisco, CA: John Wiley & Sons.
- Cromley, J. G., & Chen, R. (2025). A meta-analysis of Richard Mayer’s multimedia learning research: Searching for boundary conditions of design principles across multiple media types. Educational Research Review, 49, Article 100730.
- Juan Cristobal Castro-Alonso, & Sweller, J. (2021). The modality principle in multimedia learning. Cambridge University Press eBooks, 261–267. https://doi.org/10.1017/9781108894333.026

Leave a Reply