• Home
  • Free Resources
    • Storyboard Depot
    • Instructional Design Programs
    • Best Photo Sites
    • Graphic Editing Tools
    • Icon Collections
  • My Books
  • About
  • Book Store
  • MASTERING INSTRUCTIONAL DESIGN

The eLearning Coach

For designing effective learning experiences

Connie Malamed
  • Podcasts
  • Career
  • LXD
  • eLearning Design
    • Audience
    • Instructional Design
    • Learning Objectives
    • Storyboarding
    • Tests
    • User Interface
  • eLearning 2.0
  • Cognition
  • Multimedia
    • Audio
    • Graphics
    • Video
  • Reviews
    • Book Reviews
    • Software Reviews
  • At Work
You are here: Home / Cognition / Nuances of the Modality Principle of Multimedia Learning

Nuances of the Modality Principle of Multimedia Learning

by Connie Malamed

""

One of the first things an instructional designer may learn and follow is Mayer’s principles of multimedia learning. Observing these guidelines is somewhat akin to pledging allegiance to the field of instructional design.

One of the most frequently quoted principles is the modality principle: People learn more deeply from pictures and spoken words than from pictures and printed words. The rationale is that graphics and printed text both require visual processing, which can overload working memory. Therefore, replacing printed text with narration can distribute processing demands across both visual and auditory channels, lightening the cognitive load.

But the modality principle is not a universal law. Researchers, including Mayer, have identified a number of factors that influence the modality effect. Depending on the learner, the material’s complexity, and how instruction is presented, the advantage of narration may weaken, disappear, or even reverse.

Understanding these nuances will help learning professionals make more informed design decisions. Here are six conditions in which the modality effect may fail to provide benefit and could even detract from learning.

1. When learners cannot access spoken information
The modality principle cannot be applied without an accessible alternative when learners cannot access audio. For learners who are deaf or hard of hearing, essential spoken information must be available in an accessible form, such as captions or transcripts.

2. When learners control the pace
Instructional pacing is an important boundary condition that influences the modality effect. Early research used system-paced presentations in which learners could not control the duration or speed of delivery. In those conditions, narration can reduce competition for visual processing resources. However, when learners can control the pace they may pause, re-read, examine a graphic, or navigate between sections. Under those conditions, the modality effect may disappear or reverse in favor of printed text.

3. When learners cannot easily understand spoken information
Written text may make unfamiliar words easier to recognize and review at their own pace for learners who are not fluent in the language of instruction. It is important to provide alternatives to narration rather than assuming spoken explanations will benefit everyone.

4. When the spoken explanation is complex or long
When listening to spoken explanations, learners must retain earlier information while processing what comes next. As text length and grammatical complexity increase, a spoken presentation can detract from learning. Long narrated explanations overload working memory because auditory information is transient. For lengthy or complex explanations, consider presenting essential information in writing so learners can review it as needed.

5. When the material has low element interactivity
Element interactivity occurs when a person must learn and process multiple pieces of information at the same time because they depend on each other. High element interactivity increases working memory demands. In general, the modality effect is greater when materials have high element interactivity. The modality effect tends to be smaller when materials have low element interactivity.

6. When the explanation includes unfamiliar specialized terms, symbols, or is needed for future reference.
Another boundary condition occurs when an explanation uses technical or specialized terms or the information will serve as a reference. Seeing these in writing can support accurate identification and repeated inspection. Mayer explicitly identifies this as a situation where printed words may be appropriate.

Conclusion

The modality principle is a foundational concept in multimedia learning. Understanding the conditions that influence its effect can help learning professionals determine when spoken narration is likely to benefit learners and when it has no advantage. Consider these questions during analysis and design to ensure the modality principle will assist learning.

  • How much prior knowledge do learners have?
  • How many interacting elements must they process?
  • Can learners control the pace and revisit information?
  • Does the explanation contain information that needs repeated inspection?
  • What accessibility and language supports are needed?

See Applying Richard Mayer’s Cognitive Theory of Multimedia Learning.

References

  1. Clark, R. C., & Mayer, R. E. (2011). E-Learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia Learning (3rd ed.). San Francisco, CA: John Wiley & Sons.
  2. Cromley, J. G., & Chen, R. (2025). A meta-analysis of Richard Mayer’s multimedia learning research: Searching for boundary conditions of design principles across multiple media types. Educational Research Review, 49, Article 100730.
  3. Juan Cristobal Castro-Alonso, & Sweller, J. (2021). The modality principle in multimedia learning. Cambridge University Press eBooks, 261–267. https://doi.org/10.1017/9781108894333.026

 

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Don’t Miss One Issue: The eLearning Coach Monthly Newsletter

the elearning coach monthly newsletter

LEARN MORE AND SIGN UP

Discover New Possibilities in Everyday Tools

Everyday Tools Event

Online Master’s Degree in Learning Design

u of san diego id program

Breaking Into an Instructional Design Career

The career and competencies. Where to network, find job boards, and more.

eBook Cover
Click the image to buy the book.

SITE MENU

Home
Resources
My Books
About
Book Store
Membership Community

TOPIC MENU

Podcasts
LXD
eLearning Design
eLearning 2.0
Cognition
Multimedia (Graphics & Audio)
Reviews
At Work

RESOURCES

Storyboard Depot
Instructional Design Programs
Best Stock Images
PowerPoint Grids
eLearning Examples
Glossary of Online Learning
Graphic Editing Tools
Icon Collections

© Copyright 2023 Connie Malamed · All Rights Reserved