How To Integrate Multimedia For Effective Learning

Integrating the multimedia assets of a course can raise a host of issues. In my world, this can be as simple as explaining to a client why screens of text with an out-of-sync voice over will not be effective—to more complex issues, such as determining whether an animation will promote greater comprehension than a series of stills.

Although we know it can be advantageous to present content through multiple forms of media, the big question is how to integrate the mediums.

When deciding on these issues, I use two principles from cognitive science as guidelines that I think you’ll find helpful too. One is known as the Split-attention Effect and the other is the Redundancy Principle. Both principles are important.

Split-attention Effect

Separating a visual from text can be cognitively demanding. Click for original.

The split-attention effect occurs when a person is required to process two or more varied sources of information simultaneously, either of which can’t be understood in isolation. A typical way this occurs in online learning is when an explanation is displayed on one part of the screen, while a visual, such as a diagram or animation, is presented on another part of the screen.

See the example showing the effects of secondhand smoke, produced by the Centers for Disease Control, on the right. Although the animation is well-done, the viewer must hold the textual explanation in working memory, while engaging with the visual.

This type of cognitively demanding task will result in losing some of the information needed to understand both sources of content, causing difficulties in processing the material. To compensate, most people will shift their attention back and forth, which many find frustrating.

The Fixes

Integrate Text with Animation—Carefully

The main fix for avoiding the split-attention effect is to integrate the media so that learners don’t need to process disparate sources of information simultaneously. For example, in the sample referred to above, the textual explanation could be entirely removed from the visual and replaced as short phrases directly in the animation, as shown in the mock-up here.

Be careful that the viewer doesn’t miss the animation while reading the on-screen text. As a safeguard, you can briefly slow down or stop the animation while text is displayed. In addition, adding user controls will make an animation a more effective instructional format.

Replace One Modality with Another

Another integration approach that may be more effective is to replace one modality with another. For example, the text-based explanation could be replaced with well-synchronized audio. Research shows this to be quite effective for learning. When using mixed modalities, learners don’t need to make a huge effort to integrate the information. It’s done for them in the media itself.

The Redundancy Principle

There is one word of caution when integrating different mediums—avoid redundant content. Redundancy occurs when the same information is presented in multiple formats. The redundancy effect reduces rather than increases learning because redundancy places unnecessary demands on one’s cognitive resources. For example, when displaying graphics, avoid using text when a narrated voice over is playing. Otherwise, learners will most likely read the text and miss some of the audio. Rather than using text to call attention to a specific part of a graphic, a simple pointer or other visual cue should suffice.

If you find it difficult to remember all of these guidelines, simply put yourself in the place of the learner or viewer. Notice the cognitive effort that’s required to perceive, process and comprehend the content you’re presenting. This will give you a sense of which approaches cause cognitive overload and which approaches are well-integrated and promote learning.

Related Articles:
Using Graphics To Improve Learning
Learning Theory And Multimedia

Book Recommendation:
Multimedia Learning by Richard E. Mayer

Related Posts Plugin for WordPress, Blogger...


  1. Kevin Thorn says

    Hi Connie,

    Great example on the two cognitive science principles. The juxtaposition of text/images and/or other media is often over-thought or worse, under-thought.

    To your point, I enjoyed the animation example, but I watched the entire clip and found myself switching from watching to reading through the duration. It wasn’t until the end did I realize I needed to manually click the arrows (1 of 4) to proceed through the text. After reading the four text screens, I played the animation again to get the “full” impact of what was intended.

    Agreed…professional animation, but not much thought went into instruction.

    Great tips!

  2. Connie Malamed says

    Thanks for your comments, Pedro and Kevin. It wasn’t hard to find examples that cause the split attention effect. Not because artists and animators don’t care, but because this information isn’t widely known. The whole thing can be rather confusing if you’re not plugged into the learning field.


  3. Michael says

    I always find your posts to be very helpful and informative! I always share some of your posts with my e-learning colleagues.

    Keep them coming!

  4. Verónica says

    I agree with all of the above comments: your posts are always very useful with interesting tips to keeps in mind,
    thank you very much
    I loved this post about split-attenction affect!

  5. April Hayman says

    HI Connie!

    Do you think there is any value add in giving learners a “take away” like a PDF of the highlights from the learning activity?


  6. Sangish says

    Hi Connie
    May I know the date when this article was published because I want to reference it for my assignment


Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>