All articles

Let learners see the speaker while they listen

7 October 2026

Choc Education


A project update on video gives a listener more than words. The speaker looks toward a chart, pinches two fingers together to show a small difference, and pauses with raised eyebrows before inviting a response, all while the words continue at their ordinary pace. Strip away the picture and those signals disappear. Listening lessons should often let learners see the person speaking, because ordinary face-to-face comprehension uses eyes as well as ears.

Audio still has a job.

The picture carries language-relevant evidence

Visible movement can identify a referent, mark emphasis, show stance, or signal that a turn is ending. A learner who misses the verb in “sales edged up” may still connect the phrase with a small rising hand movement. Lip and jaw movement can also narrow an uncertain sound. None of this makes the acoustic signal optional. It gives the listener another source of evidence while speech keeps moving.

Sueyoshi and Hardison tested this with 42 low-intermediate and advanced learners of English. Participants watched or heard a videotaped lecture in one of three conditions: the speaker’s face and gestures, the face without gestures, or audio alone. Both proficiency groups answered more multiple-choice questions correctly when visual cues were available. The lower-level group scored highest with face and gestures. The advanced group scored highest with the face-only version.

That split matters. More movement did not help every listener in the same way. The study used one lecture, three conditions, and a comprehension test rather than a semester of instruction. It supports using visible cues as part of listening material. It cannot support a promise that any colourful video will improve listening.

Watching is a skill too

Putting a video on screen does not guarantee that learners will use it. In a study of video listening tests, Elvis Wagner recorded where test takers looked. They watched the video less than half of the available time, and viewing time had a weak negative relation with test scores. Stronger listeners may have needed the image less, or frequent movement between questions and screen may have cost attention. The design does not settle the cause.

An earlier verbal-report study followed eight advanced ESL learners. They differed in how they noticed and used non-verbal information. One learner could connect a gesture with a spoken contrast while another treated the same motion as background. “Watch the clip” is too vague an instruction.

Give the eyes a task. Before replaying a 74-second workplace clip, ask learners to mark the moment when the speaker changes from reporting a problem to proposing a solution. On the next viewing, ask which gesture points back to the earlier chart. These are comprehension decisions, not a hunt for decorative details.

I would rather use one short clip twice than play six minutes once. The first viewing can establish the situation. The second can direct attention to one relation between voice and movement. A third pass is only useful when it answers a new question.

Move between video and audio

Video can conceal an auditory weakness. A learner may infer “third floor” from a lift display while still hearing “first floor.” That inference is successful communication, yet a telephone call or the TOEIC Listening section removes the display. Lessons need a deliberate change of channel.

One useful sequence starts with video. Learners identify the people, purpose, and outcome. The teacher then plays a 19-second section with the screen hidden and asks for the exact phrase carrying the decision. Video returns for a final check: did the face or gesture confirm the words, add attitude, or merely repeat information already present in speech?

The reverse order works when diagnosis matters. Play audio first, collect a brief account, then reveal the picture. Learners underline what they recovered from sound and circle what the image supplied. The marks separate a word-boundary problem from a missing-context problem. Choc’s article on word boundaries in English listening offers a follow-up for the first kind.

Keep the comparison honest. Captions add written language, so a captioned video tests a different combination from a silent image plus speech. Background music can compete with quiet consonants. Rapid cuts may demand visual attention without offering useful evidence. A fixed camera on two people negotiating a deadline is often better listening material than a polished montage.

Choose clips that earn the screen

The image should contain information worth interpreting. News presenters reading directly to camera offer facial cues but few referential gestures. Cooking demonstrations, interviews, service encounters, and short meetings make objects, gaze, and turn-taking visible. For a B1 office worker in Neihu, a recorded stand-up meeting may transfer more readily than a film trailer with 31 cuts per minute.

Teachers also need consent and accessible playback, since a real online meeting cannot become lesson material merely because it contains natural speech and happens to offer exactly the interaction a teacher wants. Public interviews, licensed course media, or a teacher-recorded scenario with agreed use are safer sources. Playback should allow a clean audio-only pass without forcing learners to close their eyes while captions remain on screen.

There is a boundary. Learners preparing for an audio-only exam need sustained work under that format, and a student with limited vision needs materials designed around sound rather than incidental visual clues. The claim here concerns the many listening events where speakers are visible.

A quick material test

For tomorrow’s lesson, find a clip under 90 seconds and write two questions. One must require the words. The other must require something visible. If both questions can be answered from a transcript, the screen has not earned its place.