multimodals

• When technology came into this world, different modes of communication came into existence. They are called multimodal.
• Many texts are multimodal where meaning is communicated through combinations of two or more modes. Modes include written language, spoken language, and patterns of meaning that are visual, audio, gestural, tactile, and spatial.
• Multimodal texts include picture books, text books, graphic novels, comics, and posters, where meaning is conveyed to the reader through varying combinations of visual (still image), written

  language, and spatial mode
• Digital multimodal texts, such as film, animation, slide shows, e-posters, digital stories, and web pages, convey meaning through combinations of written and spoken language, visual (still and

  moving image), audio, gestural and spatial modes.
• Live multimodal texts, for example, dance, performance, and oral storytelling, convey meaning through combinations of modes such as gestural, spatial, spoken language, and audio
• Elements of Multimodal Text

  A text may be defined as multimodal when it combines two or more semiotic systems.

  ,

  • Linguistic: vocabulary, structure, grammar of oral/written language

  • Visual: color, vectors, and viewpoint in still and moving images

  • Audio or Aural: volume, pitch and rhythm of music and sound effects

  • Gestural: movement, facial expression and body language

  • Spatial: proximity, direction, position of layout, organization of objects in space
• The Five Modes:

  1. Visual - The visual mode refers to the images and characters that people see
  2. Aural or Audio - The aural mode is focused on sound
  3. Gestural - the way movement is interpreted
  4. Linguistic or Alphabetical - written or spoken words
  5. Spatial - arrangment of elements in spacearrangement