Pia

• Multimedia translation


  1. Process and presentation of information in two or more media simultaneously

  2. Process of translating multimedia content such as videos, audio, and images from one language to another
• Audiovisual translation (AVT)


  Branch of translation concerning transferring multimodal texts in audiovisual materials from one language/culture into another
• AVT modes


  • Dubbing
  • Subtitling
  • Voice over
  • Interpreting
  • Surtitling
  • Free Commentary
  • Partial Dubbing
  • Narration
  • Simultaneous Translation
  • Live Subtitling
  • Subtitling for the Deaf and Hard of Hearing
  • Audio Description
  • Script Transcription
  • Animation
  • Multimedia Translation
  • Double Version
• Dubbing


  • Follows "the timing, phrasing, and lip movement of the original dialogue" as closely as possible
• Subtitling


  • Displaying on-screen written text that conveys a "target language version of the source speech"
• Types of subtitling


  • Intralingual Subtitle
  • Interlingual Subtitle
  • Bilingual Subtitle
• Classifications of subtitling


  • Prepared Subtitle
  • Live Subtitle
• Technical parameters of subtitling


  • Open Subtitle
  • Close Subtitle
• Voice over


  • Accompanied by original soundtrack and translation, original can be heard at first but the translated version stands out until the end as the volume decreased
• Interpreting


  • Oral translation of an audiovisual product by one speaker only, Typically used for live interviews and news broadcasts
• Surtitling


  • Similar to subtitling, One continuous line that appears without a break
• Free Commentary


  • Text prepared, translated, and condensed in advance, Read by dubbing actors/actresses, who don't perform, Can be pre-recorded or performed live, Differs from dubbing as the text is read aloud, not acted, Similar to narration but more condensed, not always true to the original style
• Partial Dubbing


  • Known as half dubbing or concise sync, Adding pre-recorded spoken text to the original soundtrack, Uses the original silent periods to provide narration
• Narration

  • Text prepared, translated, and condensed in advance, Read by dubbing actors/actresses, who don't perform, Can be pre-recorded or performed live, Differs from dubbing as the text is read aloud, not acted
• Simultaneous Translation


  • Visual translation, Done on the spot from script or subtitles already prepared in a second language
• Live Subtitling


  • Real-time subtitling, Not pre-recorded but inserted on the spot
• Subtitling for the Deaf and Hard of Hearing


  • To make audio "seeable" for people who have difficulty hearing dialogue in movies and TV shows, It complements the verbal dimension with additional information
• Audio Description


  • Targets blind, visually impaired, or partially sighted individuals, Provides narration for visual aspects, Inserted in silence to not interfere with dialogue, Narration is done by "voice writer", Descriptions are recorded or done pre-recorded or live, Aims to make audiovisual products accessible to the visually impaired
• Script Transcription


  • Scenario translation, Sole objective: Obtain financial support for co-productions, Procedural nature, not for a general audience, Read only by financial aid providers for project information, Rarely published, but crucial for production financing
• Animation


  • Translator uses silent images like comics to create a script
• Multimedia Translation


  • Audiovisual translation, Deals with transferring multimodal and multimedia texts, Involves the use of multimedia electronic systems
• Double Version


  • Multilingual production, Actors perform in their own language thus final product is dubbed and synced to a single language
• Multimedia translation contextualizes to suit its target audience and its culture, emphasizes values and ideology, less priority on linguistic aspects
• AVT challenges


  • Difficulties regarding language issues
  • Problems linked to visual aspects, usually found in audio descriptions
  • Questions regarding the original product
  • Issues linked to specific transfer modes
  • Other general aspects such as cultural references and humor
• Audio description


  Helps blind and visually impaired, Describe and give context to visual elements, Used in various forms of media
• Types of Audio Descriptions


  • Standard
  • Extended
  • Real-Time
• Standard Audio Description


  • Snippets of narration within natural pauses of dialogue, Concise descriptions to fit into the allotted time, Audio enhances content without distracting from it
• Extended Audio Description


  • Extended descriptions can be added when listeners pause the original content, Both video and description play simultaneously, Video pauses temporarily until audio finishes, Video resumes once the audio is complete
• Real-Time Audio Description


  • Real-time audio provides live commentary or narration, Commentary is delivered by a trained professional, Listeners use headphones and a small transmitter to access the audio
• Benefits of Audio Description


  • Accessibility
  • Flexibility
  • Development
  • Auditory Learning
• Visual elements described in audio description


  • Facial expression
  • Body language and gesture
  • Visual comedy and sight gags
  • Visual actions, including sexual acts, violence, etc.
  • Dance or other movements
  • Clothing
  • Multi-media effects and light
  • Setting and scene changes
  • Individual characteristics as relevant to the content (Skin color, height age, disability, etc.)
• Multimodal interaction


  Uses different ways to communicate, like talking and listening
• Multimodality in language research


  Uses things like pictures, sounds, and words together to create meaning
• Human social interaction and multimodality

  Use different ways like talking, gestures, and vision to communicate
• Multimodal interaction research is an evolving field that explores the intersection of various communication modalities in human interactions
• Language research has progressively embraced the analysis of multimodal interaction as it provides a more comprehensive understanding of the social and communicative dimensions of language use
• Studying multimodal interactions provides a comprehensive understanding of human communication
• Nonverbal cues play a crucial role in social interactions, reflecting underlying thoughts, emotions, and attitudes
• Technology has revolutionized the analysis of multimodal communication and multimodal interaction, enabling researchers to examine subtle changes in facial expressions and micro-gestures
• Understanding multimodal interaction research offers numerous practical applications, including developing intuitive human-computer interfaces, designing training programs for social difficulties, and addressing cross-cultural communication patterns