Skip to main content

AI lip sync

Pick a video of someone speaking. After you sign in, attach it with the new audio, or a script for a workspace voice to read, and Endless matches the mouth to the speech with Sync 3 or VEED Lipsync 2.

Video
Lip-sync the video I attached, launch-intro-take2.mp4, to new speech. I will attach the audio, or give you a script to read in one of the workspace voices. Suggest Sync 3 or VEED Lipsync 2 and tell me the cost before you run it.
Video · launch-intro-take2.mp4, 14 seconds
Audio · Corrected script read by an Endless voice, 13 seconds
Model · Sync 3

Here is the intro with the corrected line. The speaker's mouth now matches the new script, and the clip runs 13 seconds, the length of the speech.

  • Sync 3 stops at the shorter of the video and the audio.
  • The original take stays in your workspace next to the synced one.

What is AI lip sync?

AI lip sync changes the mouth movements in a video so they match a different audio track. You give the model a clip of someone speaking and the new speech, and it redraws the mouth frame by frame so the words line up. The rest of the shot stays as it was. It is used to fix a line, replace a take or dub a video into another language.

Reshooting a line means getting the speaker, the set and the light back together. With lip sync you change the audio and keep the footage. Teams use it for corrected product names, new intros, localized ads and voiceovers for clips filmed without usable sound. It works best when the face is clear and turned toward the camera.

Endless runs two lip sync models in your workspace chat: Sync 3 by Sync Labs and VEED Lipsync 2. You attach the video and an audio file, or give the agent a script and it has one of the workspace voices read it first. Neither model needs a prompt. The synced video is saved in your workspace next to the original.

How it works

  1. 01

    Pick the video

    Choose the clip of the person speaking in the box above. Only its name goes into the prompt; the file is not uploaded from this page.

  2. 02

    Sign in and attach the files

    Create a free Endless account or sign in. Your workspace chat opens with the prompt already written. Attach the same video and the audio track, or paste a script for a voice to read, and send.

  3. 03

    Get the synced video

    The agent runs Sync 3 or VEED Lipsync 2 and saves the result in your workspace. Ask for the other model, a new line or a different voice in the same chat.

What people use it for

  1. 01

    Fix a line without a reshoot

    Replace a wrong price, a misspoken name or an outdated date in a finished video. Record or generate the corrected line, lip-sync it, and keep the original footage, lighting and framing. It is faster than booking the speaker and the set again.

  2. 02

    Dub a video into another language

    Ask the agent to translate the script, have a workspace voice read it, then lip-sync the clip to the new audio. The mouth follows the translated words, so the dubbed version looks closer to how it was filmed.

  3. 03

    Localize ads

    Make several language versions of the same ad from one shoot. Each version is saved in your workspace, so your team can review them together and keep the set organized by market.

  4. 04

    Add a voiceover to silent footage

    Clips filmed without usable sound can get speech afterward. Write the script, pick a voice and let the agent sync the speaker's mouth to it. Keep the length of the speech close to the length of the clip.

  5. 05

    Test different scripts

    Try two or three versions of an intro or a hook on the same clip and compare them before you publish. Changing the words takes a new audio track and a new run, not a new shoot.

  6. 06

    Sync generated videos

    Generate a talking character with a video model, then lip-sync it to the exact line you want. Both the clip and the synced version stay in your workspace with your other assets.

Frequently asked questions

Related tools

Give your next idea a place to grow.

Start free, create a project, and bring your brand’s references together. Or book a demo to explore Endless with your team.

Book a demo