by Sync

Re-sync the lips in a clip of up to 2 minutes to a new audio track

sync/lipsync-2/lip-sync
  • Lip Sync

About Sync Lipsync 2

Re-sync the lips in a clip of up to 2 minutes to a new audio track.

Call it with the model name sync/lipsync-2/lip-sync on POST /jobs/createTask, from $0.056.

Introduction

Standard-tier dialogue replacement

Sync's Lipsync 2 adapts mouth movement in existing footage to an uploaded recording. Sync describes it as a zero-shot model that learns a speaker's delivery style from the source, including when the replacement line is in another language. No speaker-training step is needed. Use sync/lipsync-2/lip-sync for the video-and-audio task; the result is an MP4 containing the supplied voice.

This endpoint exposes three fields. A written script cannot supply the voice, and there is no prompt input for directing the scene. Record or generate your dialogue separately before submitting the media URLs.

Request fields

FieldWhat to sendDefault and effect
video_urlRequired URL of a clip with a clearly visible face, 1–120 seconds long.No default; the source video's duration sets billable seconds. Videos over 120 seconds are rejected at acceptance.

Decide what happens at the ending

ModeDuration handling
cut_offEnds the result when the shorter input ends.
loopRestarts the clip as needed while the longer speech recording plays.
bounceExtends footage for longer speech by playing forward, reversing, and repeating that sequence.
silenceAdds silence after shorter audio so the remaining video can play.
remapChanges playback speed to fit the video's complete timeline into the recording's duration.

Choose loop when a repeat fits the shot. Review the restart in the returned clip. With bounce, check whether reversed movement suits the scene. Use remap when you want the video timeline fitted to the audio; inspect the resulting pace before using it in an edit.

Prepare footage and dialogue

Select the exact passage of video you need and confirm its duration. Keep the face clearly visible. Sync says lipsync-2 needs natural speaking movement in its source; a motionless portion may not produce speaking movement after processing. This publisher caveat matters when evaluating animated or AI-generated characters as well as filmed speakers.

Listen to the complete MP3 or WAV and check its ending against the planned video. The voice comes from that file; this operation does not clone the person in the footage.

Submit, track, and save

Submit the two required URLs with your chosen sync_mode, or omit it to use cut_off. Processing is asynchronous: retain the task ID, then poll for completion or receive the completion callback. Task acceptance means the request has entered processing; retrieve the MP4 after it completes.

Watch the mouth while listening to the new words, and inspect any repeated, reversed, or retimed footage. Generated files are deleted after that period.

Results from our supplied trials

The midnight-tailor-invitation example pairs 5.04 seconds of 864×496 atelier footage with a 6.5-second spoken invitation and sync_mode: loop. In our tests, the video repeated to cover the line and returned a 6.5-second MP4 at 864×496 and 24 fps. The tailor's small smile and eyebrow lift remained visible as his mouth formed the replacement words.

A separate 512×768 source ran 5.4 seconds at 25 fps. With 4.55 seconds of audio and cut_off, the MP4 measured 4.56 seconds and retained those picture dimensions and frame rate. These short trials document their particular outputs; they do not establish a resolution ceiling or a processing-time guarantee.

When to evaluate a related model

For a close shot where facial detail drives your decision, evaluate Sync Lipsync 2 Pro. Sync positions Pro as the higher-precision tier.

Other model contracts to review include Lipsync 3 from Sync, the VEED Lipsync 2.0 option, and Lip Sync v1. Compare their documented inputs and timing behavior with the edit you need rather than assuming their request fields match.

Request parameters

ParameterRequiredDescription
audio_urlYesThe voice or music track to use.
sync_modeNoWhat to do when the audio and video lengths differ: cut at the shorter one, loop the video, play it forward and back, pad with silence, or retime the video to the audio. cut_off · loop · bounce · silence · remap · Default: cut_off
video_urlYesThe clip to work on.

Pricing

Prices are in USD and charged to your PopNow balance. When a task is accepted, we reserve the maximum quoted amount from your API balance. On completion, we charge for actual usage, never more than the hold, and release the remainder. If the task fails, the hold is released.

OptionUSD per second
Standard$0.056

Send the same request body to POST /jobs/quote to see the estimated and maximum USD charge before running. A quote does not run the task or charge your balance.

API quick start

Call the Sync Lipsync 2 API in three steps

  1. Create an API key. Sign in to PopNow and create a key in the API console. Keys start with sk-popnow-. API calls are billed in USD from your PopNow balance.
  2. Send the request. POST /jobs/createTask with model sync/lipsync-2/lip-sync and an input object that follows the parameter table. The response returns a task ID straight away.
  3. Get the result. Poll GET /jobs/recordInfo with the task ID, or pass a callBackUrl and we post the result to it. Download the output links when the task succeeds.
# 1. Create the task. Keep the Idempotency-Key if you retry after a network error.
export IDEMPOTENCY_KEY="$(uuidgen)"
curl -X POST https://api.popnow.ai/api/v1/jobs/createTask \
  -H "Authorization: Bearer $POPNOW_API_KEY" \
  -H "Content-Type: application/json" \
  -H "Idempotency-Key: $IDEMPOTENCY_KEY" \
  -d '{
  "model": "sync/lipsync-2/lip-sync",
  "input": {
    "video_url": "https://media.popnow.ai/effects/flower-bloom-1abd6efb.mp4",
    "audio_url": "https://media.popnow.ai/shortfilm/voices/Aoede-46e4c427.mp3",
    "sync_mode": "cut_off"
  }
}'

# 2. Copy data.taskId from the response, then poll until state is succeeded, failed, canceled or expired.
TASK_ID="TASK_ID_FROM_RESPONSE"
curl "https://api.popnow.ai/api/v1/jobs/recordInfo?taskId=$TASK_ID" \
  -H "Authorization: Bearer $POPNOW_API_KEY"

Replace the prompt and any links with your own. The API tab has the response, polling and callback reference.

Sync Lipsync 2 API questions

How much does the Sync Lipsync 2 API cost?

Sync Lipsync 2 costs $0.056 per second. API usage is charged in USD to your PopNow balance. When a task is accepted, we reserve the maximum quoted amount from your API balance. On completion, we charge for actual usage, never more than the hold, and release the remainder. If the task fails, the hold is released.

What is the model name for Sync Lipsync 2 in the API?

Put sync/lipsync-2/lip-sync for Lip Sync in the model field of POST /jobs/createTask.

Which sync_mode fits unequal video and audio lengths?

Choose the rule that suits the ending. cut_off uses the shorter input; loop repeats video; bounce alternates forward and reverse playback; silence pads shorter audio; remap stretches or compresses video timing to the recording.

Can a translated recording keep the speaker's delivery style?

Sync says style preservation works across languages. Prepare the translated recording separately and send it as audio_url; the lip-sync operation does not produce the translation or its voice.

Must I train Sync Lipsync 2 on each speaker?

No speaker-specific training is needed. Sync describes the model as zero-shot: the input video provides the speaking-style reference for the replacement dialogue.

Why might a motionless character clip give weak mouth movement?

Sync says lipsync-2 needs natural speaking movement in its input. Still portions can lack the cues it uses to animate speech; select a take that shows the character speaking before evaluating a replacement recording.

Will Lipsync 2 create a voice that sounds like the person?

The resulting voice is the uploaded recording. This endpoint does not clone voices, so prepare the audio you want to hear before submitting the lip-sync job.

What are the limits of the Sync Lipsync 2 API?

Largest upload: 90 MB; Longest input clip: 120 s. Requests outside these limits are rejected before anything is charged.

Can I try Sync Lipsync 2 without writing code?

Run Sync Lipsync 2 in the Playground with your API USD balance, without an API key. Each run appears in your developer history with its matching code.

All Sync Lipsync models

More about Sync Lipsync 2