by VEED

Redraw the mouth in a clip to match a new audio track, at the source resolution

veed/lipsync-2.0/lip-sync
  • Lip Sync

About VEED Lipsync 2.0

Redraw the mouth in a clip to match a new audio track, at the source resolution.

Call it with the model name veed/lipsync-2.0/lip-sync on POST /jobs/createTask, from $0.079.

Introduction

VEED Lipsync 2.0 replaces what a person on screen appears to say. Pass the footage in video_url and the new speech in audio_url, and the mouth is redrawn to match.

Key features

Works on the take you already have

The rest of the frame stays as filmed: background, clothing and expression carry over, only the mouth area is re-rendered.

The audio decides the length

Shorter audio trims the clip; longer audio extends the picture to fit. In our tests the result matched the audio within a few hundredths of a second.

Request parameters

ParameterRequiredDescription
audio_urlYesThe voice or music track to use.
video_urlYesThe clip to work on.

Pricing

Prices are in USD and charged to your PopNow balance. When a task is accepted, we reserve the maximum quoted amount from your API balance. On completion, we charge for actual usage, never more than the hold, and release the remainder. If the task fails, the hold is released.

OptionUSD per second
Standard$0.079

Send the same request body to POST /jobs/quote to see the estimated and maximum USD charge before running. A quote does not run the task or charge your balance.

Use cases

Pick-up lines without a reshoot

Correct a name, a date or an offer in a recorded presenter clip.

Voice replacement

Put a translated or re-recorded voice track on the original performance.

Prompt guide & pro tips

One speaker, facing the camera

The model supports one speaker per clip. Keep the face visible and avoid fast head turns.

Clean audio

Use a single voice without music or background noise; clean a noisy recording first.

Match the pace

A new line close in length to the original keeps the body movement natural.

API quick start

Call the VEED Lipsync 2.0 API in three steps

  1. Create an API key. Sign in to PopNow and create a key in the API console. Keys start with sk-popnow-. API calls are billed in USD from your PopNow balance.
  2. Send the request. POST /jobs/createTask with model veed/lipsync-2.0/lip-sync and an input object that follows the parameter table. The response returns a task ID straight away.
  3. Get the result. Poll GET /jobs/recordInfo with the task ID, or pass a callBackUrl and we post the result to it. Download the output links when the task succeeds.
# 1. Create the task. Keep the Idempotency-Key if you retry after a network error.
export IDEMPOTENCY_KEY="$(uuidgen)"
curl -X POST https://api.popnow.ai/api/v1/jobs/createTask \
  -H "Authorization: Bearer $POPNOW_API_KEY" \
  -H "Content-Type: application/json" \
  -H "Idempotency-Key: $IDEMPOTENCY_KEY" \
  -d '{
  "model": "veed/lipsync-2.0/lip-sync",
  "input": {
    "video_url": "https://media.popnow.ai/effects/flower-bloom-1abd6efb.mp4",
    "audio_url": "https://media.popnow.ai/shortfilm/voices/Aoede-46e4c427.mp3"
  }
}'

# 2. Copy data.taskId from the response, then poll until state is succeeded, failed, canceled or expired.
TASK_ID="TASK_ID_FROM_RESPONSE"
curl "https://api.popnow.ai/api/v1/jobs/recordInfo?taskId=$TASK_ID" \
  -H "Authorization: Bearer $POPNOW_API_KEY"

Replace the prompt and any links with your own. The API tab has the response, polling and callback reference.

VEED Lipsync 2.0 API questions

How much does the VEED Lipsync 2.0 API cost?

VEED Lipsync 2.0 costs $0.079 per second. API usage is charged in USD to your PopNow balance. When a task is accepted, we reserve the maximum quoted amount from your API balance. On completion, we charge for actual usage, never more than the hold, and release the remainder. If the task fails, the hold is released.

What is the model name for VEED Lipsync 2.0 in the API?

Put veed/lipsync-2.0/lip-sync for Lip Sync in the model field of POST /jobs/createTask.

What happens when the audio and the video differ in length?

The result follows the audio. A 5-second line on 6 seconds of footage returned 5.08 seconds; a 7.8-second line on 5.4 seconds of footage returned 7.76 seconds, with the picture continuing to fit.

How is it billed?

Per second of the new audio, rounded up to a whole second. The footage itself is not counted, and failed renders are free.

Can it handle two people talking?

No. VEED supports one speaker per clip. For a conversation, use VEED Dubbing, which handles several speakers and translates the speech too.

Can I try VEED Lipsync 2.0 without writing code?

Run VEED Lipsync 2.0 in the Playground with your API USD balance, without an API key. Each run appears in your developer history with its matching code.

All VEED models

More about VEED Lipsync 2.0