About VEED Lipsync 2.0
Redraw the mouth in a clip to match a new audio track, at the source resolution.
Call it with the model name veed/lipsync-2.0/lip-sync on POST /jobs/createTask, from $0.079.
Introduction
VEED Lipsync 2.0 replaces what a person on screen appears to say. Pass the footage in video_url and the new speech in audio_url, and the mouth is redrawn to match.
Key features
Works on the take you already have
The rest of the frame stays as filmed: background, clothing and expression carry over, only the mouth area is re-rendered.
The audio decides the length
Shorter audio trims the clip; longer audio extends the picture to fit. In our tests the result matched the audio within a few hundredths of a second.
Request parameters
| Parameter | Required | Description |
|---|---|---|
audio_url | Yes | The voice or music track to use. |
video_url | Yes | The clip to work on. |
Pricing
Prices are in USD and charged to your PopNow balance. When a task is accepted, we reserve the maximum quoted amount from your API balance. On completion, we charge for actual usage, never more than the hold, and release the remainder. If the task fails, the hold is released.
| Option | USD per second |
|---|---|
| Standard | $0.079 |
Send the same request body to POST /jobs/quote to see the estimated and maximum USD charge before running. A quote does not run the task or charge your balance.
Use cases
Pick-up lines without a reshoot
Correct a name, a date or an offer in a recorded presenter clip.
Voice replacement
Put a translated or re-recorded voice track on the original performance.
Prompt guide & pro tips
One speaker, facing the camera
The model supports one speaker per clip. Keep the face visible and avoid fast head turns.
Clean audio
Use a single voice without music or background noise; clean a noisy recording first.
Match the pace
A new line close in length to the original keeps the body movement natural.
API quick start
Call the VEED Lipsync 2.0 API in three steps
- Create an API key. Sign in to PopNow and create a key in the API console. Keys start with sk-popnow-. API calls are billed in USD from your PopNow balance.
- Send the request. POST /jobs/createTask with model veed/lipsync-2.0/lip-sync and an input object that follows the parameter table. The response returns a task ID straight away.
- Get the result. Poll GET /jobs/recordInfo with the task ID, or pass a callBackUrl and we post the result to it. Download the output links when the task succeeds.
# 1. Create the task. Keep the Idempotency-Key if you retry after a network error.
export IDEMPOTENCY_KEY="$(uuidgen)"
curl -X POST https://api.popnow.ai/api/v1/jobs/createTask \
-H "Authorization: Bearer $POPNOW_API_KEY" \
-H "Content-Type: application/json" \
-H "Idempotency-Key: $IDEMPOTENCY_KEY" \
-d '{
"model": "veed/lipsync-2.0/lip-sync",
"input": {
"video_url": "https://media.popnow.ai/effects/flower-bloom-1abd6efb.mp4",
"audio_url": "https://media.popnow.ai/shortfilm/voices/Aoede-46e4c427.mp3"
}
}'
# 2. Copy data.taskId from the response, then poll until state is succeeded, failed, canceled or expired.
TASK_ID="TASK_ID_FROM_RESPONSE"
curl "https://api.popnow.ai/api/v1/jobs/recordInfo?taskId=$TASK_ID" \
-H "Authorization: Bearer $POPNOW_API_KEY"Replace the prompt and any links with your own. The API tab has the response, polling and callback reference.
VEED Lipsync 2.0 API questions
How much does the VEED Lipsync 2.0 API cost?
VEED Lipsync 2.0 costs $0.079 per second. API usage is charged in USD to your PopNow balance. When a task is accepted, we reserve the maximum quoted amount from your API balance. On completion, we charge for actual usage, never more than the hold, and release the remainder. If the task fails, the hold is released.
What is the model name for VEED Lipsync 2.0 in the API?
Put veed/lipsync-2.0/lip-sync for Lip Sync in the model field of POST /jobs/createTask.
What happens when the audio and the video differ in length?
The result follows the audio. A 5-second line on 6 seconds of footage returned 5.08 seconds; a 7.8-second line on 5.4 seconds of footage returned 7.76 seconds, with the picture continuing to fit.
How is it billed?
Per second of the new audio, rounded up to a whole second. The footage itself is not counted, and failed renders are free.
Can it handle two people talking?
No. VEED supports one speaker per clip. For a conversation, use VEED Dubbing, which handles several speakers and translates the speech too.
Can I try VEED Lipsync 2.0 without writing code?
Run VEED Lipsync 2.0 in the Playground with your API USD balance, without an API key. Each run appears in your developer history with its matching code.
All VEED models
- VEED Dubbing Pro APIStudio-grade dubbing with accents, voice match and lip syncFrom $0.234 per second
- VEED Dubbing APIDub into 86 languages in each speaker’s voice, lips redrawnFrom $0.124 per second
- VEED Lipsync 2.0 APIRedraw the mouth in a clip to match a new audio track, at the source resolutionFrom $0.079 per second
- VEED Fabric 1.0 APITurn one portrait and a voice track of up to 5 minutes into a talking videoFrom $0.09 per second