About ByteDance Lip Sync
Re-voice a clip with a new track, with a fast mode for single faces.
Call it with the model name bytedance/lip-sync/lip-sync on POST /jobs/createTask, from $0.052.
Introduction
ByteDance Lip Sync: select a scene profile
ByteDance Lip Sync is ByteDance's video lip-sync service, part of its video translation tools. An existing single-speaker video supplies the picture, and a separate human-voice recording drives the replacement mouth movement. The returned MP4 uses 25 fps and follows the recording's duration: excess source footage is trimmed, while short footage loops to cover longer speech.
Choose lite for frontal single-speaker footage. Select basic for complex single-speaker scenes, with optional scene detection and speaker recognition. These are scene profiles at the same rate. The endpoint does not clone voices; its soundtrack comes from the audio you upload.
Parameters and profile compatibility
Use bytedance/lip-sync/lip-sync as the request model. Both URLs are required. Optional controls must match the selected profile; incompatible combinations are rejected during acceptance before a generation starts.
| Public field | Value or default | Applicable profile and effect |
|---|---|---|
video_url | Required URL; no default | Both: MOV, MP4, or MKV; 360p–1080p, 24–60 fps, 1–30 Mbps; H.264 recommended. |
audio_url | Required URL; no default | Both: clean MP3/WAV/AAC/M4A/OGG, up to 10 MB, longer than 1 second; Lite ceiling 240 seconds, Basic ceiling 210 seconds. |
generation_mode | lite or basic; default lite | Chooses the scene profile without changing the audio-second rate. |
remove_background_noise | Boolean; default false | Lite: separate background sound before driving the mouth; omit in Basic. |
scene_detection | Boolean; default false | Basic: detect scenes and identify the speaker; omit in Lite. |
loop_video | Boolean; default true | Lite: repeat picture to cover a longer recording; omit in Basic. |
loop_reverse | Boolean; default false | Lite with looping enabled: alternate forward and reverse playback; omit in Basic. |
video_start_seconds | Number; default 0 | Lite: start picture playback at this source second; omit in Basic. |
There is no prompt or resolution selector in the public field set. Use the recording to provide the words. Video above 1080p is reduced to 1080p; below-360p footage is rejected.
Prepare a compatible pair
Inspect the video for a clear single speaker and check its file format, resolution, frame rate, and bitrate. For Lite, use frontal footage. For a complex scene that needs shot analysis, choose Basic and enable scene_detection if appropriate.
Listen to the separate voice recording before upload. Prepare any translated wording and its recording beforehand. Lite can separate background sound through remove_background_noise; Basic does not accept that setting. When selecting Basic, also omit loop_video, loop_reverse, and video_start_seconds, including values copied from a Lite request.
Compare the two input durations. The recording defines the intended edit length. In Lite, plan repeated footage with loop_video, add loop_reverse for alternating direction, and use video_start_seconds to select a source starting point. Review repeated gestures after completion.
Observations from our tests
The record-store sample paired 6.04 seconds of 864×496 footage with a 5.2-second line in Lite, with background-noise removal disabled. The woman in the listening room delivered the replacement words through revised mouth movement. Its result measured 5.20 seconds at 864×496 and 25 fps, demonstrating trimming to the recording.
A separate Basic run with scene detection paired a 6.04-second source with 5.2 seconds of speech and returned 5.28 seconds. Another Lite run enabled looping, reverse looping, noise removal, and a source start of 1 second: 5.04 seconds of video covered 6.5 seconds of speech, returning 6.52 seconds. Small measured differences around the recording length occurred in these runs.
Three Basic attempts with background-noise removal failed in our tests. Lite processed that option successfully, so the exposed compatibility rules restrict it to Lite. These observations explain the field split without promising a result for every input.
Completion, waiting, and file limits
Submission creates an asynchronous task and returns an identifier. Poll for completion or receive a callback, then retrieve the finished MP4. Peak traffic can add waiting time, so task acceptance does not establish completion.
Never impersonate another person.
Compare related video lip-sync choices
VEED Lipsync 2.0 and Lip Sync are additional related choices. Evaluate your own authorized video and recording against each endpoint's supported inputs.
Request parameters
| Parameter | Required | Description |
|---|---|---|
audio_url | Yes | The voice or music track to use. |
generation_mode | No | Choose a mode from the available options. It may affect cost, speed and quality. lite · basic · Default: lite |
loop_reverse | No | When looping, play the video forward then backward instead of jumping back to the start. |
loop_video | No | Repeat the video when the audio is longer than the clip. |
remove_background_noise | No | Clean up ambient noise in the recording before the voice is changed. |
scene_detection | No | Detect scene cuts and pick out who is speaking in each shot. |
video_start_seconds | No | Second in the source video where playback begins. ≥ 0 · ≤ 3600 |
video_url | Yes | The clip to work on. |
Pricing
Prices are in USD and charged to your PopNow balance. When a task is accepted, we reserve the maximum quoted amount from your API balance. On completion, we charge for actual usage, never more than the hold, and release the remainder. If the task fails, the hold is released.
| Option | USD per second |
|---|---|
| Standard | $0.052 |
Send the same request body to POST /jobs/quote to see the estimated and maximum USD charge before running. A quote does not run the task or charge your balance.
API quick start
Call the ByteDance Lip Sync API in three steps
- Create an API key. Sign in to PopNow and create a key in the API console. Keys start with sk-popnow-. API calls are billed in USD from your PopNow balance.
- Send the request. POST /jobs/createTask with model bytedance/lip-sync/lip-sync and an input object that follows the parameter table. The response returns a task ID straight away.
- Get the result. Poll GET /jobs/recordInfo with the task ID, or pass a callBackUrl and we post the result to it. Download the output links when the task succeeds.
# 1. Create the task. Keep the Idempotency-Key if you retry after a network error.
export IDEMPOTENCY_KEY="$(uuidgen)"
curl -X POST https://api.popnow.ai/api/v1/jobs/createTask \
-H "Authorization: Bearer $POPNOW_API_KEY" \
-H "Content-Type: application/json" \
-H "Idempotency-Key: $IDEMPOTENCY_KEY" \
-d '{
"model": "bytedance/lip-sync/lip-sync",
"input": {
"video_url": "https://media.popnow.ai/effects/flower-bloom-1abd6efb.mp4",
"audio_url": "https://media.popnow.ai/shortfilm/voices/Aoede-46e4c427.mp3",
"generation_mode": "lite"
}
}'
# 2. Copy data.taskId from the response, then poll until state is succeeded, failed, canceled or expired.
TASK_ID="TASK_ID_FROM_RESPONSE"
curl "https://api.popnow.ai/api/v1/jobs/recordInfo?taskId=$TASK_ID" \
-H "Authorization: Bearer $POPNOW_API_KEY"Replace the prompt and any links with your own. The API tab has the response, polling and callback reference.
ByteDance Lip Sync API questions
How much does the ByteDance Lip Sync API cost?
ByteDance Lip Sync costs $0.052 per second. API usage is charged in USD to your PopNow balance. When a task is accepted, we reserve the maximum quoted amount from your API balance. On completion, we charge for actual usage, never more than the hold, and release the remainder. If the task fails, the hold is released.
What is the model name for ByteDance Lip Sync in the API?
Put bytedance/lip-sync/lip-sync for Lip Sync in the model field of POST /jobs/createTask.
How should I choose between Lite and Basic modes?
Choose according to the scene and controls. The service offers Lite for frontal single-speaker video and Basic for complex single-speaker scenes; scene_detection belongs to Basic, while noise removal and loop controls belong to Lite.
How long can the replacement speech recording run?
Lite accepts more than 1 second through 240 seconds; Basic accepts more than 1 second through 210 seconds. Each recording must also fit within 10 MB and use MP3, WAV, AAC, M4A, or OGG.
What happens when my video and recording end at different times?
Audio sets the intended output duration. Longer video is trimmed; shorter video repeats to cover the recording. Lite exposes loop_video and loop_reverse for looping, plus video_start_seconds to choose the source starting point.
Can I remove background noise in Basic mode?
Background-noise removal is available in Lite. In our tests, three Basic attempts with that option failed, while Lite produced video; Basic requests now reject that incompatible control before processing.
What video quality and formats can I submit?
Submit MOV, MP4, or MKV at 360p–1080p, 24–60 fps, and 1–30 Mbps. H.264 is recommended. Above-1080p input is reduced to 1080p, and the output MP4 uses 25 fps.
What are the limits of the ByteDance Lip Sync API?
Largest upload: 90 MB. Requests outside these limits are rejected before anything is charged.
Can I try ByteDance Lip Sync without writing code?
Run ByteDance Lip Sync in the Playground with your API USD balance, without an API key. Each run appears in your developer history with its matching code.