Lipsync 2.0
re-sync a video to new audio
POST /v1/lipsync-2.0
Add an API key to run jobs
The playground calls the live API with your workspace key, which stays in this browser. Don't have one? API access is granted on request.
Input
URL of the new audio track to lip-sync the video to.
URL of the source video to dub.
Output
Your generated result will appear here.
Fill in the inputs and hit run — jobs typically take a minute or two.
Lipsync 2.0 — re-sync a video to new audio
Take an existing video and a new audio track, and re-render the video with the speaker's mouth matched to that new audio. Used for voice replacement — swap in a new voice, or a cleaner take.
- Inputs: a video URL and an audio URL
- Output: an MP4 video
Common use cases: dubbing & localization · translating content into new languages · replacing or re-recording a speaker's voice while keeping natural lip movement
Failure codes
An accepted job can still fail during rendering. When status is FAILED, the error code is one of:
input_validationcontent_moderationinvalid_fileaudio_too_longtransload_failedgeneration_failedtimeoutFull flow
# Submit a job
curl -X POST "https://api.veed.io/v1/lipsync-2.0" \
-H "Authorization: Bearer $VEED_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"audio_url": "https://media.veed.io/in.mp3",
"video_url": "https://media.veed.io/in.mp4"
}'
# Poll until COMPLETED (response includes data.job_id)
curl "https://api.veed.io/v1/lipsync-2.0/{job_id}" \
-H "Authorization: Bearer $VEED_API_KEY"import { Veed } from "@veedstudio/sdk";
const client = new Veed(); // reads VEED_API_KEY
const job = await client.lipsync20.generate({
audio_url: "https://media.veed.io/in.mp3",
video_url: "https://media.veed.io/in.mp4",
});
console.log(job.result);package main
import (
"context"
"fmt"
"log"
veed "github.com/veedstudio/veed-sdk-go"
)
func main() {
client, err := veed.NewClient() // reads VEED_API_KEY
if err != nil {
log.Fatal(err)
}
job, err := client.Lipsync20.Generate(context.Background(), veed.Lipsync20Input{
AudioURL: "https://media.veed.io/in.mp3",
VideoURL: "https://media.veed.io/in.mp4",
})
if err != nil {
log.Fatal(err)
}
fmt.Printf("%+v\n", job.Result)
}/v1/lipsync-2.0Submit a Lipsync 2.0 job
Start an asynchronous job that re-renders a source video with the speaker's mouth matched to a new audio track — for dubbing, voice replacement, or a cleaner take.
Inputs
video_url— public URL of the source videoaudio_url— public URL of the new audio track to lip-sync the video to
What happens next
The job is accepted immediately — you get 202 Accepted with a job_id and status PROCESSING. Rendering runs in the background; poll GET /v1/lipsync-2.0/{job_id} until the job is COMPLETED or FAILED.
Headers
X-Veed-Store-IOenumoptionalSet to 0 to not store this request's and response's bodies. They will then not be available in your request logs for debugging. Defaults to 1 (stored).
01Defaults to "1".X-Veed-Media-Expiration-SecondsintegeroptionalNumber of seconds before signed media URLs returned for this request expire. Defaults to 86400 (1 day).
86400.Request body Lipsync20Input ↗
audio_urlurlrequiredURL of the new audio track to lip-sync the video to.
video_urlurlrequiredURL of the source video to dub.
Responses
Show 4 nested fields
Failure information. Present once the job has FAILED.
Show 3 nested fields
codeenumrequiredStable, machine-readable failure code for this job type.
input_validationcontent_moderationinvalid_fileaudio_too_longtransload_failedgeneration_failedtimeoutOptional structured failure details.
Show 3 nested fields
fieldstringoptionalDotted path to the offending input, when applicable.
messagestringrequiredHuman-readable explanation of this detail.
typestringrequiredThe category of this detail entry.
messagestringrequiredHuman-readable failure message.
job_iduuidrequiredStable identifier of the job and of the resource it produces.
The produced resource. Present once the job is COMPLETED.
Show 1 nested field
Generated re-lip-synced video.
Show 4 nested fields
content_typestringoptionalThe mime type of the file.
file_namestringoptionalThe name of the file.
file_sizeintegeroptionalThe size of the file in bytes.
urlstringrequiredThe URL where the file can be downloaded from.
statusenumrequiredCurrent lifecycle state of the job.
PROCESSINGCOMPLETEDFAILEDCANCELLEDX-Request-IDCorrelation id for this request, adopted from the request or minted at the edge.401UnauthorizedErrorResponse ↗
Show 4 nested fields
codeenumrequiredinvalid_requestunauthenticatedpermission_deniednot_foundconflictrate_limitedunavailableinternalShow 6 nested fields
fieldstringoptionalmessagestringoptionalreasonenumoptionalapi_key_expiredapi_key_inactiveapi_key_invalidapi_key_revokedjob_not_foundretry_after_msintegeroptionaltypestringrequiredvalueobjectoptionalmessagestringrequiredrequest_idstringrequiredX-Request-IDCorrelation id for this request, adopted from the request or minted at the edge.422Unprocessable EntityErrorResponse ↗
Show 4 nested fields
codeenumrequiredinvalid_requestunauthenticatedpermission_deniednot_foundconflictrate_limitedunavailableinternalShow 6 nested fields
fieldstringoptionalmessagestringoptionalreasonenumoptionalapi_key_expiredapi_key_inactiveapi_key_invalidapi_key_revokedjob_not_foundretry_after_msintegeroptionaltypestringrequiredvalueobjectoptionalmessagestringrequiredrequest_idstringrequiredX-Request-IDCorrelation id for this request, adopted from the request or minted at the edge.429Rate limit exceededErrorResponse ↗
Show 4 nested fields
codeenumrequiredinvalid_requestunauthenticatedpermission_deniednot_foundconflictrate_limitedunavailableinternalShow 6 nested fields
fieldstringoptionalmessagestringoptionalreasonenumoptionalapi_key_expiredapi_key_inactiveapi_key_invalidapi_key_revokedjob_not_foundretry_after_msintegeroptionaltypestringrequiredvalueobjectoptionalmessagestringrequiredrequest_idstringrequiredRetry-AfterSeconds until the rate limit resets.X-RateLimit-ClassThe rate-limit class that was hit (read, mutation, ai-generation).X-RateLimit-LimitRequest budget for the matched class.X-RateLimit-RemainingRemaining requests in the current window.X-RateLimit-ResetUnix time (seconds) when the budget resets.X-Request-IDCorrelation id for this request, adopted from the request or minted at the edge.500Internal Server ErrorErrorResponse ↗
Show 4 nested fields
codeenumrequiredinvalid_requestunauthenticatedpermission_deniednot_foundconflictrate_limitedunavailableinternalShow 6 nested fields
fieldstringoptionalmessagestringoptionalreasonenumoptionalapi_key_expiredapi_key_inactiveapi_key_invalidapi_key_revokedjob_not_foundretry_after_msintegeroptionaltypestringrequiredvalueobjectoptionalmessagestringrequiredrequest_idstringrequiredX-Request-IDCorrelation id for this request, adopted from the request or minted at the edge.Example request
curl -X POST "https://api.veed.io/v1/lipsync-2.0" \
-H "Authorization: Bearer $VEED_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"audio_url": "https://media.veed.io/in.mp3",
"video_url": "https://media.veed.io/in.mp4"
}'import { Veed } from "@veedstudio/sdk";
const client = new Veed(); // reads VEED_API_KEY
const job = await client.lipsync20.submit({
audio_url: "https://media.veed.io/in.mp3",
video_url: "https://media.veed.io/in.mp4",
});
console.log(job.status);package main
import (
"context"
"fmt"
"log"
veed "github.com/veedstudio/veed-sdk-go"
)
func main() {
client, err := veed.NewClient() // reads VEED_API_KEY
if err != nil {
log.Fatal(err)
}
job, err := client.Lipsync20.Submit(context.Background(), veed.Lipsync20Input{
AudioURL: "https://media.veed.io/in.mp3",
VideoURL: "https://media.veed.io/in.mp4",
})
if err != nil {
log.Fatal(err)
}
fmt.Println(job.Status)
}Example response
{
"data": {
"error": {
"code": "input_validation",
"details": [
{
"field": "<field>",
"message": "<message>",
"type": "<type>"
}
],
"message": "<message>"
},
"job_id": "123e4567-e89b-12d3-a456-426614174000",
"result": {
"video": {
"content_type": "video/mp4",
"file_name": "<file_name>",
"file_size": 0,
"url": "<url>"
}
},
"status": "PROCESSING"
}
}/v1/lipsync-2.0/{job_id}Get a Lipsync 2.0 job
Retrieve the current state of a Lipsync 2.0 job by its job_id.
The response uses the shared job envelope, whose status is one of:
PROCESSING— still rendering; the result is emptyCOMPLETED— done; the result holds the re-synced videoFAILED— the job was accepted but rendering failed; the error holds a Lipsync 2.0 failure code
Poll this endpoint until the status is COMPLETED or FAILED. An unknown job_id returns 404 Not Found.
Path parameters
job_iduuidrequiredIdentifier of the Lipsync 2.0 job, returned when the job was submitted.
Headers
X-Veed-Store-IOenumoptionalSet to 0 to not store this request's and response's bodies. They will then not be available in your request logs for debugging. Defaults to 1 (stored).
01Defaults to "1".X-Veed-Media-Expiration-SecondsintegeroptionalNumber of seconds before signed media URLs returned for this request expire. Defaults to 86400 (1 day).
86400.Responses
Show 4 nested fields
Failure information. Present once the job has FAILED.
Show 3 nested fields
codeenumrequiredStable, machine-readable failure code for this job type.
input_validationcontent_moderationinvalid_fileaudio_too_longtransload_failedgeneration_failedtimeoutOptional structured failure details.
Show 3 nested fields
fieldstringoptionalDotted path to the offending input, when applicable.
messagestringrequiredHuman-readable explanation of this detail.
typestringrequiredThe category of this detail entry.
messagestringrequiredHuman-readable failure message.
job_iduuidrequiredStable identifier of the job and of the resource it produces.
The produced resource. Present once the job is COMPLETED.
Show 1 nested field
Generated re-lip-synced video.
Show 4 nested fields
content_typestringoptionalThe mime type of the file.
file_namestringoptionalThe name of the file.
file_sizeintegeroptionalThe size of the file in bytes.
urlstringrequiredThe URL where the file can be downloaded from.
statusenumrequiredCurrent lifecycle state of the job.
PROCESSINGCOMPLETEDFAILEDCANCELLEDX-Request-IDCorrelation id for this request, adopted from the request or minted at the edge.401UnauthorizedErrorResponse ↗
Show 4 nested fields
codeenumrequiredinvalid_requestunauthenticatedpermission_deniednot_foundconflictrate_limitedunavailableinternalShow 6 nested fields
fieldstringoptionalmessagestringoptionalreasonenumoptionalapi_key_expiredapi_key_inactiveapi_key_invalidapi_key_revokedjob_not_foundretry_after_msintegeroptionaltypestringrequiredvalueobjectoptionalmessagestringrequiredrequest_idstringrequiredX-Request-IDCorrelation id for this request, adopted from the request or minted at the edge.404Not FoundErrorResponse ↗
Show 4 nested fields
codeenumrequiredinvalid_requestunauthenticatedpermission_deniednot_foundconflictrate_limitedunavailableinternalShow 6 nested fields
fieldstringoptionalmessagestringoptionalreasonenumoptionalapi_key_expiredapi_key_inactiveapi_key_invalidapi_key_revokedjob_not_foundretry_after_msintegeroptionaltypestringrequiredvalueobjectoptionalmessagestringrequiredrequest_idstringrequiredX-Request-IDCorrelation id for this request, adopted from the request or minted at the edge.422Unprocessable EntityErrorResponse ↗
Show 4 nested fields
codeenumrequiredinvalid_requestunauthenticatedpermission_deniednot_foundconflictrate_limitedunavailableinternalShow 6 nested fields
fieldstringoptionalmessagestringoptionalreasonenumoptionalapi_key_expiredapi_key_inactiveapi_key_invalidapi_key_revokedjob_not_foundretry_after_msintegeroptionaltypestringrequiredvalueobjectoptionalmessagestringrequiredrequest_idstringrequiredX-Request-IDCorrelation id for this request, adopted from the request or minted at the edge.429Rate limit exceededErrorResponse ↗
Show 4 nested fields
codeenumrequiredinvalid_requestunauthenticatedpermission_deniednot_foundconflictrate_limitedunavailableinternalShow 6 nested fields
fieldstringoptionalmessagestringoptionalreasonenumoptionalapi_key_expiredapi_key_inactiveapi_key_invalidapi_key_revokedjob_not_foundretry_after_msintegeroptionaltypestringrequiredvalueobjectoptionalmessagestringrequiredrequest_idstringrequiredRetry-AfterSeconds until the rate limit resets.X-RateLimit-ClassThe rate-limit class that was hit (read, mutation, ai-generation).X-RateLimit-LimitRequest budget for the matched class.X-RateLimit-RemainingRemaining requests in the current window.X-RateLimit-ResetUnix time (seconds) when the budget resets.X-Request-IDCorrelation id for this request, adopted from the request or minted at the edge.500Internal Server ErrorErrorResponse ↗
Show 4 nested fields
codeenumrequiredinvalid_requestunauthenticatedpermission_deniednot_foundconflictrate_limitedunavailableinternalShow 6 nested fields
fieldstringoptionalmessagestringoptionalreasonenumoptionalapi_key_expiredapi_key_inactiveapi_key_invalidapi_key_revokedjob_not_foundretry_after_msintegeroptionaltypestringrequiredvalueobjectoptionalmessagestringrequiredrequest_idstringrequiredX-Request-IDCorrelation id for this request, adopted from the request or minted at the edge.Example request
curl "https://api.veed.io/v1/lipsync-2.0/{job_id}" \
-H "Authorization: Bearer $VEED_API_KEY"import { Veed } from "@veedstudio/sdk";
const client = new Veed(); // reads VEED_API_KEY
const job = await client.lipsync20.get("<job_id>");
console.log(job.status);package main
import (
"context"
"fmt"
"log"
veed "github.com/veedstudio/veed-sdk-go"
)
func main() {
client, err := veed.NewClient() // reads VEED_API_KEY
if err != nil {
log.Fatal(err)
}
job, err := client.Lipsync20.Get(context.Background(), "<job_id>")
if err != nil {
log.Fatal(err)
}
fmt.Println(job.Status)
}Example response
{
"data": {
"error": {
"code": "input_validation",
"details": [
{
"field": "<field>",
"message": "<message>",
"type": "<type>"
}
],
"message": "<message>"
},
"job_id": "123e4567-e89b-12d3-a456-426614174000",
"result": {
"video": {
"content_type": "video/mp4",
"file_name": "<file_name>",
"file_size": 0,
"url": "<url>"
}
},
"status": "PROCESSING"
}
}Estimate a job
Prices are per second of the generated video.
- Measured
- 10 seconds
- Rate
- $0.07 / second