SyncDub - Video Translation and Dubbing

How to use SyncDub

1. Input: Enter a YouTube URL or path to a local video file, or upload a video
2. Target Language: Select the language you want to translate and dub into
3. TTS Engine:
   • Simple dubbing: Uses Edge TTS (faster but less natural sounding)
   • Voice cloning: Uses XTTS to clone the original speakers' voices (slower but more natural)
4. Maximum Speakers: Optionally specify the maximum number of speakers to detect
5. Translation Method: Choose the translation method (Batch, Iterative, or Groq)
6. Process: Click the Process Video button to start

Requirements

Make sure you have the following API tokens in your .env file:

• HUGGINGFACE_TOKEN: Required for speech diarization

Troubleshooting

• This might be slow as huggingface space uses cpu.
• If you encounter errors, check that all API tokens are set correctly
• For large videos, the process may take several minutes
• If voice cloning doesn't sound right, try simple dubbing instead