Transcribe multilingual audio files
Transcribe fast, in multiple languages.
Multilingual Speech to Text
Our advanced ASR technology is built on the robust foundation of OpenAI’s Whisper, known for its exceptional performance in multilingual speech recognition. However, we’ve significantly enhanced its capabilities with in-house innovations, including the implementation of phonetic time-stamps for 49 languages.
Benchmarks for top 10 supported languages
Rank | Code | Language | WER (%) on FLEURS |
---|---|---|---|
1 | es | Spanish | 3.0 |
2 | it | Italian | 4.0 |
3 | en | English | 4.2 |
4 | pt | Portuguese | 4.3 |
5 | de | German | 4.5 |
6 | ja | Japanese | 5.0 |
7 | pl | Polish | 5.6 |
8 | ru | Russian | 5.6 |
9 | nl | Dutch | 6.1 |
10 | id | Indonesian | 6.4 |
Transcirption is by default applied for the task protect. To have the transcription without any reduction use the task parameter and set it to transcribe.
Multilingual audio transcription without PHI reduction
Set target transcription language
Code-switching support
Our ASR component support’s for up to 4 languages and robust code-switching capabilities, it effortlessly transcribes audio that blends multiple languages. Its built-in automatic language detection ensures that users do not have to manually specify the language, streamlining the workflow, while precise time-stamps allow for easy navigation and review of audio content.
Benchmarks for top 4 supported languages for VoxPopuli
Language | Whisper-Large-V3 (WER) | Our’s (WER) | Δ (WER↓) |
---|---|---|---|
English | 8.93 | 7.60 | 1.33 |
French | 11.15 | 11.07 | 0.08 |
Spanish | 11.06 | 8.52 | 2.54 |
German | 17.75 | 12.41 | 5.34 |
Evaluation benchmark for the transcription of code-switched speech data.
Language | Whisper-Large-V2 (WER) | Our’s (WER) | Δ (WER↓) |
---|---|---|---|
English-Spanish | 37.13 | 13.45 | 23.68 |
Transcirption is by default applied for the task protect. To have the transcription without any reduction use the task parameter and set it to transcribe.
Transcribe multilingual audio data in 4 supported languages.
Good news to share with you!
Changelog
Looking ahead, we’re also pushing the envelope by refining our model with an extensive trove of medical data to eliminate hallucinations and boost reliability in even the most demanding environments. The Q2 realease will not only improve the recognition of complex medical terminology but also significantly mitigate transcirption errors, ensuring that results are both accurate and reliable. Whether you need rapid transcription for global communications or precise documentation in critical healthcare settings, our ASR component is designed to deliver excellence.