> ## Content Index
> Fetch the complete content index at: https://www.theleftshift.com/llms.txt
> Use this file to discover other available public pages before exploring further.

# Jivi AI Announces Jivi-AudioX, Speech-to-Text Model Family for Indic Languages
- URL: https://www.theleftshift.com/jivi-ai-announces-jivi-audiox-speech-to-text-model-family-for-indic-languages/
- Published: 2025-04-08T09:35:09.000Z
- Updated: 2025-04-08T09:35:09.000Z
- Description: The models can understand languages such as Hindi, Gujarati, Tamil, Telugu, and others spoken by over 95% of India's population.
- Author: The Left Shift Bureau
- Tags: AI Startups, #a42

Healthcare-focused AI startup[ Jivi AI](https://www.jivi.ai/?ref=theleftshift.com) has recently announced a new state-of-the-art (SOTA) speech-to-text (STT) model family for Indian languages. The models can understand languages such as Hindi, Gujarati, Tamil, Telugu, and others spoken by over 95% of India's population.

Navigating India’s linguistic diversity and complex audio landscape, the Jivi team has launched a cutting-edge speech model tailored for medical conversations. In just three months, they built **Jivi-AudioX**, a production-grade model addressing one of the hardest AI challenges: India's multilingual, code-switched, and noisy audio data.

![](https://storage.ghost.io/c/fd/78/fd78b498-7373-46b7-884c-46f69e81b24d/content/images/2025/04/1744100225547.jpeg)

**(Credits- JIvi AI)*

Built on OpenAI’s Whisper and fine-tuned on over 10,000 hours of proprietary and public medical audio, Jivi-AudioX delivers a 20.10% Word Error Rate (WER) across datasets like FLEURS, Common Voice, IndicTTS, Kathbath, and Gramvaani.

This performance not only supports more accurate and accessible medical transcriptions but also surpasses benchmarks set by major players like Google, Microsoft, ElevenLabs, Sarvam, and OpenAI itself.

"We're proudly open-sourcing the model on Hugging Face to support the wider AI and healthcare community. Jivi-AudioX comprises two specialized models," [Ankur Jain](https://www.linkedin.com/in/ankjain/?ref=theleftshift.com), co-founder & CEO at Jivi AI, said in a LinkedIn post. 

[#ai #speechtotext #healthcare #indiclanguages #opensource #medicalai | Ankur JainWe've hit a major milestone at Jivi. We've launched Jivi-AudioX, our state-of-the-art speech-to-text (STT) model family for Indic languages — Hindi, Gujarati, Tamil, Telugu, and others spoken by over 95% of India's population — optimized for medical conversations. Speech modeling for India is a uniquely hard problem—dozens of languages, sparse data, regional accents, code-switching, and noisy real-world audio make it one of the most complex challenges in AI. Our team shipped a production-grade model in just three months. Based on OpenAI's Whisper and finetuned on 10,000+ hours of proprietary and public medical audio, Jivi-AudioX achieves a 20.10% WER across FLEURS, Common Voice, IndicTTS, Kathbath, and Gramvaani — outperforming ElevenLabs, Sarvam, Google, Microsoft and OpenAI. 🎧 Try out the model here – https://lnkd.in/gJ\_e4fcn We're proudly open-sourcing the model on Hugging Face to support the wider AI and healthcare community. Jivi-AudioX comprises two specialized models: AudioX-North — tuned for Hindi, Marathi and Gujarati 👉 Model card: https://lnkd.in/gBD5qZgx AudioX-South — tuned for Tamil, Telugu, Kannada and Malayalam 👉 Model card: https://lnkd.in/grQbCQZV We're hiring. Please email us at careers@jivi.ai or apply on LinkedIn - https://lnkd.in/d3bYaHH6\. Sanjay G V Reddy AI Fund Andrew Ng Daniel Kraft, MD Jivi AI #AI #SpeechToText #Healthcare #IndicLanguages #OpenSource #MedicalAI![](https://storage.ghost.io/c/fd/78/fd78b498-7373-46b7-884c-46f69e81b24d/content/images/icon/al2o9zrvru7aqj8e1x2rzsrca-4)LinkedInAnkur Jain![](https://storage.ghost.io/c/fd/78/fd78b498-7373-46b7-884c-46f69e81b24d/content/images/thumbnail/1744100224932)](https://www.linkedin.com/feed/update/urn:li:activity:7315286560600399873/?ref=theleftshift.com)

Jivi has also released two regional variants:

- **AudioX-North**: Tuned for **Hindi, Marathi, and Gujarati** ([Model Card](https://lnkd.in/gBD5qZgx?ref=theleftshift.com))
- **AudioX-South**: Tuned for **Tamil, Telugu, Kannada, and Malayalam** ([Model Card](https://lnkd.in/grQbCQZV?ref=theleftshift.com))

The startup, funded by [Andrew Ng’s](https://analyticsindiamag.com/people/andrew-ng/?ref=theleftshift.com) AI Fund, has previously released Jivi MedX, which has ranked number 1 on the [Open Medical LLM Leaderboard](https://huggingface.co/spaces/openlifescienceai/open%5Fmedical%5Fllm%5Fleaderboard?ref=theleftshift.com). 

Jivi’s LLM, Jivi MedX, has beaten models such as OpenAI’s GPT-4 and Google’s Med-PaLM 2 with an average score of 91.65 across the leaderboard’s nine benchmark categories.