{"id":116152,"date":"2024-08-17T15:03:12","date_gmt":"2024-08-17T15:03:12","guid":{"rendered":"https:\/\/news.talkwithrattan.com\/index.php\/2024\/08\/17\/heres-a-big-leap-into-use-of-genai-in-indian-languages-times-of-india\/"},"modified":"2024-08-17T15:03:12","modified_gmt":"2024-08-17T15:03:12","slug":"heres-a-big-leap-into-use-of-genai-in-indian-languages-times-of-india","status":"publish","type":"post","link":"https:\/\/news.talkwithrattan.com\/index.php\/2024\/08\/17\/heres-a-big-leap-into-use-of-genai-in-indian-languages-times-of-india\/","title":{"rendered":"Here\u2019s a big leap into use of GenAI in Indian languages – Times of India"},"content":{"rendered":"
\"Here\u2019s<\/div>


\n<\/p>\n

In a modest office in Bengaluru, a soft-spoken entrepreneur is charting an ambitious course to make India a powerhouse in generative artificial intelligence tailored for the nation\u2019s linguistic diversity.
Vivek Raghavan, the co-founder of Sarvam AI, believes the key to unlocking AI\u2019s potential in India lies in developing models that can understand and communicate in the country\u2019s many regional languages through voice interfaces.
\u201cIndians will interact with generative AI through voice in their own language,\u201d Raghavan tells us.
At the heart of Sarvam\u2019s approach is the idea that while massive language models like GPT-4o and Gemini 1.5 offer impressive capabilities, much of what people need can be achieved with far smaller, more efficient models finetuned for specific tasks and linguistic contexts.
\u201cIf I want to do something that\u2019s relevant millions of times a day, I can\u2019t use those large models. It\u2019s too expensive and not accurate enough,\u201d Raghavan explains. \u201cFor a use case like customer support for a telecom company, I want a smaller, purpose-built model that outperforms bigger models on that task.\u201d<\/p>\n
\n
<\/div>\n<\/div>\n

To this end, Sarvam just announced Sarvam 2B, an open-source 2 billion parameter model trained from scratch on trillions of tokens of Indian language data, including synthetically generated text. At just a fraction of the size of models like GPT-4, and at a fraction of its cost, Sarvam 2B promises to deliver superior performance on Indian language tasks like translation, transliteration, and summarisation. And it\u2019s does it for 10 Indian languages.
The company also unveiled \u201cSarvam Agents\u201d \u2014 multilingual, voiceenabled AI assistants that can perform actions like booking tickets or scheduling meetings through telephony, WhatsApp or in-app interfaces. The cost? As low as 1 rupee per minute.
In a demo we saw, a voice AI agent deployed on the phone line of a healthcare customer starts by saying: \u201cNamaste, Sarvam Saathi tak pahunchne ke liye, dhanyavad. Aap ki kya madad kar sakti hoon? (Thank you for reaching out to Sarvam. How can I help you?). Then starts a seamless conversation in Hinglish with a user who has a dental issue. The bot was able to understand even uniquely Indian utterances. There was no latency. If the user interrupted the bot, the bot handled that beautifully. It understood all queries, and it even tually even booked an appointment for the user with a doctor for the preferred date.
Unconventional beginnings<\/span>
Raghavan\u2019s path to founding Sarvam is unconventional. For 15 years, he worked as a volunteer on India\u2019s massive Aadhaar digital identity project. This experience, he says, gave him the drive to leverage technology for societal impact. \u201cI see a future where every child can get a quality education (via AI), which was not possible before this,\u201d he says, echoing a point made by Indian-American entrepreneur & venture capitalist to TOI earlier this week.
He bumped into the Indian lan guage AI problem over a decade ago when the Supreme Court sought a way to translate judgments into regional languages. This led him to advise the government\u2019s Bhashini initiative \u2013 India\u2019s AI-led language translation platform, launched as part of the Digital India vision.
The decision to finally form a for-profit startup, rather than continue in the public or non-profit sector, was driven by the need for speed and scale. \u201cWe need to move faster,\u201d Raghavan explains. \u201cThis is a space where globally, things are moving very fast.\u201d
Sarvam\u2019s approach reflects Raghavan\u2019s belief in \u201csovereign AI\u201d \u2014 models tailored for Indian contexts that can be deployed on-premises by enterprises concerned about data privacy. It\u2019s also about giving Indian researchers the tools to push the boundaries of language AI.
The company is open-sourcing the audio language model that\u2019s built on top of Meta\u2019s open-source Llama model. \u201cWe want the Indian AI ecosystem to make progress,\u201d Raghavan says.
Fundamental innovations<\/span>
Under the hood, Sarvam has pioneered techniques to reduce the \u201ctokenizer tax\u201d that makes representing Indian language text inefficient in standard models. In AI and ML parlance, a token can represent an entire word or just a single character, Indian languages routinely fall prey to the negative effects of the second category, because the number of tokens it usually takes to represent an Indian language is far higher than say for a language like English. Which is why methods to reduce the tokenizer tax of using an Indian language was important, says Raghavan. Fewer tokens mean a smaller, more efficient model.
The company also embraced synthetic data generation as a way to augment limited real-world datasets for Indian languages. \u201cWe\u2019ve built models to generate data and we\u2019re using that data to train models,\u201d Raghavan says. Sarvam\u2019s 2B model was trained on a cluster provided by Indian company Yotta.
Looking ahead, Raghavan sees opportunities to apply generative AI to domains rich in Indian knowledge like Ayurveda, where models could synthesise information from ancient texts into a coherent, referenceable corpus.<\/div>\n