Loading video...

Video Failed to Load

Go Home

introducing rumik oss 1 india's first state of the art open source, fully pre-trained voice model capable of speaking 20+ languages trained on only 66k hours of data, it beats even the top closed models on multiple benchmarks including emotion realism weights are now live 👇🏻

100,771 views • 12 days ago •via X (Twitter)

47 Comments

rohan's profile picture
rohan12 days ago

rumik oss 1 is a 3 billion parameter open weights text to speech model it can speak in indian english, hindi, telugu, tamil, kannada, bengali, punjabi and switches between them mid-sentence, and takes delivery instructions in plain text full research blog - download the weights on hugging face -

rohan's profile picture
rohan12 days ago

describe how you want the model to sound like, and it will follow those instructions here are some examples 👇🏻

rohan's profile picture
rohan12 days ago

along with the model, we are also open sourcing two of our internal benchmarks 1. indic-emo this benchmark tests can a model hold an emotion through code-switched speech? 100 prompts, each mixing two to five of our seven languages, equal coverage of happy, sad, angry, excited and professional. three judge models score anonymized clips on a five-point rubric covering tone, dynamics, phrasing and sustained expression. rumik oss 1 comfortably beats @cartesia, @ElevenLabs and only @GeminiApp is better and by a big margin it was expected given gemini 3.1 flash tts must be trained on 1000x more data compared to rumik oss 1 is only trained on 66k hours in total

rohan's profile picture
rohan12 days ago

2. nova this benchmark measures precise delivery of emotions for eg - if you ask for a laugh at word seven, does it land at word seven? 149 english prompts, one vocalization each at a specified word position, seven systems, three synthesis runs. three detectors check position-correct rendering. benchmark + protocol ->

rohan's profile picture
rohan12 days ago

on WER (word error rate) and CER (character error rate) rumik oss 1 tops odia, konkani, maithili while comes second in assamese, kannada, nepali, malyalam

rohan's profile picture
rohan12 days ago

rumik oss 1 comes with CC BY-NC 4.0 license plus an acceptable use addendum. that makes it open weights for research and non-commercial use, speech research, benchmarking, teaching, finetuning for experiments. you can share the weights and your adaptations under the same terms, keeping attribution, license links and a note of what you changed.

Soumith Chintala's profile picture
Soumith Chintala12 days ago

congrats to the @rumik_ai team. looks like a good first attempt. hope to see rapid iterations.

rohan's profile picture
rohan12 days ago

@rumik_ai thanks a ton @soumithchintala

Arpan (Locked In ARC)'s profile picture
Arpan (Locked In ARC)12 days ago

LFG🔥🔥

Arpan (Locked In ARC)'s profile picture
Arpan (Locked In ARC)12 days ago

You will win 🍀

Vaibhav Srivastava's profile picture
Vaibhav Srivastava12 days ago

Congratulations 🎊

Rahul Guha's profile picture
Rahul Guha12 days ago

I was using @SarvamAI, let's see how this plays out.

rohan's profile picture
rohan12 days ago

@SarvamAI let's go

Mad scientist 🥼's profile picture
Mad scientist 🥼12 days ago

Congratulations, how can we contribute?

rohan's profile picture
rohan12 days ago

Spread the word 🤌

AMBUJ TIWARI's profile picture
AMBUJ TIWARI12 days ago

I'll make sure to cover each update from now 🙌

rohan's profile picture
rohan12 days ago

hahaha indeed

cheaty's profile picture
cheaty12 days ago

took you guys long enough

∞ Gman's profile picture
∞ Gman12 days ago

Great move to open source it 💪 We should add them to @indos_tech catalog @utkarsh_k1c

Genysis AI's profile picture
Genysis AI12 days ago

Great I am happy india is taking root in ai landscape

Samiksha Shukla's profile picture
Samiksha Shukla12 days ago

Crazy! Excited to try it out!!

rohan's profile picture
rohan12 days ago

lmk how it goes!

pushkar's profile picture
pushkar12 days ago

super cool, congratulations on the release!

rohan's profile picture
rohan12 days ago

thanks @thepushkarp

Mehar's profile picture
Mehar12 days ago

never not impressed by rumik. so so good 🙌

Brian Hadu's profile picture
Brian Hadu12 days ago

if it really beats top closed models, it could shift the landscape for accessibility

himanshu's profile picture
himanshu12 days ago

very cool, congrats!

rohan's profile picture
rohan11 days ago

tahnks @himanshustwts

Aryan's profile picture
Aryan12 days ago

🚀🚀🚀🚀

Kimi Nguyen's profile picture
Kimi Nguyen12 days ago

training on just 66k hours and outperforming top models is no small feat

Ayman's profile picture
Ayman12 days ago

Congratulations 🎉. Is Bengali trained as well?

rohan's profile picture
rohan12 days ago

Yes

Parth's profile picture
Parth12 days ago

very cool, congrats on the launch!

aniketh's profile picture
aniketh12 days ago

never bet against these guys @lets_dig_deeper and @bhartivatsal ❤️

Srinivasa Babu 💙's profile picture
Srinivasa Babu 💙12 days ago

It's exciting to know that we have multiple options across different languages, which can now be used as an alternative to Google's live models. Though at this point in time, I would still prefer using Gemini Live because I feel I can make it sound better in Tamil and have the same expressiveness that has been demonstrated here. I am really excited to try this on the next version, though!

Noctus's profile picture
Noctus12 days ago

Congrats for the launch

ᱫᱩᱞᱟᱹᱲ's profile picture
ᱫᱩᱞᱟᱹᱲ12 days ago

does it support Santali?

kartik's profile picture
kartik12 days ago

insane🔥, and well detailed blog!

Aru_sharma's profile picture
Aru_sharma12 days ago

Let's go congrats for the crazy feat

Krishna Chaturvedi's profile picture
Krishna Chaturvedi12 days ago

66k hours and these benchmark results is seriously impressive. Great work.🤌

Atharva's profile picture
Atharva12 days ago

Incredible timing, I just spent half a day messing with Sarvam to make it sound right. Congrats!

Arib Zeeshan's profile picture
Arib Zeeshan12 days ago

This is the first indian AI thing that is actually superior to the other peer products.........I dont know how well it is compared to GPT Live (Its the current SOTA I think), But certainly one of the better open source models from the demos I have seen.

Hrushik Pabbathi's profile picture
Hrushik Pabbathi12 days ago

yooo that's insane!! congrats!!

Neelakandan NC's profile picture
Neelakandan NC12 days ago

Languages are finally becoming our strength

Nipun Taneja's profile picture
Nipun Taneja12 days ago

W

Rohan Malik's profile picture
Rohan Malik12 days ago

from Rohan to another....keep at it bro...naam roshan karo humara.

Vineeth's profile picture
Vineeth12 days ago

Lfggggg

Related Videos