Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Announcing Sarvam Inference: SOTA open weight models served on Indian infrastructure.

MohapatraHemant's profile picture

Hemant Mohapatra

81,439 subscribers

54,502 Aufrufe • vor 2 Tagen •via X (Twitter)

Wissenschaft & TechnologieBildungNachrichten & Politik
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

New: separate leaderboards for open-weight models and closed-weight models on
0:36

New: separate leaderboards for open-weight models and closed-weight models on

OpenRouter

16,009 Aufrufe • vor 18 Tagen

.Fireworks AI is helping teams scale AI applications with a production platform for open-weight models, supporting world-class inference, fine-tuning, and enterprise AI workloads.
0:46

.Fireworks AI is helping teams scale AI applications with a production platform for open-weight models, supporting world-class inference, fine-tuning, and enterprise AI workloads.

Microsoft Azure

15,485 Aufrufe • vor 22 Tagen

🎥 Frustrated by Sora's credit limits? Still waiting for Veo 2? 🚀 Open-source video DiTs are actually on par. We introduce FastVideo, an open-source stack to support fast video generation for SoTA open models. We have supported Mochi and Hunyuan, 8x faster inference, 720P 5-second video in 62 seconds.
0:25

🎥 Frustrated by Sora's credit limits? Still waiting for Veo 2? 🚀 Open-source video DiTs are actually on par. We introduce FastVideo, an open-source stack to support fast video generation for SoTA open models. We have supported Mochi and Hunyuan, 8x faster inference, 720P 5-second video in 62 seconds.

Hao AI Lab

69,743 Aufrufe • vor 1 Jahr

Thank you to Markku Räsänen, CEO of ConfidentialMind for sitting down with us and sharing his thoughts on: - Whether open source models are undervalued - Changes in AI infrastructure & inference - Power consumption & efficiency in Europe - The future of open source AI
2:32

Thank you to Markku Räsänen, CEO of ConfidentialMind for sitting down with us and sharing his thoughts on: - Whether open source models are undervalued - Changes in AI infrastructure & inference - Power consumption & efficiency in Europe - The future of open source AI

SambaNova

31,874 Aufrufe • vor 11 Monaten

the market has evolved and Kimi K3 is bullish for the infrastructure layer "There’ll be an interesting, almost thermonuclear battle to provide the compute to support the demand that’s emerging for open weight models" -Benchmark's Peter Fenton Deepseek 1.5 yrs ago made everyone question how much compute AI would actually need. K3 points the other way -- cheaper, open models mean wider distribution, more usage, more inference
0:28

the market has evolved and Kimi K3 is bullish for the infrastructure layer "There’ll be an interesting, almost thermonuclear battle to provide the compute to support the demand that’s emerging for open weight models" -Benchmark's Peter Fenton Deepseek 1.5 yrs ago made everyone question how much compute AI would actually need. K3 points the other way -- cheaper, open models mean wider distribution, more usage, more inference

Deirdre Bosa

38,929 Aufrufe • vor 13 Tagen

1/ Announcing the first Compute Market on Nockchain: AI inference.
0:34

1/ Announcing the first Compute Market on Nockchain: AI inference.

Nockchain

167,270 Aufrufe • vor 2 Monaten

Free, instant access to 1M inference tok/day is now waitlist-free! Building the new onboarding flow and removing our waitlist were so fun to ship & all API signups automatically get > Free 1,000,000 toks/day > SOTA models on the world's fastest inference provider
0:21

Free, instant access to 1M inference tok/day is now waitlist-free! Building the new onboarding flow and removing our waitlist were so fun to ship & all API signups automatically get > Free 1,000,000 toks/day > SOTA models on the world's fastest inference provider

Sarah Chieng

120,480 Aufrufe • vor 1 Jahr

will open-source models become the majority of inference? dax weighs in: YES
2:27

will open-source models become the majority of inference? dax weighs in: YES

Lan

29,514 Aufrufe • vor 25 Tagen

We added 4 major open weight models in April. These powerful models are available for encrypted inference in the Maple apps, web, and API: - DeepSeek DeepSeek V4 - Kimi.ai Kimi K2.6 - Z.ai GLM 5.1 - Google Gemma Gemma 4 Power and privacy in one spot.
0:50

We added 4 major open weight models in April. These powerful models are available for encrypted inference in the Maple apps, web, and API: - DeepSeek DeepSeek V4 - Kimi.ai Kimi K2.6 - Z.ai GLM 5.1 - Google Gemma Gemma 4 Power and privacy in one spot.

Maple

11,640 Aufrufe • vor 3 Monaten

In a first for India, homegrown startup Pixxel teams up with India’s AI unicorn Sarvam to take data centres to the orbit🚀 Pixxel Founder & CEO Awais Ahmed tells Shereen Bhan why the future of AI infrastructure may not be on Earth at all. ‘SpaceX now has announced its own plans for launching a million data center satellites.’ ‘We have seen what Sarvam has been doing the last few months with sovereign AI models that they've trained and running inference there, and we have been focused on what we can do with the infrastructure that we are building in Bangalore, to build and launch better, bigger, better, larger satellites.’ Powered by NVIDIA GPUs, the satellite will run sovereign AI models directly in space using solar energy, orbital cooling and real-time AI inference. And the timeline? ‘Let’s see what can be done with one satellite this year’ #YoungTurksReloaded #Pixxel #Sarvam #AI #SpaceTech #OrbitalDataCentre #NVIDIA #SovereignAI
2:51

In a first for India, homegrown startup Pixxel teams up with India’s AI unicorn Sarvam to take data centres to the orbit🚀 Pixxel Founder & CEO Awais Ahmed tells Shereen Bhan why the future of AI infrastructure may not be on Earth at all. ‘SpaceX now has announced its own plans for launching a million data center satellites.’ ‘We have seen what Sarvam has been doing the last few months with sovereign AI models that they've trained and running inference there, and we have been focused on what we can do with the infrastructure that we are building in Bangalore, to build and launch better, bigger, better, larger satellites.’ Powered by NVIDIA GPUs, the satellite will run sovereign AI models directly in space using solar energy, orbital cooling and real-time AI inference. And the timeline? ‘Let’s see what can be done with one satellite this year’ #YoungTurksReloaded #Pixxel #Sarvam #AI #SpaceTech #OrbitalDataCentre #NVIDIA #SovereignAI

CNBC-TV18

30,407 Aufrufe • vor 2 Monaten

Alibaba just dropped Wan2.1 open AI Video Generation #1 on VBench leaderboard, outperforming SOTA open-source & commercial models Mastery in complex motion dynamics & physics simulation & text rendering
1:02

Alibaba just dropped Wan2.1 open AI Video Generation #1 on VBench leaderboard, outperforming SOTA open-source & commercial models Mastery in complex motion dynamics & physics simulation & text rendering

AK

75,807 Aufrufe • vor 1 Jahr

What is AI inference engineering, why is it such an in-demand skill, and how do you break into the field? With author of Inference Engineering Philip Kiely and head of training at Baseten Charlie O'Neill 0:00: What is inference? 2:47: History of inference 4:59: Downstream effects of AI research on inference 13:54: What you'll learn from Inference Engineering 16:14: Advice for engineers transitioning into AI 19:00: Open source models driving inference growth 20:55: Specialization vs. frontier closed models 23:51: "Big Token" and the importance of open source AI 27:18: Where to get Inference Engineering
27:58

What is AI inference engineering, why is it such an in-demand skill, and how do you break into the field? With author of Inference Engineering Philip Kiely and head of training at Baseten Charlie O'Neill 0:00: What is inference? 2:47: History of inference 4:59: Downstream effects of AI research on inference 13:54: What you'll learn from Inference Engineering 16:14: Advice for engineers transitioning into AI 19:00: Open source models driving inference growth 20:55: Specialization vs. frontier closed models 23:51: "Big Token" and the importance of open source AI 27:18: Where to get Inference Engineering

Madison Kanna

119,268 Aufrufe • vor 4 Monaten

India’s Sovereign Move - Sarvam Vision Cracks the Code across 22 Indian languages Sarvam Vision is an AI model from Sarvam AI that excels in optical character recognition (OCR) for 22 Indian languages, outperforming global models like Gemini and GPT-4o on Indic benchmarks. This achievement supports India's push for sovereign AI by digitizing real-world documents and archives in local scripts. ​ Sarvam Vision, a 3-billion-parameter model, handles "messy" scanned paperwork across languages like Hindi (95.91% accuracy), Bengali (92.61%), Tamil (93.42%), Marathi (93.13%), and even low-resource ones like Santali and Dogri (over 80%). ​ It structures data natively without relying on English translation layers, enabling applications in cultural recovery and document intelligence. ​ The model powers India's sovereign AI infrastructure under the IndiaAI Mission, where Sarvam was selected to build a national LLM. This launch fits Sarvam's broader stack, including prior models like Sarvam-Translate (also for 22 languages) and audio models for code-mixed speech. By focusing on Indic challenges ignored by Western AI, it unlocks centuries of knowledge in non-English archives. ​ Recent demos, like digitizing historical texts, highlight its real-world impact beyond benchmarks. Credit : AIM Network.
6:27

India’s Sovereign Move - Sarvam Vision Cracks the Code across 22 Indian languages Sarvam Vision is an AI model from Sarvam AI that excels in optical character recognition (OCR) for 22 Indian languages, outperforming global models like Gemini and GPT-4o on Indic benchmarks. This achievement supports India's push for sovereign AI by digitizing real-world documents and archives in local scripts. ​ Sarvam Vision, a 3-billion-parameter model, handles "messy" scanned paperwork across languages like Hindi (95.91% accuracy), Bengali (92.61%), Tamil (93.42%), Marathi (93.13%), and even low-resource ones like Santali and Dogri (over 80%). ​ It structures data natively without relying on English translation layers, enabling applications in cultural recovery and document intelligence. ​ The model powers India's sovereign AI infrastructure under the IndiaAI Mission, where Sarvam was selected to build a national LLM. This launch fits Sarvam's broader stack, including prior models like Sarvam-Translate (also for 22 languages) and audio models for code-mixed speech. By focusing on Indic challenges ignored by Western AI, it unlocks centuries of knowledge in non-English archives. ​ Recent demos, like digitizing historical texts, highlight its real-world impact beyond benchmarks. Credit : AIM Network.

Augadh

20,645 Aufrufe • vor 5 Monaten

Open source/weight models are often used in regulated industries like Health Care or Financial Services, where they handle personally identifiable data, and can't send it to proprietary LLM providers. We recently chatted to Vaibhav (VB) Srivastav about the partnership VS Visual Studio Code and Hugging Face inference providers have to let you use open weight models directly in your IDE! Something that surprised me was just how fast inference providers like Cerebras make it to generate code! In this episode we made a journaling CLI tool using Qwen! I personally love open source and hope more of these models will become small enough to run locally!
1:36

Open source/weight models are often used in regulated industries like Health Care or Financial Services, where they handle personally identifiable data, and can't send it to proprietary LLM providers. We recently chatted to Vaibhav (VB) Srivastav about the partnership VS Visual Studio Code and Hugging Face inference providers have to let you use open weight models directly in your IDE! Something that surprised me was just how fast inference providers like Cerebras make it to generate code! In this episode we made a journaling CLI tool using Qwen! I personally love open source and hope more of these models will become small enough to run locally!

Marlene Mhangami

18,215 Aufrufe • vor 8 Monaten

Claude Fable 5 is INSANE 🤯 So we asked it to build the perfect private AI infrastructure, where: → 500+ open models run behind a single API, not one company's black box → An open data marketplace → You fine-tune and serve models on decentralized GPU compute → Agents pay per call in USDC via x402 → Every model, dataset, and payment settles on Base It failed. Luckily, we've spent years building exactly that. Private Inference. Data. Compute. Settlement. One private AI infrastructure layer. Cluster Protocol.
0:21

Claude Fable 5 is INSANE 🤯 So we asked it to build the perfect private AI infrastructure, where: → 500+ open models run behind a single API, not one company's black box → An open data marketplace → You fine-tune and serve models on decentralized GPU compute → Agents pay per call in USDC via x402 → Every model, dataset, and payment settles on Base It failed. Luckily, we've spent years building exactly that. Private Inference. Data. Compute. Settlement. One private AI infrastructure layer. Cluster Protocol.

Cluster Protocol

25,516 Aufrufe • vor 1 Monat

BOOM! Starting today you can use open source frontier LLMs in Visual Studio Code with HF Inference Providers! 🔥 Use your inference credits on SoTA llms like GLM 4.5, Qwen3 Coder, DeepSeek 3.1 and more All of it packaged in one simple extension - try it out today 🤗
1:52

BOOM! Starting today you can use open source frontier LLMs in Visual Studio Code with HF Inference Providers! 🔥 Use your inference credits on SoTA llms like GLM 4.5, Qwen3 Coder, DeepSeek 3.1 and more All of it packaged in one simple extension - try it out today 🤗

Vaibhav (VB) Srivastav

41,201 Aufrufe • vor 10 Monaten

DeepSeek v3.2 on Baseten is SOTA open-source performance at SOTA speed. Available now, in Cline.
0:43

DeepSeek v3.2 on Baseten is SOTA open-source performance at SOTA speed. Available now, in Cline.

Cline

24,155 Aufrufe • vor 8 Monaten

🤝 Arcee.ai, an American AI lab, built its frontier open model family on NVIDIA Blackwell Ultra. Its flagship MoE model, Trinity-Large-Thinking, was RL post-trained using NVIDIA NeMo open libraries. Arcee optimized agentic model inference with NVIDIA Dynamo and vLLM, along with NVIDIA accelerated networking, to deliver low token cost, achieving: ✅ 3T+ tokens served on OpenRouter in its first two months ✅ $0.90 per 1M output tokens ✅ 2nd on PinchBench for open agentic models Explore Arcee's open models, powered by NVIDIA ➡️
1:12

🤝 Arcee.ai, an American AI lab, built its frontier open model family on NVIDIA Blackwell Ultra. Its flagship MoE model, Trinity-Large-Thinking, was RL post-trained using NVIDIA NeMo open libraries. Arcee optimized agentic model inference with NVIDIA Dynamo and vLLM, along with NVIDIA accelerated networking, to deliver low token cost, achieving: ✅ 3T+ tokens served on OpenRouter in its first two months ✅ $0.90 per 1M output tokens ✅ 2nd on PinchBench for open agentic models Explore Arcee's open models, powered by NVIDIA ➡️

NVIDIA AI Infrastructure

27,180 Aufrufe • vor 17 Tagen

Leaders of all top AI model makers from OpenAI, Anthropic, Google DeepMind including Indian models like Sarvam signing voluntary declarations on response AI development and use. At the historic #IndiaAIImpactSummit2026. Pardon the chatter behind
2:18

Leaders of all top AI model makers from OpenAI, Anthropic, Google DeepMind including Indian models like Sarvam signing voluntary declarations on response AI development and use. At the historic #IndiaAIImpactSummit2026. Pardon the chatter behind

Mausam (IITD)

13,277 Aufrufe • vor 5 Monaten

India is accelerating its sovereign AI mission with homegrown models built for local languages and governance needs. Bengaluru-based Sarvam AI has launched Sarvam Vision, an OCR system for complex paper records, and Bulbul, a text-to-speech model spanning 11 Indian languages. Sarvam claims its OCR beat Google Gemini on a benchmark. Backed by government funding, the programme aims to cut dependence on foreign AI systems. Watch this report. 🔽
5:05

India is accelerating its sovereign AI mission with homegrown models built for local languages and governance needs. Bengaluru-based Sarvam AI has launched Sarvam Vision, an OCR system for complex paper records, and Bulbul, a text-to-speech model spanning 11 Indian languages. Sarvam claims its OCR beat Google Gemini on a benchmark. Backed by government funding, the programme aims to cut dependence on foreign AI systems. Watch this report. 🔽

BJP

34,446 Aufrufe • vor 5 Monaten