Video yükleniyor...

Video Yüklenemedi

Bu video yüklenirken bir sorun oluştu. Bu geçici bir ağ sorunundan kaynaklanıyor olabilir veya video kullanılamıyor olabilir.

Ana Sayfaya Dön

With Kimi K3 Day-0 on vLLM: Open Frontier Intelligence for Everyone 🚀 At 2.8 trillion parameters, Moonshot AI's Kimi K3 is one of the most powerful open-weight models ever released. Starting today, you can serve it on vLLM the moment the weights are public. What K3 brings: 🧠 2.8T-parameter... Mixture-of-Experts (16 of 896 experts active per token) 📚 1M-token context window 🛠️ Native multimodal understanding, including vision ⚡ Kimi Delta Attention: a hybrid of linear and full attention that makes million-token context affordable Huge thank you to Kimi.ai AI for the model release and partnership, Inferact for leading the vLLM optimizations, and to our partners at NVIDIA, AMD, and the broader vLLM community. 1/6show more

vLLM

45,442 subscribers

95,596 görüntüleme • 3 gün önce •via X (Twitter)

Bilim & Teknoloji

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

WOW: Kimi K3 just killed the AI subscription era 🇨🇳 On July 27, Moonshot publishes the full K3 weights under a modified MIT license. ▫️ 2.8 trillion parameters ▫️ 1M token context ▫️ Open weights, yours to run "The frontier becomes a file." The closed labs charge you monthly for access. Moonshot just made the frontier a download. Does open weight end the subscription model, or do the big labs still win on polish?

WOW: Kimi K3 just killed the AI subscription era 🇨🇳 On July 27, Moonshot publishes the full K3 weights under a modified MIT license. ▫️ 2.8 trillion parameters ▫️ 1M token context ▫️ Open weights, yours to run "The frontier becomes a file." The closed labs charge you monthly for access. Moonshot just made the frontier a download. Does open weight end the subscription model, or do the big labs still win on polish?

Ruben

94,742 görüntüleme • 9 gün önce

🎉 Congrats to MiniMax (official) on releasing MiniMax M3! Frontier coding and agentic capabilities, native image and video input, computer use, and a 1M-token context window, all in a single open model. At the heart of M3 is MSA, a new sparse attention architecture: instead of attending densely over the full KV cache, each query scores 128-token KV blocks and runs attention only over the top blocks. That is what makes 1M-token context practical to serve. M3 runs in vLLM with day-0 support, verified on NVIDIA and AMD hardware: ✨ MSA sparse attention with dedicated prefill and decode kernels ✨ 1M-token context serving with prefix caching and chunked prefill ✨ BF16 and MXFP8 checkpoints, with MoE backends for both Hopper and Blackwell ✨ Native multimodal input (image + video) ✨ Tool calling, reasoning parsing, and thinking-mode control for agent workloads Day-0 support like this is a true team effort. Grateful to the teams at MiniMax (official), NVIDIA AI, AI at AMD, and Inferact, and to the vLLM community for making it happen. 🙏 Deep dive into the implementation, kernel work, and deployment recipes: 🔗

🎉 Congrats to MiniMax (official) on releasing MiniMax M3! Frontier coding and agentic capabilities, native image and video input, computer use, and a 1M-token context window, all in a single open model. At the heart of M3 is MSA, a new sparse attention architecture: instead of attending densely over the full KV cache, each query scores 128-token KV blocks and runs attention only over the top blocks. That is what makes 1M-token context practical to serve. M3 runs in vLLM with day-0 support, verified on NVIDIA and AMD hardware: ✨ MSA sparse attention with dedicated prefill and decode kernels ✨ 1M-token context serving with prefix caching and chunked prefill ✨ BF16 and MXFP8 checkpoints, with MoE backends for both Hopper and Blackwell ✨ Native multimodal input (image + video) ✨ Tool calling, reasoning parsing, and thinking-mode control for agent workloads Day-0 support like this is a true team effort. Grateful to the teams at MiniMax (official), NVIDIA AI, AI at AMD, and Inferact, and to the vLLM community for making it happen. 🙏 Deep dive into the implementation, kernel work, and deployment recipes: 🔗

vLLM

40,306 görüntüleme • 1 ay önce

The Kimi AI Model And What If This Carnegie Mellon, PhD student was incentivized to open source AI in the US? The answer is Kimi would have been an open source US model. Yang Zhilin Moonshot’s founder and maker of the Kimi series turned his deep research expertise into one of the world’s most capable open AI systems. After earning his PhD at Carnegie Mellon under leading researchers and interning at Google Brain and Meta, he returned to China and co-founded Moonshot AI in March 2023 with Tsinghua classmates Zhou Xinyu and Wu Yuxin. Why? The US VC world and tax structure did not favor Zhilin’s proposal to open source the AI models as a strategy. So he left. He named the company after his favorite Pink Floyd album, reflecting his ambitious vision for scalable. Yang assembled a core technical team of inventors behind breakthroughs like Transformer-XL and RoPE. Together they focused on turning massive compute into efficient intelligence through innovative architectures. The journey began with the Kimi chatbot in October 2023, rapidly scaling context from 200,000 to millions of characters. This evolved into the Kimi series: K1.5 matched top reasoning models, K2 introduced a 1-trillion-parameter Mixture-of-Experts design trained on 15.5 trillion tokens and released openly, and K2 Thinking added advanced agentic capabilities. Kimi K3 represents the pinnacle, this 2.8-trillion-parameter model uses a sparse MoE architecture with 896 experts (only 16 active per token), new Kimi Delta Attention and attention residuals for efficiency, and a 1-million-token context window. It delivers frontier performance in long-horizon coding, reasoning, and multimodal tasks at competitive cost, with weights set for open release. Yang’s approach emphasizes openness, efficiency, and continuous self-improvement — enabling solo developers and teams to achieve what once required massive resources. By sharing technical insights in public talks, he has accelerated global progress toward more accessible, powerful AI. Imagine if we held open source higher than the fear theater games of Anthropic? We are chasing out some of the best minds. This is how you lose…

The Kimi AI Model And What If This Carnegie Mellon, PhD student was incentivized to open source AI in the US? The answer is Kimi would have been an open source US model. Yang Zhilin Moonshot’s founder and maker of the Kimi series turned his deep research expertise into one of the world’s most capable open AI systems. After earning his PhD at Carnegie Mellon under leading researchers and interning at Google Brain and Meta, he returned to China and co-founded Moonshot AI in March 2023 with Tsinghua classmates Zhou Xinyu and Wu Yuxin. Why? The US VC world and tax structure did not favor Zhilin’s proposal to open source the AI models as a strategy. So he left. He named the company after his favorite Pink Floyd album, reflecting his ambitious vision for scalable. Yang assembled a core technical team of inventors behind breakthroughs like Transformer-XL and RoPE. Together they focused on turning massive compute into efficient intelligence through innovative architectures. The journey began with the Kimi chatbot in October 2023, rapidly scaling context from 200,000 to millions of characters. This evolved into the Kimi series: K1.5 matched top reasoning models, K2 introduced a 1-trillion-parameter Mixture-of-Experts design trained on 15.5 trillion tokens and released openly, and K2 Thinking added advanced agentic capabilities. Kimi K3 represents the pinnacle, this 2.8-trillion-parameter model uses a sparse MoE architecture with 896 experts (only 16 active per token), new Kimi Delta Attention and attention residuals for efficiency, and a 1-million-token context window. It delivers frontier performance in long-horizon coding, reasoning, and multimodal tasks at competitive cost, with weights set for open release. Yang’s approach emphasizes openness, efficiency, and continuous self-improvement — enabling solo developers and teams to achieve what once required massive resources. By sharing technical insights in public talks, he has accelerated global progress toward more accessible, powerful AI. Imagine if we held open source higher than the fear theater games of Anthropic? We are chasing out some of the best minds. This is how you lose…

Brian Roemmele

37,185 görüntüleme • 10 gün önce

Chinese labs are now competing with each other to build the strongest open-weight model. > DeepSeek started the domino effect > Qwen kept improving across coding, reasoning and long context > GLM, MiniMax and Moonshot joined the race > Kimi K3 pushed it to 2.8T parameters and a 1M context window > now Alibaba is answering with Qwen3.8 > 2.4T parameters > full open-weight release coming soon > Alibaba says it is second only to Fable 5 Qwen3.8 may be the model that brings open-weight AI closest to Claude Fable 5.

Chinese labs are now competing with each other to build the strongest open-weight model. > DeepSeek started the domino effect > Qwen kept improving across coding, reasoning and long context > GLM, MiniMax and Moonshot joined the race > Kimi K3 pushed it to 2.8T parameters and a 1M context window > now Alibaba is answering with Qwen3.8 > 2.4T parameters > full open-weight release coming soon > Alibaba says it is second only to Fable 5 Qwen3.8 may be the model that brings open-weight AI closest to Claude Fable 5.

Tornado guy

64,960 görüntüleme • 11 gün önce

SGLang day-0 speed on Kimi K3: 423 tok/s (measured on gsm8k), plus RL support ready in Miles RadixArk! How the largest open-source model runs this fast: we natively implemented and deeply optimized K3’s new architecture with fused KDA decode kernels, DP attention, DSpark, PD disagg, and KDA-aware prefix caching. We've passed Kimi Vendor Verifier and are ready for production! Thanks to Kimi.ai, NVIDIA, AMD, KVCache.AI, Modal, and Baseten for building this with us, and to Google Cloud, Nebius Token Factory, fal, DigitalOcean, Runpod, DeepInfra and GMI Cloud for serving K3 on SGLang. Blog, cookbook, benchmarks in the comments. P.S. This demo video? Kimi K3 made it itself. Play the game 👇

SGLang day-0 speed on Kimi K3: 423 tok/s (measured on gsm8k), plus RL support ready in Miles RadixArk! How the largest open-source model runs this fast: we natively implemented and deeply optimized K3’s new architecture with fused KDA decode kernels, DP attention, DSpark, PD disagg, and KDA-aware prefix caching. We've passed Kimi Vendor Verifier and are ready for production! Thanks to Kimi.ai, NVIDIA, AMD, KVCache.AI, Modal, and Baseten for building this with us, and to Google Cloud, Nebius Token Factory, fal, DigitalOcean, Runpod, DeepInfra and GMI Cloud for serving K3 on SGLang. Blog, cookbook, benchmarks in the comments. P.S. This demo video? Kimi K3 made it itself. Play the game 👇

LMSYS Org

183,495 görüntüleme • 3 gün önce

Found a way to run Kimi K3 for FREE with daily credits on 😳 it's a 2.8T parameter model. 1M context. beats Fable 5 on coding benchmarks. what you get for $0: -2.8 trillion parameters -1M context window -beats Fable 5 on SWE Marathon (42 vs 35) -beats Fable 5 on Program Bench (77.8) -topped BrowseComp (91.2) -native vision understanding What this replaces: -Paid frontier API costs for coding agents -Fable 5 at $30/M output tokens -GPT-5.6 Sol at $25/M output tokens how to use it (2 min): 1. Go to 2. Sign up with email 3. Start using K3 — it's the default model Also available on desktop app, CLI, and mobile. Important: Free daily credits reset. Full open weights dropping July 27. Rate limits apply on free tier. use this before the free tier gets crowded

Found a way to run Kimi K3 for FREE with daily credits on 😳 it's a 2.8T parameter model. 1M context. beats Fable 5 on coding benchmarks. what you get for $0: -2.8 trillion parameters -1M context window -beats Fable 5 on SWE Marathon (42 vs 35) -beats Fable 5 on Program Bench (77.8) -topped BrowseComp (91.2) -native vision understanding What this replaces: -Paid frontier API costs for coding agents -Fable 5 at $30/M output tokens -GPT-5.6 Sol at $25/M output tokens how to use it (2 min): 1. Go to 2. Sign up with email 3. Start using K3 — it's the default model Also available on desktop app, CLI, and mobile. Important: Free daily credits reset. Full open weights dropping July 27. Rate limits apply on free tier. use this before the free tier gets crowded

painn

251,450 görüntüleme • 12 gün önce

Today we announced a $150M seed round in Inferact, a new startup led by the maintainers of the vLLM project. Inferact will support the vLLM open source project through dedicated financial and developer resources and build what they see as the next generation commercial inference engine. Cofounders Simon Mo and Woosuk Kwon joined a16z GP Matt Bornstein for a conversation on how vLLM came to be, what they’ve learned from building it, and what they’re now doing at Inferact. They cover how vLLM began as a side project, why open source is essential to the world’s AI infrastructure, why inference is getting harder, and more. 00:00 Introduction 11:41 Community and collaboration in vLLM 19:19 Understanding inference engines 24:27 Cluster scale and GPU deployment 31:19 Belief in open source AI 35:45 Founding Inferact 40:00 The future of Inference at scale Simon Mo Woosuk Kwon Matt Bornstein

Today we announced a $150M seed round in Inferact, a new startup led by the maintainers of the vLLM project. Inferact will support the vLLM open source project through dedicated financial and developer resources and build what they see as the next generation commercial inference engine. Cofounders Simon Mo and Woosuk Kwon joined a16z GP Matt Bornstein for a conversation on how vLLM came to be, what they’ve learned from building it, and what they’re now doing at Inferact. They cover how vLLM began as a side project, why open source is essential to the world’s AI infrastructure, why inference is getting harder, and more. 00:00 Introduction 11:41 Community and collaboration in vLLM 19:19 Understanding inference engines 24:27 Cluster scale and GPU deployment 31:19 Belief in open source AI 35:45 Founding Inferact 40:00 The future of Inference at scale Simon Mo Woosuk Kwon Matt Bornstein

a16z

87,993 görüntüleme • 6 ay önce

Nobody expected the largest AI model ever built to be free. Kimi K3 just shipped at 2.8 trillion parameters. Full weights go public in ten days. No API waitlist. No enterprise sales call. No usage tier. Closed labs spent two years selling "frontier intelligence" as something you rent. Open source just proved you can own it outright. The gap everyone bet on didn't shrink. It closed.

Nobody expected the largest AI model ever built to be free. Kimi K3 just shipped at 2.8 trillion parameters. Full weights go public in ten days. No API waitlist. No enterprise sales call. No usage tier. Closed labs spent two years selling "frontier intelligence" as something you rent. Open source just proved you can own it outright. The gap everyone bet on didn't shrink. It closed.

Shawn Chauhan

51,064 görüntüleme • 12 gün önce

Rockstar spent 7 years, 2,000+ developers, and $500 million to build Red Dead Redemption 2. Kimi K3 rebuilt the same scene in 10 hours. One prompt. 4 million tokens. It's open source. 2.8 trillion parameters. A 1 million token context window. It beats Claude Opus 4.8 and GPT-5.6. It sits on par with Fable 5. Fable 5 results, at Sonnet pricing. The wall between you and a AAA game used to be a studio. Now it's a prompt.

Rockstar spent 7 years, 2,000+ developers, and $500 million to build Red Dead Redemption 2. Kimi K3 rebuilt the same scene in 10 hours. One prompt. 4 million tokens. It's open source. 2.8 trillion parameters. A 1 million token context window. It beats Claude Opus 4.8 and GPT-5.6. It sits on par with Fable 5. Fable 5 results, at Sonnet pricing. The wall between you and a AAA game used to be a studio. Now it's a prompt.

Dep

99,083 görüntüleme • 13 gün önce

Chinese AI models are wiping billions off Big Tech right now. Google just lost $200 billion in a single day, and the model it needed to fight back still isn't ready. Gemini 3.5 Pro, Google's most powerful model, is months behind schedule. Alphabet stock dropped 4.4% that same day. The Deepseek moment is happening again, and the new model is FAR bigger. On the same day Google's delay leaked, a Beijing lab called Moonshot released Kimi K3. It is the largest open model ever built, with 2.8 trillion parameters. It took the number one spot on the Frontend Code Arena, a live coding leaderboard, passing Anthropic's best model. And Moonshot is giving it away for free on July 27. The genius part: Anyone with enough computers can download it and run a frontier level AI without paying a cent to a US company. A single task on Kimi K3 costs about 94 cents. The same work on some American models costs nearly double. So why would a company keep paying premium prices for a model it can now get for free? The entire US AI business is built on selling access to models that cost billions to train. If a free Chinese version does most of the same work, that pricing power starts to crack. And Kimi is close to the best. On one closely watched intelligence ranking it scored 57, just behind the top American models GPT-5.6 Sol and Fable 5, and ahead of Claude Opus 4.8. Bank of America told clients that Kimi proves Chinese labs can keep making big leaps even with limited chips. And the founder of Moonshot, Yang Zhilin, learned to build AI as a researcher INSIDE Google. Google literally wrote the 2017 paper that made all of these models possible. Now the people who studied its work are using it to destroy Google, and handing it out for free. What happens next: Kimi K3's weights go public on July 27. Google reports earnings on July 22, and everyone will be asking the same question about Gemini. If free models keep topping the charts, every valuation built on paid AI access has to be rewritten. What do you think?

Chinese AI models are wiping billions off Big Tech right now. Google just lost $200 billion in a single day, and the model it needed to fight back still isn't ready. Gemini 3.5 Pro, Google's most powerful model, is months behind schedule. Alphabet stock dropped 4.4% that same day. The Deepseek moment is happening again, and the new model is FAR bigger. On the same day Google's delay leaked, a Beijing lab called Moonshot released Kimi K3. It is the largest open model ever built, with 2.8 trillion parameters. It took the number one spot on the Frontend Code Arena, a live coding leaderboard, passing Anthropic's best model. And Moonshot is giving it away for free on July 27. The genius part: Anyone with enough computers can download it and run a frontier level AI without paying a cent to a US company. A single task on Kimi K3 costs about 94 cents. The same work on some American models costs nearly double. So why would a company keep paying premium prices for a model it can now get for free? The entire US AI business is built on selling access to models that cost billions to train. If a free Chinese version does most of the same work, that pricing power starts to crack. And Kimi is close to the best. On one closely watched intelligence ranking it scored 57, just behind the top American models GPT-5.6 Sol and Fable 5, and ahead of Claude Opus 4.8. Bank of America told clients that Kimi proves Chinese labs can keep making big leaps even with limited chips. And the founder of Moonshot, Yang Zhilin, learned to build AI as a researcher INSIDE Google. Google literally wrote the 2017 paper that made all of these models possible. Now the people who studied its work are using it to destroy Google, and handing it out for free. What happens next: Kimi K3's weights go public on July 27. Google reports earnings on July 22, and everyone will be asking the same question about Gemini. If free models keep topping the charts, every valuation built on paid AI access has to be rewritten. What do you think?

Ricardo

47,202 görüntüleme • 9 gün önce

$SITUATION EXPLAINED: Kimi K3 just beat Fable on a major coding benchmark, at a fraction of the price. • Kimi K3 beat Fable on Frontend Code Arena • The gap between Kimi and Fable is bigger than the gap between Fable and Sol • It also smashes Opus outright, while being priced the same as Sonnet, $3/$15 per million tokens • Sonnet 5 High currently sits in 10th place on this leaderboard at that same price point • The generational jump is dramatic: Kimi K2.6 ranked 18th on this benchmark, K3 jumped 17 spots to take the top spot • K3 ranked #1 in 6 of 7 tested domains: brand and marketing, reference-based design, data and analytics, consumer products, simulations, and content creation tools, it placed #2, only in gaming, behind Fable • Full model weights are set to release July 27th Theo Jaffee: "Imagine if Anthropic were a public company today, their stock would be down 20%, maybe more, enterprises are probably not gonna be spending $10 and $50 on Fable when they can instead be spending $3 and $15 on Kimi K3."$

SITUATION EXPLAINED: Kimi K3 just beat Fable on a major coding benchmark, at a fraction of the price. • Kimi K3 beat Fable on Frontend Code Arena • The gap between Kimi and Fable is bigger than the gap between Fable and Sol • It also smashes Opus outright, while being priced the same as Sonnet, $3/$15 per million tokens • Sonnet 5 High currently sits in 10th place on this leaderboard at that same price point • The generational jump is dramatic: Kimi K2.6 ranked 18th on this benchmark, K3 jumped 17 spots to take the top spot • K3 ranked #1 in 6 of 7 tested domains: brand and marketing, reference-based design, data and analytics, consumer products, simulations, and content creation tools, it placed #2, only in gaming, behind Fable • Full model weights are set to release July 27th Theo Jaffee: "Imagine if Anthropic were a public company today, their stock would be down 20%, maybe more, enterprises are probably not gonna be spending $10 and $50 on Fable when they can instead be spending $3 and $15 on Kimi K3."

MTS

132,318 görüntüleme • 13 gün önce

We co-led Inferact's $150M seed round to support them in their mission to build the inference engine for all current and future AI. In this episode of The Investment Memo, Lightspeed's Bucky Moore and James Alcorn sit down with Simon Mo (Co-Founder & CEO Inferact) to cover: - How vLLM grew to 60K+ GitHub stars - Why inference is shifting to the majority of compute - How vLLM evolved from a research project into the industry standard - Why building a company was the next step to push open-source inference forward 00:00 Introduction 02:03 The investment memo 04:47 Latency vs throughput vs cost 06:19 Paged attention explained 08:04 The evolution of attention 09:42 Growing the vLLM open source community 11:41 Working with hardware vendors 14:45 Deploying vLLM at large scale 16:03 Inferact's culture of openness 18:45 Building an open ecosystem and horizontal stack 19:45 Inferact's approach to fundraising 22:14 What is the future of inference? Simon Mo Bucky Moore James Alcorn

We co-led Inferact's $150M seed round to support them in their mission to build the inference engine for all current and future AI. In this episode of The Investment Memo, Lightspeed's Bucky Moore and James Alcorn sit down with Simon Mo (Co-Founder & CEO Inferact) to cover: - How vLLM grew to 60K+ GitHub stars - Why inference is shifting to the majority of compute - How vLLM evolved from a research project into the industry standard - Why building a company was the next step to push open-source inference forward 00:00 Introduction 02:03 The investment memo 04:47 Latency vs throughput vs cost 06:19 Paged attention explained 08:04 The evolution of attention 09:42 Growing the vLLM open source community 11:41 Working with hardware vendors 14:45 Deploying vLLM at large scale 16:03 Inferact's culture of openness 18:45 Building an open ecosystem and horizontal stack 19:45 Inferact's approach to fundraising 22:14 What is the future of inference? Simon Mo Bucky Moore James Alcorn

Lightspeed

27,040 görüntüleme • 6 ay önce

New course on serving LLMs efficiently -- how do you serve models to many concurrent users at low latency and reasonable cost? This short course is built with Red Hat and taught by Cedric Clyburn. Efficient LLM serving requires efficient memory management. A 70B-parameter model takes ~140 GB just to load the weights. On top of that, every active request needs its own chunk of GPU memory, the KV cache, to store the token context it has built up so far. In this course, you'll learn to reduce a model's memory footprint with quantization and serve it using vLLM, which handles many concurrent requests efficiently through smart memory management. Skills you'll gain: - Quantize a model and measure the accuracy tradeoff - Serve a model with vLLM and watch it handle concurrent requests efficiently - Benchmark your deployment and make informed tradeoffs between speed, cost, and accuracy Join and learn to serve LLMs efficiently:

New course on serving LLMs efficiently -- how do you serve models to many concurrent users at low latency and reasonable cost? This short course is built with Red Hat and taught by Cedric Clyburn. Efficient LLM serving requires efficient memory management. A 70B-parameter model takes ~140 GB just to load the weights. On top of that, every active request needs its own chunk of GPU memory, the KV cache, to store the token context it has built up so far. In this course, you'll learn to reduce a model's memory footprint with quantization and serve it using vLLM, which handles many concurrent requests efficiently through smart memory management. Skills you'll gain: - Quantize a model and measure the accuracy tradeoff - Serve a model with vLLM and watch it handle concurrent requests efficiently - Benchmark your deployment and make informed tradeoffs between speed, cost, and accuracy Join and learn to serve LLMs efficiently:

Andrew Ng

128,334 görüntüleme • 1 ay önce

In December, we launched Gemini 1.0 Pro. Today, we're introducing Gemini 1.5 Pro! 🚀 This next-gen model uses a Mixture-of-Experts (MoE) approach for more efficient training & higher-quality responses. Gemini 1.5 Pro, our mid-sized model, will soon come standard with a 128K-token context window, but starting today, developers + customers can sign up for the limited Private Preview to try out 1.5 Pro with a groundbreaking and experimental 1 million token context window! The 1M tokens feature unlocks huge possibilities for devs - upload hundreds of pages of text, entire code repos, and long videos and let Gemini reason across them. It's still experimental and early and we’d love your feedback - learn more here.

In December, we launched Gemini 1.0 Pro. Today, we're introducing Gemini 1.5 Pro! 🚀 This next-gen model uses a Mixture-of-Experts (MoE) approach for more efficient training & higher-quality responses. Gemini 1.5 Pro, our mid-sized model, will soon come standard with a 128K-token context window, but starting today, developers + customers can sign up for the limited Private Preview to try out 1.5 Pro with a groundbreaking and experimental 1 million token context window! The 1M tokens feature unlocks huge possibilities for devs - upload hundreds of pages of text, entire code repos, and long videos and let Gemini reason across them. It's still experimental and early and we’d love your feedback - learn more here.

Sundar Pichai

852,656 görüntüleme • 2 yıl önce

Kimi K3 is the most powerful open-source AI model ever, and you can use it 100% free right now. Go to Sign in. Switch the dropdown from K2.6 to K3. That's it. No credit card. No API setup. On my own tests, it beat GPT 5.6 and Opus 4.8. It builds games. 3D worlds. Full websites. Even videos. It goes fully open source in July 2026. Use it off-peak hours and you get even more free tokens. Most people will never even try it. The ones who do get frontier-level AI for $0.

Kimi K3 is the most powerful open-source AI model ever, and you can use it 100% free right now. Go to Sign in. Switch the dropdown from K2.6 to K3. That's it. No credit card. No API setup. On my own tests, it beat GPT 5.6 and Opus 4.8. It builds games. 3D worlds. Full websites. Even videos. It goes fully open source in July 2026. Use it off-peak hours and you get even more free tokens. Most people will never even try it. The ones who do get frontier-level AI for $0.

Julian Goldie SEO

143,676 görüntüleme • 12 gün önce

Anthropic's in trouble, again. The entire Claude experience is now available at 1/6th the price. Kimi now does everything Claude does, powered by K2.6, a 1-trillion-parameter MoE model that activates only 32B parameters per token. It covers all three features Claude has (Chat, Code, and Cowork): 1) Kimi Chat runs in four modes - Instant for fast responses - Thinking for deep reasoning - Agent for multi-step execution - and Agent Swarm for parallel workloads. There's a 262K context window across all of them. 2) Kimi Code is the open-source CLI coding agent with K2.6 as the default backend. K2.6 ranked #1 on OpenRouter's programming leaderboard by weekly usage. 3) Kimi Agent is the Cowork equivalent. It generates: - full websites with database and auth - presentation decks (editable PPTX output) - spreadsheets with formulas and charts - word docs and structured research reports. On top of this, Kimi K2.6 is also trained to decompose tasks into up to 300 parallel sub-agents. This helps it retain coherence even across 4,000+ tool calls in a single run, with sessions sustaining up to 13 hours. On SWE-Bench Pro: - Kimi K2.6 → 58.6 - GPT-5.4 xhigh → 57.7 - Gemini 3.1 Pro → 54.2 - Claude Opus 4.6 → 53.4 Kimi K2.6 model is open weights and self-hostable on 4x H100s in INT4. Find the link to the HuggingFace model page in the replies!

Anthropic's in trouble, again. The entire Claude experience is now available at 1/6th the price. Kimi now does everything Claude does, powered by K2.6, a 1-trillion-parameter MoE model that activates only 32B parameters per token. It covers all three features Claude has (Chat, Code, and Cowork): 1) Kimi Chat runs in four modes - Instant for fast responses - Thinking for deep reasoning - Agent for multi-step execution - and Agent Swarm for parallel workloads. There's a 262K context window across all of them. 2) Kimi Code is the open-source CLI coding agent with K2.6 as the default backend. K2.6 ranked #1 on OpenRouter's programming leaderboard by weekly usage. 3) Kimi Agent is the Cowork equivalent. It generates: - full websites with database and auth - presentation decks (editable PPTX output) - spreadsheets with formulas and charts - word docs and structured research reports. On top of this, Kimi K2.6 is also trained to decompose tasks into up to 300 parallel sub-agents. This helps it retain coherence even across 4,000+ tool calls in a single run, with sessions sustaining up to 13 hours. On SWE-Bench Pro: - Kimi K2.6 → 58.6 - GPT-5.4 xhigh → 57.7 - Gemini 3.1 Pro → 54.2 - Claude Opus 4.6 → 53.4 Kimi K2.6 model is open weights and self-hostable on 4x H100s in INT4. Find the link to the HuggingFace model page in the replies!

Avi Chawla

109,921 görüntüleme • 2 ay önce

New podcast with Florian Brand on all things open models. More on Kimi K3, Qwen 3.8, GLM-5.2, Xi's WAIC speech, distillation, the open-closed Gap, and what's next. Chapters: 00:00 Welcome & context 04:38 Living with / using Kimi K3 08:53 GLM 5.2’s continued role 12:47 How are the Chinese models this good? 17:41 Data, environments, and a tour of the Chinese labs 19:47 Roundup of Chinese providers: Qwen, DeepSeek, MiniMax… 24:08 The US open-model ecosystem 30:25 Frontier vs. near-frontier, and the cybersecurity case against bans 34:58 Distillation and the Ben Thompson debate 44:12 Predictions and a frontier tier list 48:36 Wrap-up Hoping to keep doing a few more of these on Interconnects. Crucial times in AI, we're working hard to share our expertise.

Nathan Lambert

19,006 görüntüleme • 8 gün önce

before you watch the World Cup final tonight, watch this 30-minute interview with Kimi founder Zhilin Yang it's the clearest look I've seen at how K2 was actually built and where AI models go next > why compute scaling still beats every other method > why the "data flywheel" everyone talks about hasn't formed yet > the real challenge in multimodality nobody mentions > why K2 was closer to a base model — the real potential wasn't unlocked yet this is only part of the interview, translated to English — and everything he hinted at just shipped as Kimi K3, 2.8 trillion parameters, the biggest open model ever full breakdown below

before you watch the World Cup final tonight, watch this 30-minute interview with Kimi founder Zhilin Yang it's the clearest look I've seen at how K2 was actually built and where AI models go next > why compute scaling still beats every other method > why the "data flywheel" everyone talks about hasn't formed yet > the real challenge in multimodality nobody mentions > why K2 was closer to a base model — the real potential wasn't unlocked yet this is only part of the interview, translated to English — and everything he hinted at just shipped as Kimi K3, 2.8 trillion parameters, the biggest open model ever full breakdown below

Kirill

532,710 görüntüleme • 10 gün önce

Introducing "Building with Llama 4." This short course is created with Meta AI at Meta, and taught by Amit Sangani, Director of Partner Engineering for Meta’s AI team. Meta’s new Llama 4 has added three new models and introduced the Mixture-of-Experts (MoE) architecture to its family of open-weight models, making them more efficient to serve. In this course, you’ll work with two of the three new models introduced in Llama 4. First is Maverick, a 400B parameter model, with 128 experts and 17B active parameters. Second is Scout, a 109B parameter model with 16 experts and 17B active parameters. Maverick and Scout support long context windows of up to a million tokens and 10M tokens, respectively. The latter is enough to support directly inputting even fairly large GitHub repos for analysis! In hands-on lessons, you’ll build apps using Llama 4’s new multimodal capabilities including reasoning across multiple images and image grounding, in which you can identify elements in images. You’ll also use the official Llama API, work with Llama 4’s long-context abilities, and learn about Llama’s newest open-source tools: its prompt optimization tool that automatically improves system prompts and synthetic data kit that generates high-quality datasets for fine-tuning. If you need an open model, Llama is a great option, and the Llama 4 family is an important part of any GenAI developer's toolkit. Through this course, you’ll learn to call Llama 4 via API, use its optimization tools, and build features that span text, images, and large context. Please sign up here:

Introducing "Building with Llama 4." This short course is created with Meta AI at Meta, and taught by Amit Sangani, Director of Partner Engineering for Meta’s AI team. Meta’s new Llama 4 has added three new models and introduced the Mixture-of-Experts (MoE) architecture to its family of open-weight models, making them more efficient to serve. In this course, you’ll work with two of the three new models introduced in Llama 4. First is Maverick, a 400B parameter model, with 128 experts and 17B active parameters. Second is Scout, a 109B parameter model with 16 experts and 17B active parameters. Maverick and Scout support long context windows of up to a million tokens and 10M tokens, respectively. The latter is enough to support directly inputting even fairly large GitHub repos for analysis! In hands-on lessons, you’ll build apps using Llama 4’s new multimodal capabilities including reasoning across multiple images and image grounding, in which you can identify elements in images. You’ll also use the official Llama API, work with Llama 4’s long-context abilities, and learn about Llama’s newest open-source tools: its prompt optimization tool that automatically improves system prompts and synthetic data kit that generates high-quality datasets for fine-tuning. If you need an open model, Llama is a great option, and the Llama 4 family is an important part of any GenAI developer's toolkit. Through this course, you’ll learn to call Llama 4 via API, use its optimization tools, and build features that span text, images, and large context. Please sign up here:

Andrew Ng

67,846 görüntüleme • 1 yıl önce

OpenAI chairman Bret Taylor talks to about 100 CEOs every month. His answer to the cheap open-weight model panic: cheaper to train does not mean cheaper to use, and the number that decides it is token efficiency. "One thing that I think is a little bit overblown about these open weight models is they're not necessarily cheaper to run. Whether or not they're cheaper to train, you don't care. Because you're using just as many tokens. In fact, they may be less efficient." "There's this thing called token efficiency. And it turns out the frontier models are much, much more token efficient." "A token is to intelligence like a watt is to electricity... how many tokens does it take to complete a task? Not every token is actually equal." "For a lot of tasks, it turns out these frontier models from OpenAI and Anthropic are actually just better than these open weight models... just having open weights isn't actually the main thing driving any of those costs." Later in the same interview he goes after the billing unit itself: "It would be like if you signed up for Gmail and you paid for CPU cycle or something... where the world is going is paying for outcomes." The unresolved column: the chart CNBC airs mid-answer, from Artificial Analysis, prices a completed task at $0.94 on Kimi K3 against $2.75 on Claude Fable 5, efficiency folded in. If that gap holds, the premium he is defending gets earned on quality, not price. - Bret Taylor (Bret Taylor), OpenAI chairman and Sierra co-founder, on CNBC's Squawk Box.

OpenAI chairman Bret Taylor talks to about 100 CEOs every month. His answer to the cheap open-weight model panic: cheaper to train does not mean cheaper to use, and the number that decides it is token efficiency. "One thing that I think is a little bit overblown about these open weight models is they're not necessarily cheaper to run. Whether or not they're cheaper to train, you don't care. Because you're using just as many tokens. In fact, they may be less efficient." "There's this thing called token efficiency. And it turns out the frontier models are much, much more token efficient." "A token is to intelligence like a watt is to electricity... how many tokens does it take to complete a task? Not every token is actually equal." "For a lot of tasks, it turns out these frontier models from OpenAI and Anthropic are actually just better than these open weight models... just having open weights isn't actually the main thing driving any of those costs." Later in the same interview he goes after the billing unit itself: "It would be like if you signed up for Gmail and you paid for CPU cycle or something... where the world is going is paying for outcomes." The unresolved column: the chart CNBC airs mid-answer, from Artificial Analysis, prices a completed task at $0.94 on Kimi K3 against $2.75 on Claude Fable 5, efficiency folded in. If that gap holds, the premium he is defending gets earned on quality, not price. - Bret Taylor (Bret Taylor), OpenAI chairman and Sierra co-founder, on CNBC's Squawk Box.

Karl Mehta

16,614 görüntüleme • 8 gün önce