Video yükleniyor...

Video Yüklenemedi

Bu video yüklenirken bir sorun oluştu. Bu geçici bir ağ sorunundan kaynaklanıyor olabilir veya video kullanılamıyor olabilir.

Ana Sayfaya Dön

Introducing Jan-v2-VL, a multimodal agent built for long-horizon tasks. Jan-v2-VL executes 49 steps without failure, while the base model stops at 5 and other similar-scale VLMs stop between 1 and 2. It achieves longer, stable task execution in your browser without accuracy loss. 3 variants are available: - Jan-v2-VL-low... show more

👋 Jan

13,077 subscribers

130,234 görüntüleme • 9 ay önce •via X (Twitter)

Eğitim Bilim & Teknoloji Finans

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Introducing a brand new way to use Jan 💛 You can now search the web, do deep research, and let Jan use your browser. Powered by Jan-v2-VL-Max, 30B model beating Gemini 2.5 Pro & DeepSeek R1 on execution benchmarks. Try it:

👋 Jan

29,403 görüntüleme • 8 ay önce

Jan-v2-VL-Max-Instruct is out on 💛 Our newest 30B vision-language model, extending the Jan-v2-VL family. This is our experiment bringing interleaved reasoning to an Instruct model. It handles long tasks well and stays on track when things get complicated. Good for research, multi-step problems, anything that needs patience. Try it now at

Jan-v2-VL-Max-Instruct is out on 💛 Our newest 30B vision-language model, extending the Jan-v2-VL family. This is our experiment bringing interleaved reasoning to an Instruct model. It handles long tasks well and stays on track when things get complicated. Good for research, multi-step problems, anything that needs patience. Try it now at

👋 Jan

23,063 görüntüleme • 8 ay önce

Introducing Jan-v1: 4B model for web search, an open-source alternative to Perplexity Pro. In our evals, Jan v1 delivers 91% SimpleQA accuracy, slightly outperforming Perplexity Pro while running fully locally. Use cases: - Web search - Deep Research Built on the new version of Qwen's Qwen3-4B-Thinking (up to 256k context length), fine-tuned for reasoning and tool use in Jan. You can run the model in Jan, llama.cpp, or vLLM. To enable search in Jan, go to Settings → Experimental Features → On, then Settings → MCP Servers → enable a search-related MCP such as Serper. Use the model: - Jan-v1-4B: - Jan-v1-4B-GGUF: Credit to the Qwen team for Qwen3 4B Thinking & Georgi Gerganov for llama.cpp.

Introducing Jan-v1: 4B model for web search, an open-source alternative to Perplexity Pro. In our evals, Jan v1 delivers 91% SimpleQA accuracy, slightly outperforming Perplexity Pro while running fully locally. Use cases: - Web search - Deep Research Built on the new version of Qwen's Qwen3-4B-Thinking (up to 256k context length), fine-tuned for reasoning and tool use in Jan. You can run the model in Jan, llama.cpp, or vLLM. To enable search in Jan, go to Settings → Experimental Features → On, then Settings → MCP Servers → enable a search-related MCP such as Serper. Use the model: - Jan-v1-4B: - Jan-v1-4B-GGUF: Credit to the Qwen team for Qwen3 4B Thinking & Georgi Gerganov for llama.cpp.

👋 Jan

690,853 görüntüleme • 1 yıl önce

Jan v1 is now more reliable when handling searches. It's an open-source alternative to Perplexity Pro, and it now avoids infinite loops with Jan v1 2509. Performance updates: - Gains on reasoning & creativity benchmarks - Small drop on SimpleQA (91.1 -> 90.7), still competitive with Perplexity Pro The updated version is live on Jan Hub. You can run the model in Jan, llama.cpp, or vLLM. Use the model: - Model: - GGUF: Shoutout to the Qwen team for Qwen3-4B Thinking and Georgi Gerganov for llama.cpp.

Jan v1 is now more reliable when handling searches. It's an open-source alternative to Perplexity Pro, and it now avoids infinite loops with Jan v1 2509. Performance updates: - Gains on reasoning & creativity benchmarks - Small drop on SimpleQA (91.1 -> 90.7), still competitive with Perplexity Pro The updated version is live on Jan Hub. You can run the model in Jan, llama.cpp, or vLLM. Use the model: - Model: - GGUF: Shoutout to the Qwen team for Qwen3-4B Thinking and Georgi Gerganov for llama.cpp.

👋 Jan

17,759 görüntüleme • 11 ay önce

🎉 恭喜发财🧧🐍 As we welcome the Chinese New Year, we're thrilled to announce the launch of Qwen2.5-VL , our latest flagship vision-language model! 🚀 💗 Qwen Chat: 📖 Blog: 🤗 Hugging Face: 🤖 ModelScope: 🌟 Key Highlights: * Visual Understanding : From flowers to complex charts, Qwen2.5-VL sees it all! * Agentic Capabilities : It’s a visual agent that can reason and interact with tools like computers & phones. * Long Video Comprehension : Captures events in videos over 1 hour long! ⏳🎥 * Precise Localization : Generates bounding boxes & JSON outputs for accurate object detection. * Structured Data Outputs : Perfect for finance & commerce, handling invoices, forms & more! 💼📊 Try Qwen2.5-VL now at Qwen Chat or explore models on Hugging Face & ModelScope . 🌐

🎉 恭喜发财🧧🐍 As we welcome the Chinese New Year, we're thrilled to announce the launch of Qwen2.5-VL , our latest flagship vision-language model! 🚀 💗 Qwen Chat: 📖 Blog: 🤗 Hugging Face: 🤖 ModelScope: 🌟 Key Highlights: * Visual Understanding : From flowers to complex charts, Qwen2.5-VL sees it all! * Agentic Capabilities : It’s a visual agent that can reason and interact with tools like computers & phones. * Long Video Comprehension : Captures events in videos over 1 hour long! ⏳🎥 * Precise Localization : Generates bounding boxes & JSON outputs for accurate object detection. * Structured Data Outputs : Perfect for finance & commerce, handling invoices, forms & more! 💼📊 Try Qwen2.5-VL now at Qwen Chat or explore models on Hugging Face & ModelScope . 🌐

Qwen

762,520 görüntüleme • 1 yıl önce

🩵 ▓▓▓▓▓▓▓░░░░░░░░ 40% 🌸 The Mainnet Beta of Nibiru EVM is live! This marks the end of “Stage 2: Pre-Launch Optimization” from the launch outline. Stage 2 included several third-party security audits and improvements for compatibility and performance. NOW 👉🏽 Stage 3: “Mainnet Beta” includes the Nibiru V2 upgrade and brings Ethereum functionality to Nibiru’s mainnet (Cataclysm-1), enabling the deployment of key infrastructure and a suite of new applications. The next stage, “General Availability and Growth”, will open access for widespread use by a retail audience. This phase will also focus on driving growth and increasing adoption for applications. More Details Nibiru EVM is a fully backward-compatible upgrade to Nibiru that makes it power an EVM-equivalent execution environment, supporting Ethereum contracts and tools like Ethers, Coinbase Wallet, and Metamask out of the box with no code changes. Out the box, Nibiru offers 40K+ real TPS, instant finality, and ultra-low gas fees. Nibiru V2 unlocks MultiVM access for any application type, positioning Nibiru as a hub for cross-chain liquidity and high-performance apps. Stay up-to-date on Nibiru’s developments covering MultiVM architecture, DeFi products, and the Nibiru Lagrange Point roadmap. Nibiru Ecosystem Update #2 - Jan 2025 Stages of the Nibiru EVM (Nibiru V2) Launch Latest Articles on Nibiru EVM

🩵 ▓▓▓▓▓▓▓░░░░░░░░ 40% 🌸 The Mainnet Beta of Nibiru EVM is live! This marks the end of “Stage 2: Pre-Launch Optimization” from the launch outline. Stage 2 included several third-party security audits and improvements for compatibility and performance. NOW 👉🏽 Stage 3: “Mainnet Beta” includes the Nibiru V2 upgrade and brings Ethereum functionality to Nibiru’s mainnet (Cataclysm-1), enabling the deployment of key infrastructure and a suite of new applications. The next stage, “General Availability and Growth”, will open access for widespread use by a retail audience. This phase will also focus on driving growth and increasing adoption for applications. More Details Nibiru EVM is a fully backward-compatible upgrade to Nibiru that makes it power an EVM-equivalent execution environment, supporting Ethereum contracts and tools like Ethers, Coinbase Wallet, and Metamask out of the box with no code changes. Out the box, Nibiru offers 40K+ real TPS, instant finality, and ultra-low gas fees. Nibiru V2 unlocks MultiVM access for any application type, positioning Nibiru as a hub for cross-chain liquidity and high-performance apps. Stay up-to-date on Nibiru’s developments covering MultiVM architecture, DeFi products, and the Nibiru Lagrange Point roadmap. Nibiru Ecosystem Update #2 - Jan 2025 Stages of the Nibiru EVM (Nibiru V2) Launch Latest Articles on Nibiru EVM

Nibiru

148,788 görüntüleme • 1 yıl önce

The MiniMax M2 model is mind-blowing! It's open-source. It outperforms Gemini 2.5, Claude 4.1, and Qwen3 across coding and tool-use benchmarks. Right now, it's one of the world's top 5 models in intelligence! And here is the best part: Claude is one of the best models you can use today, and MiniMax M2 costs only 8% of that! It's smaller, faster, and cheaper. Extremely efficient at using tokens. Minimax M2's biggest strength: High agentic capabilities. The model can plan and execute complex multi-tool workflows. It's reliable and very robust at executing long-horizon tool chains. In summary: • Low latency • Very cheap • Excels at agentic tasks • Open-source The model currently powers the MiniMax Agent and is available for a free global trial. You can access MiniMax M2's API here: To access the agent: And here is the MiniMax website: Thanks to the MiniMax team for showing me the ropes and partnering with me on this post.

The MiniMax M2 model is mind-blowing! It's open-source. It outperforms Gemini 2.5, Claude 4.1, and Qwen3 across coding and tool-use benchmarks. Right now, it's one of the world's top 5 models in intelligence! And here is the best part: Claude is one of the best models you can use today, and MiniMax M2 costs only 8% of that! It's smaller, faster, and cheaper. Extremely efficient at using tokens. Minimax M2's biggest strength: High agentic capabilities. The model can plan and execute complex multi-tool workflows. It's reliable and very robust at executing long-horizon tool chains. In summary: • Low latency • Very cheap • Excels at agentic tasks • Open-source The model currently powers the MiniMax Agent and is available for a free global trial. You can access MiniMax M2's API here: To access the agent: And here is the MiniMax website: Thanks to the MiniMax team for showing me the ropes and partnering with me on this post.

Santiago

91,197 görüntüleme • 10 ay önce

Listen, speak, handle interruptions, and call tools in one live conversation. 🎙️ Introducing NVIDIA-NemotronLabs-VoiceChat-11B, NVIDIA’s end-to-end full-duplex model for real-time voice agents. 🤖 🏆 It ranks #2 among open full-duplex models on both VoiceBench and Full-Duplex-Bench 1.0. ⚡ Natural turn-taking responds in ~448 ms, while barge-in lets users interrupt the model with ~480 ms latency. 🛠️ The first open full-duplex model with live tool calling. One unified system handles speech understanding, generation, transcription, and tool execution while keeping the conversation flowing. 🧠 Built with a Fast Conformer, Nemotron Nano v2, and a TTS decoder, trained on ~550K hours of real and synthetic speech. 📜 Research use only. OpenMDW 1.1.

Listen, speak, handle interruptions, and call tools in one live conversation. 🎙️ Introducing NVIDIA-NemotronLabs-VoiceChat-11B, NVIDIA’s end-to-end full-duplex model for real-time voice agents. 🤖 🏆 It ranks #2 among open full-duplex models on both VoiceBench and Full-Duplex-Bench 1.0. ⚡ Natural turn-taking responds in ~448 ms, while barge-in lets users interrupt the model with ~480 ms latency. 🛠️ The first open full-duplex model with live tool calling. One unified system handles speech understanding, generation, transcription, and tool execution while keeping the conversation flowing. 🧠 Built with a Fast Conformer, Nemotron Nano v2, and a TTS decoder, trained on ~550K hours of real and synthetic speech. 📜 Research use only. OpenMDW 1.1.

ModelScope

22,194 görüntüleme • 24 gün önce

Tofu60 3.0 Now Supports 3rd-Party HE PCBs. After testing, the case is confirmed compatible with: • Wooting 60HE V1/V2 (ANSI) • Rakka Atlas 60HE • Venom 60HE What you’ll need: Tofu60 3.0 case + daughterboard & FPC cable + compatible plate. (cable and plate sold separately) For other 60% GH60-layout HE PCBs (USB between Esc & 1, Holy60 compatible), you will also need the daughterboard & FPC cable set. ⚠️ Note: Plates must be user-trimmed to fit your specific HE PCB. Assembly is not possible without a plate. Pre-order until 30th Jan #kbdfans #customkeyboard #Wooting60HE #buildyourown

Tofu60 3.0 Now Supports 3rd-Party HE PCBs. After testing, the case is confirmed compatible with: • Wooting 60HE V1/V2 (ANSI) • Rakka Atlas 60HE • Venom 60HE What you’ll need: Tofu60 3.0 case + daughterboard & FPC cable + compatible plate. (cable and plate sold separately) For other 60% GH60-layout HE PCBs (USB between Esc & 1, Holy60 compatible), you will also need the daughterboard & FPC cable set. ⚠️ Note: Plates must be user-trimmed to fit your specific HE PCB. Assembly is not possible without a plate. Pre-order until 30th Jan #kbdfans #customkeyboard #Wooting60HE #buildyourown

KBDfans

24,537 görüntüleme • 7 ay önce

Progress in open models is keeping Big AI labs up at night, and I'm here for it! We have a brand new open-weight multimodal model optimized for long-horizon tasks. This model is really good at something: it can work on tasks that keep evolving over time. • 280B total parameters, but only 16B active • 512K context window • Understands text, images, and audio • Strong reasoning, coding, and tool use But the best of all: the model learns and adapts to new information! Imagine you start running an agent today to solve a problem, and while it's working, you get new information that changes the initial conditions, or you change your mind. The agents you run today don't have issues with short tasks and goals that don't change, but reality is messy, and that makes it hard for long-horizon agents to succeed. The new dots3-note Preview model introduces TEMPO. TEMPO is a new reinforcement learning technique that lets the model periodically pause and critique its own progress. Basically, from time to time, the agent asks itself: "Am I getting closer to the goal, or am I wasting my time?" The same model switches between actor and critic. The actor works on the problem. The critic looks at the current state, reasons about how much progress it has made, and determines what should happen next. TEMPO gives the model feedback along the way. This is huge for any agent that can work on long-horizon tasks without wasting its time.

Santiago

79,311 görüntüleme • 8 gün önce

$This is the setup that changed everything for me, Claude can now browse the internet on its own. Not with your browser. Its own dedicated browser.. It can now login with your credentials, scrape data, monitors communities and generates leads.. all in the background while you sleep First how you can set it up, > Open Claude Desktop > Click the plus (+) icon in the chat bar and select Connectors (or "Manage Connectors") > Click Add Custom Connector and enter the following details - Name: Firecrawl - URL: dev/{FIRECRAWL_API_KEY}/v2/mcp - API Key: Paste your API key from the Firecrawl dashboard. > Click Add. then just enable and Authorize, > Once added, find "Firecrawl" in your connectors list and toggle it on. > Claude will ask for approval to use the connector; select Always Allow to let it run tasks without prompting you every time can start using it normally in chat now.. Prompt it like: "Go to [website], extract [data], and organize it" It opens its own browser, navigates, scrapes, and brings you clean results. will share how i use this setup in my next post, so be sure to follow me and turn post notifications on.$

This is the setup that changed everything for me, Claude can now browse the internet on its own. Not with your browser. Its own dedicated browser.. It can now login with your credentials, scrape data, monitors communities and generates leads.. all in the background while you sleep First how you can set it up, > Open Claude Desktop > Click the plus (+) icon in the chat bar and select Connectors (or "Manage Connectors") > Click Add Custom Connector and enter the following details - Name: Firecrawl - URL: dev/{FIRECRAWL_API_KEY}/v2/mcp - API Key: Paste your API key from the Firecrawl dashboard. > Click Add. then just enable and Authorize, > Once added, find "Firecrawl" in your connectors list and toggle it on. > Claude will ask for approval to use the connector; select Always Allow to let it run tasks without prompting you every time can start using it normally in chat now.. Prompt it like: "Go to [website], extract [data], and organize it" It opens its own browser, navigates, scrapes, and brings you clean results. will share how i use this setup in my next post, so be sure to follow me and turn post notifications on.

Axel Bitblaze 🪓

180,036 görüntüleme • 5 ay önce

Today we're excited to introduce Vy, our AI that sees and acts on your computer. At Vercept, our mission is to reinvent how humans use computers–enabling you to accomplish orders of magnitude more than what you can do today. Vy is a first glimpse at AI that sees and uses your computer just like you do. It runs natively on your computer, with access to all your applications and accounts that you’re already signed into. It is available for download starting today! As part of the release, we’ve built VyUI, an AI model bridging the gap between language and your screen. It sets a new state-of-the-art on UI grounding benchmarks like ScreenSpot v1, ScreenSpot v2, and GroundUI Web–beating leading models from OpenAI, Google, and Anthropic. Check out what Vy can do in the thread below: 🧵👇

Today we're excited to introduce Vy, our AI that sees and acts on your computer. At Vercept, our mission is to reinvent how humans use computers–enabling you to accomplish orders of magnitude more than what you can do today. Vy is a first glimpse at AI that sees and uses your computer just like you do. It runs natively on your computer, with access to all your applications and accounts that you’re already signed into. It is available for download starting today! As part of the release, we’ve built VyUI, an AI model bridging the gap between language and your screen. It sets a new state-of-the-art on UI grounding benchmarks like ScreenSpot v1, ScreenSpot v2, and GroundUI Web–beating leading models from OpenAI, Google, and Anthropic. Check out what Vy can do in the thread below: 🧵👇

Vercept

123,748 görüntüleme • 1 yıl önce

Imagine if your browser had a brain. And it could click, read, and act like you. That’s exactly what flowithOS by does. It’s not an AI tool. ↳ It’s an Agentic Operating System right inside your browser. You browse as usual. The agent does everything else. → Reads pages and pulls insights → Writes summaries or reports → Executes tasks across tabs and apps → Even manages your workflow while you focus on decisions I used it to automate my newsletter content creation. 1. I wrote one prompt 2. It searched the web for top AI news 3. It created a content doc, and organized everything for me. Think of it like fully automated self-driving, but for the internet. Instead of adding AI features to a browser, flowithOS rebuilt the entire experience. It combines vision, reasoning, and execution in one loop. Your intent becomes action in real time. Use it to research, create, manage content, shop, study, or build projects. One space. One agent. Infinite actions. 📌 Try flowithOS today → ---- #flowithOS #AI #Agent #FutureOfWork #Productivity #flowithOSPartnership #SponsoredByflowithOS

Imagine if your browser had a brain. And it could click, read, and act like you. That’s exactly what flowithOS by does. It’s not an AI tool. ↳ It’s an Agentic Operating System right inside your browser. You browse as usual. The agent does everything else. → Reads pages and pulls insights → Writes summaries or reports → Executes tasks across tabs and apps → Even manages your workflow while you focus on decisions I used it to automate my newsletter content creation. 1. I wrote one prompt 2. It searched the web for top AI news 3. It created a content doc, and organized everything for me. Think of it like fully automated self-driving, but for the internet. Instead of adding AI features to a browser, flowithOS rebuilt the entire experience. It combines vision, reasoning, and execution in one loop. Your intent becomes action in real time. Use it to research, create, manage content, shop, study, or build projects. One space. One agent. Infinite actions. 📌 Try flowithOS today → ---- #flowithOS #AI #Agent #FutureOfWork #Productivity #flowithOSPartnership #SponsoredByflowithOS

Andrew Bolis

36,689 görüntüleme • 10 ay önce

NVIDIA AI Releases Nemotron 3 Embed: An Open Embedding Collection Whose 8B Checkpoint Ranks #1 on RTEB Most RAG stacks treat the embedding model as a commodity — pick one, index, move on. Nemotron 3 Embed is NVIDIA's argument that the retrieval layer is where agent cost actually gets set. They released three open checkpoints — Nemotron-3-Embed-8B-BF16, 1B-BF16, and 1B-NVFP4 — built on Ministral bases, trained with bidirectional attention masking, pooled by averaging token-level representations, all taking 32,768-token inputs under OpenMDW-1.1. Here's what's actually interesting: → The 8B ranks #1 overall on RTEB: 78.46 avg NDCG@10, alongside 75.45 on MMTEB Retrieval and 60.60 on ViDoRe-V3 text → The 1B wasn't trained small. It was pruned from a 3B parent with ModelOpt mcore_minitron NAS, then distilled from the 8B teacher on COS + MSE loss — twice → That pipeline lands the 1.14B checkpoint at 72.38 RTEB, up 10.4 points on the prior-generation llama-nemotron-embed-vl-1b-v2 → NVFP4 costs 0.38 RTEB points (72.00 vs 72.38, ~99.5% retention) and buys up to 2x BF16 throughput on Blackwell Full Analysis: Model weight: Technical details: NVIDIA AI NVIDIA

NVIDIA AI Releases Nemotron 3 Embed: An Open Embedding Collection Whose 8B Checkpoint Ranks #1 on RTEB Most RAG stacks treat the embedding model as a commodity — pick one, index, move on. Nemotron 3 Embed is NVIDIA's argument that the retrieval layer is where agent cost actually gets set. They released three open checkpoints — Nemotron-3-Embed-8B-BF16, 1B-BF16, and 1B-NVFP4 — built on Ministral bases, trained with bidirectional attention masking, pooled by averaging token-level representations, all taking 32,768-token inputs under OpenMDW-1.1. Here's what's actually interesting: → The 8B ranks #1 overall on RTEB: 78.46 avg NDCG@10, alongside 75.45 on MMTEB Retrieval and 60.60 on ViDoRe-V3 text → The 1B wasn't trained small. It was pruned from a 3B parent with ModelOpt mcore_minitron NAS, then distilled from the 8B teacher on COS + MSE loss — twice → That pipeline lands the 1.14B checkpoint at 72.38 RTEB, up 10.4 points on the prior-generation llama-nemotron-embed-vl-1b-v2 → NVFP4 costs 0.38 RTEB points (72.00 vs 72.38, ~99.5% retention) and buys up to 2x BF16 throughput on Blackwell Full Analysis: Model weight: Technical details: NVIDIA AI NVIDIA

Marktechpost AI

32,352 görüntüleme • 1 ay önce

introducing OpenBench v1, an open framework for measuring AI performance and efficiency for your codebase and use case. Companies are realizing that you can't simply tokenmaxx, and are frantically looking for better ways to use and measure AI use and efficiency. One approach is evidenced by the rise in model routers: OpenRouter, Cloudflare, Databricks, Vercel, and now Ramp to name a few. But they'll also need the ability to evaluate how agents are performing in their actual use cases and codebase. A good example is DoorDash's recent evals on their codebase and prs. This will become even more important as companies explore different model + harness combinations. OpenBench will be built to this direction, focusing on the cross between correctness vs efficiency in both token use and latency. Starting off, OpenBench makes it easy for anyone to add to the task set, and run a variety of harness + models. The framework also makes it easy to add any custom harness variant, for example I've been testing codex variants with ablations against the stock codex harness. OpenBench will also have tooling to help with discovering/adding reliable tasks from your repo. Today I have integrated harnesses: codex, claude, cursor, devin, grok build, pi, and eval'ed them for different models like gpt 5.6-sol, GLM 5.2, Kimi K3, Grok 4.5, etc. measuring correctness %, token use (in/out/cache), and latency.

introducing OpenBench v1, an open framework for measuring AI performance and efficiency for your codebase and use case. Companies are realizing that you can't simply tokenmaxx, and are frantically looking for better ways to use and measure AI use and efficiency. One approach is evidenced by the rise in model routers: OpenRouter, Cloudflare, Databricks, Vercel, and now Ramp to name a few. But they'll also need the ability to evaluate how agents are performing in their actual use cases and codebase. A good example is DoorDash's recent evals on their codebase and prs. This will become even more important as companies explore different model + harness combinations. OpenBench will be built to this direction, focusing on the cross between correctness vs efficiency in both token use and latency. Starting off, OpenBench makes it easy for anyone to add to the task set, and run a variety of harness + models. The framework also makes it easy to add any custom harness variant, for example I've been testing codex variants with ablations against the stock codex harness. OpenBench will also have tooling to help with discovering/adding reliable tasks from your repo. Today I have integrated harnesses: codex, claude, cursor, devin, grok build, pi, and eval'ed them for different models like gpt 5.6-sol, GLM 5.2, Kimi K3, Grok 4.5, etc. measuring correctness %, token use (in/out/cache), and latency.

Matthew Lam

123,006 görüntüleme • 1 ay önce

We’re launching Optima. Now anyone can create a custom benchmark for their use case, leveraging Artificial Analysis’ leading research and platform Building and running benchmarks is difficult. We have distilled Artificial Analysis’ research and experience developing benchmarks into Optima, a new platform for benchmarking models on your own workloads and comparing performance, speed and cost efficiency. Optima allows you to find the best model for your task, or an equally performant alternative to your current setup at 10x lower cost or time per task. We’ve integrated Artificial Analysis' research and experience in benchmarks across the Optima workflow: ➤ Build benchmarks based on your own data and use cases: There are three ways to build a benchmark with Optima. Upload an existing evaluation dataset from your own files or Hugging Face, or import agent traces from platforms including Arize AI, Braintrust and langfuse.com. Install the Optima skill to build a benchmark using context from your coding environment and previous sessions. Or simply describe your use case and provide example inputs and outputs, and Optima will build the benchmark for you ➤ Run across the latest models: Run the same benchmark across leading models in a single click, and keep your leaderboard up to date as soon as new models are released ➤ Bring Artificial Analysis grading to your own benchmark: Evaluate responses against objective rubric criteria or using the same pairwise judging approach used for Artificial Analysis benchmarks including GDPval-AA and AA-Briefcase. For pairwise judging, select your preferred responses from a sample and Optima uses those preferences to rank models across your test set ➤ Compare performance, cost and time efficiency: Optima measures more than model performance. Cost per Task and Time per Task are tracked alongside benchmark scores, with category-level results and support for custom metrics, allowing you to compare the tradeoffs between models for your specific use case Ahead of launch, here are examples questions our beta testers answered with Optima: ➤ Which model can save me 10x the cost without a meaningful decrease in quality for my finance & accounting agent? ➤ Which model best matches the writing style of lawyers for my legal agent? ➤ Which model can best identify different elements in my custom image dataset? Optima is available today. Build your own benchmark at

We’re launching Optima. Now anyone can create a custom benchmark for their use case, leveraging Artificial Analysis’ leading research and platform Building and running benchmarks is difficult. We have distilled Artificial Analysis’ research and experience developing benchmarks into Optima, a new platform for benchmarking models on your own workloads and comparing performance, speed and cost efficiency. Optima allows you to find the best model for your task, or an equally performant alternative to your current setup at 10x lower cost or time per task. We’ve integrated Artificial Analysis' research and experience in benchmarks across the Optima workflow: ➤ Build benchmarks based on your own data and use cases: There are three ways to build a benchmark with Optima. Upload an existing evaluation dataset from your own files or Hugging Face, or import agent traces from platforms including Arize AI, Braintrust and langfuse.com. Install the Optima skill to build a benchmark using context from your coding environment and previous sessions. Or simply describe your use case and provide example inputs and outputs, and Optima will build the benchmark for you ➤ Run across the latest models: Run the same benchmark across leading models in a single click, and keep your leaderboard up to date as soon as new models are released ➤ Bring Artificial Analysis grading to your own benchmark: Evaluate responses against objective rubric criteria or using the same pairwise judging approach used for Artificial Analysis benchmarks including GDPval-AA and AA-Briefcase. For pairwise judging, select your preferred responses from a sample and Optima uses those preferences to rank models across your test set ➤ Compare performance, cost and time efficiency: Optima measures more than model performance. Cost per Task and Time per Task are tracked alongside benchmark scores, with category-level results and support for custom metrics, allowing you to compare the tradeoffs between models for your specific use case Ahead of launch, here are examples questions our beta testers answered with Optima: ➤ Which model can save me 10x the cost without a meaningful decrease in quality for my finance & accounting agent? ➤ Which model best matches the writing style of lawyers for my legal agent? ➤ Which model can best identify different elements in my custom image dataset? Optima is available today. Build your own benchmark at

Artificial Analysis

130,269 görüntüleme • 14 gün önce

Locked and loaded 💥 Openwork is now Accomplish v0.3.4 released today (download from link in bio): - Following the announcement from Kimi.ai a couple of hours ago, we are happy to introduce support for Kimi K2.5 with a new Moonshot AI integration! This is a global SOTA model for CUA BrowseComp (74.9%) - Log in with your OpenAI account (using OAuth) instead of providing an API key! This is both more seurce and it allows you to leverage existing OpenAI plan/subscription. - Support for Microsoft Azure AI Foundry thanks to our friends from Microsoft (cheers Ido Frizler!) - Support for LM Studio to run models locally (cheers to Yossi Elkrief LM Studiodevs!) . Try qwen/qwen3-vl-8b! - Support for MiniMax (official), the awesome open source models we love (thanks marcho) - You can now voice chat with openwork, courtesy of ! Thank you Max (Zihan) ZENG! Watch Openwork is now Accomplish one-shotting SOC 2 Compliance gap analysis (scanning your GitHub, Jira, Notion, websites and more):

Locked and loaded 💥 Openwork is now Accomplish v0.3.4 released today (download from link in bio): - Following the announcement from Kimi.ai a couple of hours ago, we are happy to introduce support for Kimi K2.5 with a new Moonshot AI integration! This is a global SOTA model for CUA BrowseComp (74.9%) - Log in with your OpenAI account (using OAuth) instead of providing an API key! This is both more seurce and it allows you to leverage existing OpenAI plan/subscription. - Support for Microsoft Azure AI Foundry thanks to our friends from Microsoft (cheers Ido Frizler!) - Support for LM Studio to run models locally (cheers to Yossi Elkrief LM Studiodevs!) . Try qwen/qwen3-vl-8b! - Support for MiniMax (official), the awesome open source models we love (thanks marcho) - You can now voice chat with openwork, courtesy of ! Thank you Max (Zihan) ZENG! Watch Openwork is now Accomplish one-shotting SOC 2 Compliance gap analysis (scanning your GitHub, Jira, Notion, websites and more):

Or Hiltch

34,008 görüntüleme • 7 ay önce

🤗 MOSS-VL-Realtime is now open source on Hugging Face . Built for real-time visual understanding over continuous video streams: 🧠 11B vision-language model 📜 Apache-2.0 license 💬 Ask questions at any point in a video stream 👀 Keeps watching while generating a response 🔄 Revises or interrupts its response as the scene changes 🤫 Can remain silent when more evidence is needed 🧩 256K-token context window 🌐 Chinese and English multimodal understanding 📦 Base, Instruct, and Realtime models are all open source From “watch first, answer later” to “keep watching while answering.” 👀 OpenMOSS Thank you SGLang LMSYS Org for day-0 support! 🚀

🤗 MOSS-VL-Realtime is now open source on Hugging Face . Built for real-time visual understanding over continuous video streams: 🧠 11B vision-language model 📜 Apache-2.0 license 💬 Ask questions at any point in a video stream 👀 Keeps watching while generating a response 🔄 Revises or interrupts its response as the scene changes 🤫 Can remain silent when more evidence is needed 🧩 256K-token context window 🌐 Chinese and English multimodal understanding 📦 Base, Instruct, and Realtime models are all open source From “watch first, answer later” to “keep watching while answering.” 👀 OpenMOSS Thank you SGLang LMSYS Org for day-0 support! 🚀

MOSI

53,413 görüntüleme • 1 ay önce

Cerebras inference is very fast. So fast that it changes how we think about configuring our LLMs for voice agent use cases. Kimi K2.6 is a 1T parameter reasoning model that Cerebras serves at 650 - 1,000 tokens per second (end-to-end throughput), with time to first token metrics as low as 150ms (latency). These numbers are two to three times faster than other similarly capable models. The biggest lever we get from this kind of speed is that we can use the model in reasoning mode, and still have excellent "time to first non-thinking token." This solves a big pain point we have in 2026 for voice agent use cases. Almost all recent innovation in post-training has focused on making models good at reasoning ("test time compute"). This is great, but it makes the user-facing model latency much, much slower. Which is a problem for conversational voice agents. We can run Kimi K2.6 with reasoning turned on, and get responses faster than other models produce with reasoning disabled. On my 30-turn voice agent benchmark, Kimi K2.6 with reasoning enabled ties GPT 5.1 and Haiku 4.5 with reasoning disabled, and is still about 200ms seconds faster! On my primary task agent benchmark, Kimi K2.6 is now the #2 model. It ranks just behind Gemini 3.5 Flash in "high" reasoning mode, and tied with GLM 5, Sonnet 4.6, and GPT 5.4 with reasoning set to "low." But Kimi K2.6 completes each turn in the agent loop in under 500ms. The other four models are all at least 3x slower. (Models only qualify for this benchmark if they can complete task turns at a P50 <4s.) A couple of other things that this speed buys us, for production voice agents: - Tool calls happen fast enough that we don't have to work around tool call latency in our pipeline design. - We can prompt the model to output structured data at the beginning of a response, followed by plain text for voice generation. This opens up possibilities like asking the model to do complex classification/generation tasks that influence the rest of the pipeline. For example, the model could create a detailed style prompt for a steerable TTS model, for each individual conversation turn. And, of course, you can use Kimi K2.6 with reasoning turned off. Cerebras calls this "instant" mode. Here's a video of a Cerebras Kimi K2.6 voice agent with voice-to-voice response time, measured at the client, under 500ms. This is the true response latency as perceived by the user, including all network and audio codec overhead, transcription and turn detection, Kimi K2.6 token generation, and voice generation. 500ms is, effectively, instant. So the Cerebras naming for this mode is a propos. :-)

Cerebras inference is very fast. So fast that it changes how we think about configuring our LLMs for voice agent use cases. Kimi K2.6 is a 1T parameter reasoning model that Cerebras serves at 650 - 1,000 tokens per second (end-to-end throughput), with time to first token metrics as low as 150ms (latency). These numbers are two to three times faster than other similarly capable models. The biggest lever we get from this kind of speed is that we can use the model in reasoning mode, and still have excellent "time to first non-thinking token." This solves a big pain point we have in 2026 for voice agent use cases. Almost all recent innovation in post-training has focused on making models good at reasoning ("test time compute"). This is great, but it makes the user-facing model latency much, much slower. Which is a problem for conversational voice agents. We can run Kimi K2.6 with reasoning turned on, and get responses faster than other models produce with reasoning disabled. On my 30-turn voice agent benchmark, Kimi K2.6 with reasoning enabled ties GPT 5.1 and Haiku 4.5 with reasoning disabled, and is still about 200ms seconds faster! On my primary task agent benchmark, Kimi K2.6 is now the #2 model. It ranks just behind Gemini 3.5 Flash in "high" reasoning mode, and tied with GLM 5, Sonnet 4.6, and GPT 5.4 with reasoning set to "low." But Kimi K2.6 completes each turn in the agent loop in under 500ms. The other four models are all at least 3x slower. (Models only qualify for this benchmark if they can complete task turns at a P50 <4s.) A couple of other things that this speed buys us, for production voice agents: - Tool calls happen fast enough that we don't have to work around tool call latency in our pipeline design. - We can prompt the model to output structured data at the beginning of a response, followed by plain text for voice generation. This opens up possibilities like asking the model to do complex classification/generation tasks that influence the rest of the pipeline. For example, the model could create a detailed style prompt for a steerable TTS model, for each individual conversation turn. And, of course, you can use Kimi K2.6 with reasoning turned off. Cerebras calls this "instant" mode. Here's a video of a Cerebras Kimi K2.6 voice agent with voice-to-voice response time, measured at the client, under 500ms. This is the true response latency as perceived by the user, including all network and audio codec overhead, transcription and turn detection, Kimi K2.6 token generation, and voice generation. 500ms is, effectively, instant. So the Cerebras naming for this mode is a propos. :-)

kwindla

40,593 görüntüleme • 3 ay önce