Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Mistral unveiled Large 4, a 1T-parameter multimodal model with 49B active parameters. It reports results in cyber, manufacturing, finance and visual grounding. API available; weights due end-Oct.

Documenting AGI

66,270 subscribers

10,921 views • 1 month ago •via X (Twitter)

Science & Technology

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

We're excited to introduce Arcee.ai's Trinity Large model. An open 400B parameter Mixture of Experts model, delivering frontier-level performance with only 13B active parameters. Trained in collaboration between Arcee, Datology and Prime Intellect.

We're excited to introduce Arcee.ai's Trinity Large model. An open 400B parameter Mixture of Experts model, delivering frontier-level performance with only 13B active parameters. Trained in collaboration between Arcee, Datology and Prime Intellect.

Prime Intellect

178,830 views • 9 months ago

Tiny Recursive Models: A tiny 7M parameter model that recursively refines its answer beats LLMs 100x larger on hard puzzles like ARC-AGI We independently reproduced the paper, corroborated results, and released the weights + API access for those looking to benchmark it 🔍

Tiny Recursive Models: A tiny 7M parameter model that recursively refines its answer beats LLMs 100x larger on hard puzzles like ARC-AGI We independently reproduced the paper, corroborated results, and released the weights + API access for those looking to benchmark it 🔍

alphaXiv

52,843 views • 1 year ago

Announcing jina-ocr-v1, our new visual document parser with 3.4B total parameters and 570M active parameters, with speculative decoding built in. Throw PDFs, scans, tables, charts, or invoices at it and get clean markdown back. Available on 🤗 & Jina Reader `x-respond-with` today

Announcing jina-ocr-v1, our new visual document parser with 3.4B total parameters and 570M active parameters, with speculative decoding built in. Throw PDFs, scans, tables, charts, or invoices at it and get clean markdown back. Available on 🤗 & Jina Reader `x-respond-with` today

Jina AI

158,552 views • 1 month ago

Introducing OUI-1: the first open-weights model for Generative UI 71.7% on Generative UI Bench at 4B params. Beats Gemma 4 31B with 8× fewer active params, and scores 5.5× the base DiffusionGemma it was fine-tuned from. Methodology, weights, and full benchmark results in the blog 👇

Introducing OUI-1: the first open-weights model for Generative UI 71.7% on Generative UI Bench at 4B params. Beats Gemma 4 31B with 8× fewer active params, and scores 5.5× the base DiffusionGemma it was fine-tuned from. Methodology, weights, and full benchmark results in the blog 👇

Rabi Shanker Guha

77,618 views • 2 months ago

Grok 4.4 with proper 𝕏 training data is coming soon. It will be the first Grok model release with 1T parameters.

Grok 4.4 with proper 𝕏 training data is coming soon. It will be the first Grok model release with 1T parameters.

Testlabor

16,299 views • 5 months ago

🚨 HUGE: Moonshot AI unveils Kimi K3.1 Pro, a 2.8-TRILLION-parameter model claiming to beat Claude Opus 5.5 and GPT-6 Astra on long-horizon coding tasks. The model features a 1 MILLION-token context window, with 104 billion parameters active per token. Moonshot reports leading scores on SWE Marathon and agent benchmarks. Its ambitions go beyond chat with building game projects in Unreal Engine, Unity and Godot, creating parametric 3D models, and improving financial-modeling reliability. Moonshot promises OPEN WEIGHTS by November 4. Independent testing will determine whether those benchmark claims translate into reliable, working projects.

🚨 HUGE: Moonshot AI unveils Kimi K3.1 Pro, a 2.8-TRILLION-parameter model claiming to beat Claude Opus 5.5 and GPT-6 Astra on long-horizon coding tasks. The model features a 1 MILLION-token context window, with 104 billion parameters active per token. Moonshot reports leading scores on SWE Marathon and agent benchmarks. Its ambitions go beyond chat with building game projects in Unreal Engine, Unity and Godot, creating parametric 3D models, and improving financial-modeling reliability. Moonshot promises OPEN WEIGHTS by November 4. Independent testing will determine whether those benchmark claims translate into reliable, working projects.

Coin Bureau

36,692 views • 15 days ago

FLUX 3 Image Klein is here. Open Weights with the quality of a large frontier model. Customizable and fast. 5.6B parameters and runs on a single consumer GPU. Native 4K, bounding boxes, and pixel-perfect editing.

FLUX 3 Image Klein is here. Open Weights with the quality of a large frontier model. Customizable and fast. 5.6B parameters and runs on a single consumer GPU. Native 4K, bounding boxes, and pixel-perfect editing.

Black Forest Labs

343,303 views • 24 days ago

Gemini Embedding 2 is now generally available in the Gemini API and Vertex AI! Start building with our first natively multimodal embedding model, now equipped with the stability and optimizations required for production apps.

Gemini Embedding 2 is now generally available in the Gemini API and Vertex AI! Start building with our first natively multimodal embedding model, now equipped with the stability and optimizations required for production apps.

Google AI Developers

816,466 views • 6 months ago

1/ Happy to share UniDisc - Unified Multimodal Discrete Diffusion – We train a 1.5 billion parameter transformer model from scratch on 250 million image/caption pairs using a **discrete diffusion objective**. Our model has all the benefits of diffusion models but now in multimodal space! - flexible compute-quality tradeoff, zero-shot inpainting and editing, better control via classifier-free guidance and lower latency! We open source everything - our code, weights and the training dataset.

1/ Happy to share UniDisc - Unified Multimodal Discrete Diffusion – We train a 1.5 billion parameter transformer model from scratch on 250 million image/caption pairs using a discrete diffusion objective. Our model has all the benefits of diffusion models but now in multimodal space! - flexible compute-quality tradeoff, zero-shot inpainting and editing, better control via classifier-free guidance and lower latency! We open source everything - our code, weights and the training dataset.

Mihir Prabhudesai

105,076 views • 1 year ago

1/ muse spark 1.2 is a very strong multimodal model—it can do visual coding, robotics planning, and audio-visual understanding that all come together through agentic tools.

1/ muse spark 1.2 is a very strong multimodal model—it can do visual coding, robotics planning, and audio-visual understanding that all come together through agentic tools.

Alexandr Wang

185,363 views • 2 months ago

Mistral Large 4 is now on the Dell Technologies Enterprise Hub on Hugging Face. 🚀 Frontier-class open weights + one-click deployment optimized for Dell PowerEdge AI infrastructure. On prem, private and secure, unmetered intelligence 🚀 Deploy it in minutes:

Mistral Large 4 is now on the Dell Technologies Enterprise Hub on Hugging Face. 🚀 Frontier-class open weights + one-click deployment optimized for Dell PowerEdge AI infrastructure. On prem, private and secure, unmetered intelligence 🚀 Deploy it in minutes:

Michael Dell 🇺🇸

26,864 views • 10 days ago

The NVIDIA AI team shipped Nemotron 3.5 Super VL today, and you can call it now on CoreWeave Serverless Inference. Send it text and images, build with supported reasoning, tool calling and structured outputs, and trace every call in CoreWeave Agent Lens. It's a multimodal mixture-of-experts model with 12B active parameters, served in NVFP4. Pricing per 1M tokens is $0.25 input, $1.50 output, and $0.05 cached input. Try it here:

The NVIDIA AI team shipped Nemotron 3.5 Super VL today, and you can call it now on CoreWeave Serverless Inference. Send it text and images, build with supported reasoning, tool calling and structured outputs, and trace every call in CoreWeave Agent Lens. It's a multimodal mixture-of-experts model with 12B active parameters, served in NVFP4. Pricing per 1M tokens is $0.25 input, $1.50 output, and $0.05 cached input. Try it here:

CoreWeave

11,055 views • 24 days ago

Solar Mini 4 from Upstage is free on Nous Portal for the next two weeks It has 3B active parameters (35B total), 512K context, and an Artificial Analysis Intelligence Index score of 24 - above models with 10x the active parameters

Solar Mini 4 from Upstage is free on Nous Portal for the next two weeks It has 3B active parameters (35B total), 512K context, and an Artificial Analysis Intelligence Index score of 24 - above models with 10x the active parameters

Nous Research

72,466 views • 1 month ago

4/ to achieve maximum memory efficiency, we quantize model weights to ~4-bit, getting the language model under 20GB with room for the kv cache, perception encoder, and drafter alongside it. a dflash drafter proposes blocks of tokens the main model verifies in parallel, so it stays responsive.

4/ to achieve maximum memory efficiency, we quantize model weights to ~4-bit, getting the language model under 20GB with room for the kv cache, perception encoder, and drafter alongside it. a dflash drafter proposes blocks of tokens the main model verifies in parallel, so it stays responsive.

Alexandr Wang

69,685 views • 3 months ago

Inkling-small is out today! With SGLang, you can get 648 tok/s decode with DSpark (simulated acc len=4) and 288 tok/s w/o DSpark, under the same setup (8x NVIDIA AI B200, TP 8, NVFP4, bs=1). What makes this model different is the size. 276B total with 12B active is a sweet spot for RL, and both LoRA and full-parameter training become well within reach. Miles is ready and verified for multimodal RL on Inkling-small, so you can turn your multimodal data into real capability gains. At ~1/4 the size, Inkling-small matches the bigger version in capability and even wins on some benchmarks. Run Inkling-small with SGLang, and customize it with Miles.

Inkling-small is out today! With SGLang, you can get 648 tok/s decode with DSpark (simulated acc len=4) and 288 tok/s w/o DSpark, under the same setup (8x NVIDIA AI B200, TP 8, NVFP4, bs=1). What makes this model different is the size. 276B total with 12B active is a sweet spot for RL, and both LoRA and full-parameter training become well within reach. Miles is ready and verified for multimodal RL on Inkling-small, so you can turn your multimodal data into real capability gains. At ~1/4 the size, Inkling-small matches the bigger version in capability and even wins on some benchmarks. Run Inkling-small with SGLang, and customize it with Miles.

LMSYS Org

120,233 views • 3 months ago

🎉 Congrats to Thinking Machines on TML Inkling—a 1T-parameter open-weight model supported in vLLM from Day 0. Highlights: • Natively multimodal across text, image, and audio • Up to 1M-token context • New architecture with relative attention, short convolutions, and MoE expert sinks • 8 MTP heads for speculative decoding vLLM supports both NVFP4 and BF16 checkpoints, optimized for NVIDIA Blackwell and Hopper, reaching up to 380 tok/s/user on 4× GB200 with MTP. Huge thanks to the Thinking Machines Lab team for the close collaboration 🙏 Read about implementation below 👇

🎉 Congrats to Thinking Machines on TML Inkling—a 1T-parameter open-weight model supported in vLLM from Day 0. Highlights: • Natively multimodal across text, image, and audio • Up to 1M-token context • New architecture with relative attention, short convolutions, and MoE expert sinks • 8 MTP heads for speculative decoding vLLM supports both NVFP4 and BF16 checkpoints, optimized for NVIDIA Blackwell and Hopper, reaching up to 380 tok/s/user on 4× GB200 with MTP. Huge thanks to the Thinking Machines Lab team for the close collaboration 🙏 Read about implementation below 👇

vLLM

49,464 views • 3 months ago

MiniMax H3 (Hailuo-03) is now available on fal. - Open-weight multimodal video model with native stereo audio on every generation. - Combines up to 9 images, 3 video clips, and 3 audio clips as references - Holds subjects, motion, and audio consistent - Weights will be released soon.

MiniMax H3 (Hailuo-03) is now available on fal. - Open-weight multimodal video model with native stereo audio on every generation. - Combines up to 9 images, 3 video clips, and 3 audio clips as references - Holds subjects, motion, and audio consistent - Weights will be released soon.

fal

54,627 views • 3 months ago