Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Introducing Falcon Mamba 7B from TII! This state-of-the-art language model sets a new AI benchmark with its innovative state space architecture. This groundbreaking release marks a significant stride in AI research. Learn more on

Technology Innovation Institute

16,013 subscribers

29,828 views • 2 years ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

3 Comments

sileod2 years ago

Interesting, how many training tokens ?

Christus Julius Maximus REX - SPQR2 years ago

Zorgon Peterson manufactures the Mamba. I prefer the Krait II myself.

Krish Dasgupta2 years ago

Is this on ollama yet ? Cant see the latest release yet.

Related Videos

Introducing EmbeddingGemma: our new open, state-of-the-art embedding model designed for on-device AI 📱

Introducing EmbeddingGemma: our new open, state-of-the-art embedding model designed for on-device AI 📱

Google AI Developers

153,927 views • 1 year ago

Introducing Majorana 1—the world’s first quantum processor powered by topological qubits, featuring a new state of matter. This breakthrough marks a significant step toward scalable quantum computing. Learn more: #QuantumReady

Introducing Majorana 1—the world’s first quantum processor powered by topological qubits, featuring a new state of matter. This breakthrough marks a significant step toward scalable quantum computing. Learn more: #QuantumReady

Azure Quantum

234,101 views • 1 year ago

Can a language model become SOTA in chemical synthesis? 🧪🔥 We put a 2.6B-parameter Liquid AI model into MMAI Gym. It now sets the state of the art in single-step retrosynthesis. 🚀 #insilicoSOTAFM

Can a language model become SOTA in chemical synthesis? 🧪🔥 We put a 2.6B-parameter Liquid AI model into MMAI Gym. It now sets the state of the art in single-step retrosynthesis. 🚀 #insilicoSOTAFM

Insilico Medicine

39,289 views • 27 days ago

Introducing Conversational AI 2.0 Build voice agents with: • New state-of-the-art turn-taking model • Language switching • Multicharacter mode • Multimodality • Batch calls • Built-in RAG Now fully enterprise-ready with HIPAA compliance, EU data residency, and robust security.

Introducing Conversational AI 2.0 Build voice agents with: • New state-of-the-art turn-taking model • Language switching • Multicharacter mode • Multimodality • Batch calls • Built-in RAG Now fully enterprise-ready with HIPAA compliance, EU data residency, and robust security.

ElevenLabs

232,790 views • 1 year ago

Today, Generative AI takes its next big step forward. Introducing Gen-1: a new AI model that uses language and images to generate new videos out of existing ones. Sign up for early research access:

Today, Generative AI takes its next big step forward. Introducing Gen-1: a new AI model that uses language and images to generate new videos out of existing ones. Sign up for early research access:

Runway

2,480,958 views • 3 years ago

Introducing our new frontier video model, Runway Gen-4.5. Previously known as Whisper Thunder (aka) David. Gen-4.5 is state-of-the-art and sets a new standard for video generation motion quality, prompt adherence and visual fidelity. Learn more below.

Introducing our new frontier video model, Runway Gen-4.5. Previously known as Whisper Thunder (aka) David. Gen-4.5 is state-of-the-art and sets a new standard for video generation motion quality, prompt adherence and visual fidelity. Learn more below.

Runway

854,589 views • 10 months ago

1/ We're unwrapping the new architecture + benchmarks behind Playground v3 - our new foundation model focused on graphic design. This is our first step towards making a powerful AI graphic designer. It's state-of-the-art at text rendering, prompt understanding, and color precision. Paper + details in the reply tweet 👇

1/ We're unwrapping the new architecture + benchmarks behind Playground v3 - our new foundation model focused on graphic design. This is our first step towards making a powerful AI graphic designer. It's state-of-the-art at text rendering, prompt understanding, and color precision. Paper + details in the reply tweet 👇

Suhail

334,582 views • 1 year ago

New short course: Build Long-Context AI Apps with Jamba. Learn about state space models (SSMs), which have emerged as an alternative to transformers! Specifically, Jamba is a hybrid transformer-Mamba architecture that combines strengths of the transformer with ideas from SSMs. This course is built with AI21 Labs and taught by Chen Wang and Chen Almagor. The transformer architecture is computationally expensive when handling very long input contexts. But there's an alternative called Mamba, a selective state space model that can process very long contexts with a much lower computational cost. However, researchers found that the pure Mamba architecture underperforms in understanding the context, and gives lower-quality responses. To overcome this, AI21 developed the Jamba model, which combines Mamba's computational efficiency with the transformer's attention mechanism to help with the output quality. In this course, you’ll learn about how state space models, and Jamba, work. You’ll also learn how to prompt Jamba, use it to process long documents, and build long-context RAG apps. - Learn how Jamba combines transformer and state space model architectures to achieve high performance and quality - Use the AI21 SDK, with an example of prompting over a large 200k-token annual financial report of Nvidia - Use Jamba for tool-calling, with hands-on examples from calling simple arithmetic calculations to a function that returns quarterly company financial reports. - Learn how training for long context is done, and the metrics used for its evaluation - Create a RAG app using the AI21 Conversational RAG tool and build your own RAG pipeline that uses Jamba and LangChain. By the end of this course, you'll learn how to build applications that can handle context as long as an entire book. Please sign up here:

New short course: Build Long-Context AI Apps with Jamba. Learn about state space models (SSMs), which have emerged as an alternative to transformers! Specifically, Jamba is a hybrid transformer-Mamba architecture that combines strengths of the transformer with ideas from SSMs. This course is built with AI21 Labs and taught by Chen Wang and Chen Almagor. The transformer architecture is computationally expensive when handling very long input contexts. But there's an alternative called Mamba, a selective state space model that can process very long contexts with a much lower computational cost. However, researchers found that the pure Mamba architecture underperforms in understanding the context, and gives lower-quality responses. To overcome this, AI21 developed the Jamba model, which combines Mamba's computational efficiency with the transformer's attention mechanism to help with the output quality. In this course, you’ll learn about how state space models, and Jamba, work. You’ll also learn how to prompt Jamba, use it to process long documents, and build long-context RAG apps. - Learn how Jamba combines transformer and state space model architectures to achieve high performance and quality - Use the AI21 SDK, with an example of prompting over a large 200k-token annual financial report of Nvidia - Use Jamba for tool-calling, with hands-on examples from calling simple arithmetic calculations to a function that returns quarterly company financial reports. - Learn how training for long context is done, and the metrics used for its evaluation - Create a RAG app using the AI21 Conversational RAG tool and build your own RAG pipeline that uses Jamba and LangChain. By the end of this course, you'll learn how to build applications that can handle context as long as an entire book. Please sign up here:

Andrew Ng

77,792 views • 1 year ago

This #ForensicScienceWeek, we’re celebrating the dedicated professionals of the Massachusetts State Police Crime Lab—and a major milestone for our new state-of-the-art facility in Marlborough.🔬 Learn more:

This #ForensicScienceWeek, we’re celebrating the dedicated professionals of the Massachusetts State Police Crime Lab—and a major milestone for our new state-of-the-art facility in Marlborough.🔬 Learn more:

Massachusetts State Police

17,066 views • 5 days ago

New AI research from Meta – CoTracker3 Simpler and Better Point Tracking by Pseudo-Labelling Real Videos. More details ➡️ Demo on Hugging Face ➡️ Building on our previous work on CoTracker, this new model demonstrates impressive tracking results where points can be tracked for a long time even when they're occluded or leave the field of view. CoTracker3 achieves state-of-the-art, outperforming all recent point tracking approaches on standard benchmarks — often by a substantial margin. We've released the research paper, code and a demo on Hugging Face — along with models available under an A-NC license to support further research in this space.

New AI research from Meta – CoTracker3 Simpler and Better Point Tracking by Pseudo-Labelling Real Videos. More details ➡️ Demo on Hugging Face ➡️ Building on our previous work on CoTracker, this new model demonstrates impressive tracking results where points can be tracked for a long time even when they're occluded or leave the field of view. CoTracker3 achieves state-of-the-art, outperforming all recent point tracking approaches on standard benchmarks — often by a substantial margin. We've released the research paper, code and a demo on Hugging Face — along with models available under an A-NC license to support further research in this space.

AI at Meta

219,050 views • 1 year ago

Say hello to DX Research Group, a new AI studio focused on innovative onchain experiences Our first experiment DX01: SINGULARITY begins this Thursday on Base Follow DX Research Group and read below to learn more

Say hello to DX Research Group, a new AI studio focused on innovative onchain experiences Our first experiment DX01: SINGULARITY begins this Thursday on Base Follow DX Research Group and read below to learn more

poof

47,832 views • 1 year ago

From excellence in the classroom to groundbreaking research, FIU has been designated a Preeminent State Research University by the Florida Board of Governors. Read more at:

From excellence in the classroom to groundbreaking research, FIU has been designated a Preeminent State Research University by the Florida Board of Governors. Read more at:

FIU

39,445 views • 2 years ago

SpaceX has recently implemented a significant upgrade to the Falcon 9’s second stage cameras, transitioning from the original system to a new, state-of-the-art high definition one. 😉

SpaceX has recently implemented a significant upgrade to the Falcon 9’s second stage cameras, transitioning from the original system to a new, state-of-the-art high definition one. 😉

Stellarix

117,660 views • 2 months ago

Is AI more significant than the printing press? Yuval Noah Harari says this technology is fundamentally different. On today’s GPS, we talked about the state of the information age and Harari’s new book, “Nexus: A Brief History of Information Networks from the Stone Age to AI”

Is AI more significant than the printing press? Yuval Noah Harari says this technology is fundamentally different. On today’s GPS, we talked about the state of the information age and Harari’s new book, “Nexus: A Brief History of Information Networks from the Stone Age to AI”

Fareed Zakaria

63,739 views • 2 years ago

Sneak a peek inside NASA's newest wind tunnel — opening this Friday, July 31! Watch to take a closer look at the Flight Dynamic Research Facility's state-of-the-art control room, one of its powerful fans, and a lobby space honoring the past as it prepares to propel a new era of flight research. More:

Sneak a peek inside NASA's newest wind tunnel — opening this Friday, July 31! Watch to take a closer look at the Flight Dynamic Research Facility's state-of-the-art control room, one of its powerful fans, and a lobby space honoring the past as it prepares to propel a new era of flight research. More:

NASA Langley Research Center

222,319 views • 2 months ago

Google just released Veo 2, a new state-of-the-art AI video model. In testing, Veo beat OpenAI Sora in BOTH quality and prompt adherence. The video compilation below is 100% created by AI (more details in thread):

Google just released Veo 2, a new state-of-the-art AI video model. In testing, Veo beat OpenAI Sora in BOTH quality and prompt adherence. The video compilation below is 100% created by AI (more details in thread):

Rowan Cheung

250,056 views • 1 year ago

Announcing Gaia, a major update to our AI phone agents. Gaia sets a new state of the art: its latency beats the competition by over 500ms in our benchmarks. This is the closest that phone agents have ever gotten to human calls. Give it a call at the number below!

Announcing Gaia, a major update to our AI phone agents. Gaia sets a new state of the art: its latency beats the competition by over 500ms in our benchmarks. This is the closest that phone agents have ever gotten to human calls. Give it a call at the number below!

Flo Crivello

518,778 views • 1 year ago