Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

New 🤗 transformers release includes a very powerful Multimodel Large Language Model (MLLM) by Microsoft called KOSMOS-2! 🤩 The highlight of KOSMOS-2 is grounding, the model is incredibly accurate! 🌎 Play with the demo here 👉 But how does this model work? Let's take a look! 👀🧶

merve

86,581 subscribers

143,816 Aufrufe • vor 2 Jahren •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

11 Kommentare

Profilbild von merve

mervevor 2 Jahren

Grounding helps machine learning models relate to real-world examples. Including grounding makes models more performant by means of accuracy and robustness during inference. It also helps reduce the so-called "hallucinations" in language models.

Profilbild von merve

mervevor 2 Jahren

In Kosmos-2, model is grounded to perform following tasks and is evaluated on 👇 - multimodal grounding & phrase grounding, e.g. localizing the object through natural language query - multimodal referring, e.g. describing object characteristics & location - perception-language tasks - language understanding and generation

Profilbild von merve

mervevor 2 Jahren

The dataset used for grounding, called GRiT is also available on Hugging Face Hub 👉 Thanks to transformers integration, you can use KOSMOS-2 with few lines of code 🤩 See below! 👇

Profilbild von merve

mervevor 2 Jahren

also big kudos to @ydshieh for implementing this in transformers ✨

Profilbild von Rainmaker

Rainmakervor 2 Jahren

Can Machine Learning beat the market? Check out this post on my free Substack where I share code and commentary for an XGBoost model and a Random Forest model that both deliver powerful performances.

Profilbild von merve

mervevor 2 Jahren

multimodal* 🥲

Profilbild von Luis C

Luis Cvor 2 Jahren

@Microsoft Wow, its very fast on an A40

Profilbild von iamrobotbear (bk)

iamrobotbear (bk)vor 2 Jahren

@Microsoft License?

Profilbild von Vlad

Vladvor 2 Jahren

@ClementDelangue @Microsoft 🤔 I could use this to improve I'm using the Blip model and is not bad but this looks like it could give more accurate results.

Profilbild von SkalskiP

SkalskiPvor 2 Jahren

@Microsoft Yup KOSMOS-2 is awesome!

Profilbild von Risichad 🦾

Risichad 🦾vor 2 Jahren

@Microsoft AI can understand a video at 3fps then !!!

Ähnliche Videos

I'm stoked to be showing my challenge students how to use AI with ROS 2! In this demo the robot detects the coke can using a Large Language Model called CLIPSeg, which uses a text prompt "A can of soda" to segment the image .

I'm stoked to be showing my challenge students how to use AI with ROS 2! In this demo the robot detects the coke can using a Large Language Model called CLIPSeg, which uses a text prompt "A can of soda" to segment the image .

Dr. John Vial

12,274 Aufrufe • vor 1 Jahr

Introducing WildDet3D, a grounding model for monocular 3D object detection in the wild. A question I keep coming back to is: what is the right backbone for robotics foundation models? Should it be a video model, a language model, or perhaps a grounding model? WildDet3D is our first step in exploring that direction.

Introducing WildDet3D, a grounding model for monocular 3D object detection in the wild. A question I keep coming back to is: what is the right backbone for robotics foundation models? Should it be a video model, a language model, or perhaps a grounding model? WildDet3D is our first step in exploring that direction.

Jiafei Duan

12,072 Aufrufe • vor 2 Monaten

WhisperKit x OpenAI Whisper Large v3 Turbo Released a few hours ago, this model is 8x faster than the original Large v3 model while retaining its high-quality multilingual capabilities. Here is a demo using our test app. Test app: GitHub (MIT): OpenAI release:

WhisperKit x OpenAI Whisper Large v3 Turbo Released a few hours ago, this model is 8x faster than the original Large v3 model while retaining its high-quality multilingual capabilities. Here is a demo using our test app. Test app: GitHub (MIT): OpenAI release:

argmax

47,779 Aufrufe • vor 1 Jahr

$When dividing by a fraction, a lot of people think about the measurement model, but we can think about the partitive model too! Here's why I think the partitive model is powerful.$

When dividing by a fraction, a lot of people think about the measurement model, but we can think about the partitive model too! Here's why I think the partitive model is powerful.

Howie Hua

10,788 Aufrufe • vor 8 Monaten

Two videos of Russian interceptor drones with AI-targeting The first is the 'Bolt' UAV, a new model with ~15km range The second is the Yolka, a very common model with 2-3km range. It has no explosives, only kinetic forces

Two videos of Russian interceptor drones with AI-targeting The first is the 'Bolt' UAV, a new model with ~15km range The second is the Yolka, a very common model with 2-3km range. It has no explosives, only kinetic forces

EventsInUkraine

10,509 Aufrufe • vor 15 Tagen

A glimpse at the new EGLD economics model. So how does the model work? How does it capture value? How is it better than what we had before? One word. Growth. 🔥🛠️

A glimpse at the new EGLD economics model. So how does the model work? How does it capture value? How is it better than what we had before? One word. Growth. 🔥🛠️

Beniamin Mincu |🇺🇸/acc

21,154 Aufrufe • vor 8 Monaten

I've seen so many people criticize the stock sonic model and say the model needs changing. But no, the model is fine. the problem is with how it's always posed. here for example with the unleashed model you can simply deform the brows and the muzzle to curve. This is pretty much the sonic unleashed game model but with a good rig that makes anything possible with the face. (Rig by DANCADA³ᴰ)

I've seen so many people criticize the stock sonic model and say the model needs changing. But no, the model is fine. the problem is with how it's always posed. here for example with the unleashed model you can simply deform the brows and the muzzle to curve. This is pretty much the sonic unleashed game model but with a good rig that makes anything possible with the face. (Rig by DANCADA³ᴰ)

TBSF

192,128 Aufrufe • vor 1 Jahr

See how Heavy Pulp made a trailer worthy of the big screen with this powerful new model:

See how Heavy Pulp made a trailer worthy of the big screen with this powerful new model:

xAI

4,444,088 Aufrufe • vor 15 Stunden

OpenAI Co-founder Andrej Karpathy explains the new computing paradigm: "We're entering a new computing paradigm with large language models acting like CPUs, using tokens instead of bytes, and having a context window instead of RAM. This is the Large Language Model OS (LMOS)"

OpenAI Co-founder Andrej Karpathy explains the new computing paradigm: "We're entering a new computing paradigm with large language models acting like CPUs, using tokens instead of bytes, and having a context window instead of RAM. This is the Large Language Model OS (LMOS)"

Haider.

552,309 Aufrufe • vor 1 Jahr

Language is the future for how we interact with robots. Today Wayve is sharing a first look at LINGO-1, a new vision-language-action AI model. To give you a glimpse of its capabilities, here is a video of me playing with LINGO-1 yesterday morning.

Language is the future for how we interact with robots. Today Wayve is sharing a first look at LINGO-1, a new vision-language-action AI model. To give you a glimpse of its capabilities, here is a video of me playing with LINGO-1 yesterday morning.

Alex Kendall

154,727 Aufrufe • vor 2 Jahren

Karp has been saying it for years: The Large Language Model is a commodity

Karp has been saying it for years: The Large Language Model is a commodity

Jack Prescott

37,483 Aufrufe • vor 6 Tagen

Over the past few years, we have taken a gigantic leap forward in our decades-long quest to build intelligent machines: the advent of the large language model or LLM. This is how they work

Over the past few years, we have taken a gigantic leap forward in our decades-long quest to build intelligent machines: the advent of the large language model or LLM. This is how they work

Financial Times

40,840 Aufrufe • vor 2 Jahren

tried making myself with the 2wintails customizable model 👀 how does the face tracking look?

tried making myself with the 2wintails customizable model 👀 how does the face tracking look?

❌2𝔴𝔦𝔫𝔱𝔞𝔦𝔩𝔰❌ Customisable Model OUT NOW

36,720 Aufrufe • vor 5 Monaten

Apple built a large foundation model and fine-tuned it on multiple tasks. But they are doing something very clever: They load a single model in memory and use different adapters to specialize the model on the fly. I recorded a video to show you how to write the code to do the same thing Apple is doing. I explain everything step by step. Here is what I'll show you in the video: 1. We'll load two datasets 2. Then load a large model 3. Then, we'll fine-tune the model on both datasets I'll use LoRA to fine-tune the model. This process creates two small adapters, each specializing in solving one of the datasets. The base model's original parameters will remain unchanged. From here: 4. We'll generate a list of tasks 5. We'll load the correct adapter to solve each task The large model I'm using needs 346 MB of memory, but I only need to load it once. Each adapter is only 2.7 MB. I only need to load the base model once and pair it with any of the fine-tuned adapters. Minimum memory footprint and I can solve multiple tasks. Hope this helps!

Apple built a large foundation model and fine-tuned it on multiple tasks. But they are doing something very clever: They load a single model in memory and use different adapters to specialize the model on the fly. I recorded a video to show you how to write the code to do the same thing Apple is doing. I explain everything step by step. Here is what I'll show you in the video: 1. We'll load two datasets 2. Then load a large model 3. Then, we'll fine-tune the model on both datasets I'll use LoRA to fine-tune the model. This process creates two small adapters, each specializing in solving one of the datasets. The base model's original parameters will remain unchanged. From here: 4. We'll generate a list of tasks 5. We'll load the correct adapter to solve each task The large model I'm using needs 346 MB of memory, but I only need to load it once. Each adapter is only 2.7 MB. I only need to load the base model once and pair it with any of the fine-tuned adapters. Minimum memory footprint and I can solve multiple tasks. Hope this helps!

Santiago

84,747 Aufrufe • vor 1 Jahr

Nick Fuentes says SNEAKO is literally a Large Language Model 😂 "He functions like a prediction model, he doesn't have any real beliefs; he detects which way the wind is blowing, and he DESPERATELY tries to say the 'hot take' of the day."

Nick Fuentes says SNEAKO is literally a Large Language Model 😂 "He functions like a prediction model, he doesn't have any real beliefs; he detects which way the wind is blowing, and he DESPERATELY tries to say the 'hot take' of the day."

Fuentes Updates

24,432 Aufrufe • vor 21 Tagen

I've had early access to Kling AI brand new 2.0 video model and done extensive testing and trust me when I say that this model upgrade is AMAZING!!! 🔥 The amount of incredible dynamic action that you can generate now is next level. If you want to make things go fast, the new model completely excels at this, movement looks very natural and fluid. This is a major release for Kling! Here is a collection of some clips I've generated with the 2.0 model.

Travis Davids

87,789 Aufrufe • vor 1 Jahr

Since the first edition of the HBL PSL, the tournament has followed a Player Draft Model. As the league transitions to a Player Auction Model, let's look at how the Player Auction will work 👇 #HBLPSL | #NewEra

Since the first edition of the HBL PSL, the tournament has followed a Player Draft Model. As the league transitions to a Player Auction Model, let's look at how the Player Auction will work 👇 #HBLPSL | #NewEra

PakistanSuperLeague

52,731 Aufrufe • vor 4 Monaten

$TSLA Take a look at the Welcome Signal of the new Model Y!

$TSLA Take a look at the Welcome Signal of the new Model Y!

Tsla Chan

88,758 Aufrufe • vor 1 Jahr

Large Language Diffusion with Masking (LLaDA) are here - and their generation looks so fucking dope! 🤯 True to Yann LeCun's vision, Ditch the auto-regressive bits and approximate the language distribution via Maximum Likelihood Estimation! So cool to watch the model denoise text from tokens in real time! - The team released their model checkpoints and there's a demo for you to play with it too! Try it out!🤗

Large Language Diffusion with Masking (LLaDA) are here - and their generation looks so fucking dope! 🤯 True to Yann LeCun's vision, Ditch the auto-regressive bits and approximate the language distribution via Maximum Likelihood Estimation! So cool to watch the model denoise text from tokens in real time! - The team released their model checkpoints and there's a demo for you to play with it too! Try it out!🤗

Vaibhav (VB) Srivastav

21,394 Aufrufe • vor 1 Jahr