Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

I've been trying Meta smart glasses' new multimodal AI - while it's pretty basic right now, it's still sick to see it combine what it sees from the camera with the language model to describe what it's seeing! Already solid for accessibility Full episode:

Marques Brownlee

6,130,482 subscribers

1,128,366 views • 2 years ago •via X (Twitter)

Education Health & Wellness Science & Technology

Anya Rossi• Live Now

Private livecam show

10 Comments

Ben Geskin2 years ago

We are getting there 👀

Everett World2 years ago

Multi-modality is the next step. We're moving from LLMs to world models, that will be even more helpful for practical reasons.

Karthik Kannan2 years ago

Um, we’re already here

Average Engineer2 years ago

When he says that phrase and ask questions, Glass takes photo and takes question from users using OpenAI Whisper API, Upload to Gta-4 Vision API with your prompt Get back the results and make it speak again using API. Is there anything i am missing here?

David2 years ago

This is the way Marques !

Rahul2 years ago

Lower hanging use cases I could use this for already: reading while walking.

Pawel2 years ago

It is going to be the feature of AR

Newtonian2 years ago

Epic 👏🔥🔥

Joseph Bella2 years ago

I feel like we are seeing history repeat itself when Apple released the Newton and Palm made the Pilot.

Ellie MacQueen2 years ago

Here for the David stares

Related Videos

Everyone's losing their mind over the "new" Meta "Multimodal AI Glasses". I'm here to say it's already been out and round for 3 years. We, Envision have been building an AI-powered glasses for blind & low vision people since 2020. Check this profile by Business Insider

Karthik

49,150 views • 2 years ago

“But for me, I have to... It's not a dance, dance..performing ..It's more like the movement and trying to find the right move for this character.” “so that was what I've trying to dig into it with the choreographer” her dedication to it 🥹

“But for me, I have to... It's not a dance, dance..performing ..It's more like the movement and trying to find the right move for this character.” “so that was what I've trying to dig into it with the choreographer” her dedication to it 🥹

👽

152,091 views • 2 months ago

Here's a preview of what I've been working on with the Girl Front score to see if you like it. It's pretty simple at first (except for the arpeggios in the intro 😭), but it's supposed to get more difficult as it goes along.

Here's a preview of what I've been working on with the Girl Front score to see if you like it. It's pretty simple at first (except for the arpeggios in the intro 😭), but it's supposed to get more difficult as it goes along.

Xiomi♮

34,405 views • 3 months ago

Lawyer for Epstein Survivors: It's consistent with what we've been seeing from the Department of Justice for quite some time now. It's an incompetent coverup. They're trying to cover up documents, to withhold documents, to keep things from the public, but worse, they're not good at it.

Lawyer for Epstein Survivors: It's consistent with what we've been seeing from the Department of Justice for quite some time now. It's an incompetent coverup. They're trying to cover up documents, to withhold documents, to keep things from the public, but worse, they're not good at it.

The Lincoln Project

254,704 views • 4 months ago

Mark Zuckerberg says glasses are the perfect form factor for personal AI. “It can see what you see, hear what you hear, and talk to you throughout the day.” It's ambient intimacy with total recall.

Mark Zuckerberg says glasses are the perfect form factor for personal AI. “It can see what you see, hear what you hear, and talk to you throughout the day.” It's ambient intimacy with total recall.

vitrupo

138,781 views • 1 year ago

Been testing the new multistream OBS plugin from StreamElements and it's pretty insane. I'll make a video about it soon but here's what you need to know for now.

Been testing the new multistream OBS plugin from StreamElements and it's pretty insane. I'll make a video about it soon but here's what you need to know for now.

nutty

84,830 views • 1 year ago

🚨🇮🇷 It's 1:45 AM in Iran and the streets are still full from what it looks like right now.

🚨🇮🇷 It's 1:45 AM in Iran and the streets are still full from what it looks like right now.

Eli Afriat 🇮🇱

42,003 views • 5 months ago

Cash is fast, effective, and easy to scale. It's not just smart aid, it's the right aid. It gives people the power to choose what they need most. And it's completely aligned with the humanitarian reset – more local, more flexible.

Cash is fast, effective, and easy to scale. It's not just smart aid, it's the right aid. It gives people the power to choose what they need most. And it's completely aligned with the humanitarian reset – more local, more flexible.

Tom Fletcher

140,135 views • 1 year ago

here's a quick showcase of the ui editor i've been working on! already starting to add more to it, and i'm super happy with the direction it's going in! let me know what else you'd like to see :)

here's a quick showcase of the ui editor i've been working on! already starting to add more to it, and i'm super happy with the direction it's going in! let me know what else you'd like to see :)

Gavin

38,541 views • 4 days ago

Google Gemini 2.0 Multimodal is not AGI but... wow it's blowing my mind. Imagine having an intelligence sitting with you and helping you with everything you do. It isn't super-intelligence but it sees everything you see and it knows, well, everything there is to know. I've been playing with it all day and I made a video to show you what it's capable of. I share 3 use cases - 1) It watches while I read a technical paper and answers questions that I have when I ask it 2) It sees the code I'm looking at and explains it to me and makes suggestions to improve it 3) This one is most impressive. I hold up my phone to my computer camera and it solves the crossword that's on the phone. Y'all... we're living in the future, and it's only going to get smarter and better from here. Unlimited intelligence, at your fingertips, seeing what you see, helping you in everything you do. Say hello to Gemini 2.0

Google Gemini 2.0 Multimodal is not AGI but... wow it's blowing my mind. Imagine having an intelligence sitting with you and helping you with everything you do. It isn't super-intelligence but it sees everything you see and it knows, well, everything there is to know. I've been playing with it all day and I made a video to show you what it's capable of. I share 3 use cases - 1) It watches while I read a technical paper and answers questions that I have when I ask it 2) It sees the code I'm looking at and explains it to me and makes suggestions to improve it 3) This one is most impressive. I hold up my phone to my computer camera and it solves the crossword that's on the phone. Y'all... we're living in the future, and it's only going to get smarter and better from here. Unlimited intelligence, at your fingertips, seeing what you see, helping you in everything you do. Say hello to Gemini 2.0

Sid Bharath

120,168 views • 1 year ago

A new interesting model from Hailuo AI (MiniMax) It's called T2V-01-Director, and as the name says, you can use natural language or specific commands to guide the camera. Available in early preview for the creative partners. Here's how it works:

A new interesting model from Hailuo AI (MiniMax) It's called T2V-01-Director, and as the name says, you can use natural language or specific commands to guide the camera. Available in early preview for the creative partners. Here's how it works:

Alex Patrascu

53,808 views • 1 year ago

"It's sick and twisted that I have to work to survive for basic necessities... What if I don't want to achieve sh*t? I still have to work till the day I die just to live?... Universal healthcare, universal basic income it needs to happen now... For the 1% it'll never be enough."

"It's sick and twisted that I have to work to survive for basic necessities... What if I don't want to achieve sh*t? I still have to work till the day I die just to live?... Universal healthcare, universal basic income it needs to happen now... For the 1% it'll never be enough."

Leftism

7,550,829 views • 3 years ago

Hazuki on how she would like to defend the Spark belt: "Hmm... I've been saying that I want to defend it, but, well, it's not a STARDOM belt, so I feel like it's pretty hard to actually get a defense match. I've only defended it once, and it's already been a year." #STARDOM

Hazuki on how she would like to defend the Spark belt: "Hmm... I've been saying that I want to defend it, but, well, it's not a STARDOM belt, so I feel like it's pretty hard to actually get a defense match. I've only defended it once, and it's already been a year." #STARDOM

Himanshu Doi

13,898 views • 3 months ago

$META delaying the launch of Ray-Ban Display smart glasses in Europe due to higher-than-expected demand in the US is great news. The numbers are still irrelevant, but Zuck’s vision — where the ~2 billion people who already wear glasses every day eventually switch to smart glasses — is slowly starting to gain traction. A world where smart glasses become the default device for many isn’t that far away. And for now, META is years ahead of its closest competitor. All $META needs to do is successfully integrate these smart glasses with a frontier AI model.

$META delaying the launch of Ray-Ban Display smart glasses in Europe due to higher-than-expected demand in the US is great news. The numbers are still irrelevant, but Zuck’s vision — where the ~2 billion people who already wear glasses every day eventually switch to smart glasses — is slowly starting to gain traction. A world where smart glasses become the default device for many isn’t that far away. And for now, META is years ahead of its closest competitor. All $META needs to do is successfully integrate these smart glasses with a frontier AI model.

Daniel

48,317 views • 5 months ago

been using a stealth model all day in opencode and it's working real well now you can use it too - it's called Sonic, it's made for coding and it's free for you to use so the team behind it can test it update to latest opencode and it should pop up right there

been using a stealth model all day in opencode and it's working real well now you can use it too - it's called Sonic, it's made for coding and it's free for you to use so the team behind it can test it update to latest opencode and it should pop up right there

dax

122,609 views • 10 months ago

28 minutes. From idea to export. That's all it took to do this. It's not perfect, but it's still impressive what you can achieve with Sora and Kling AI today:

28 minutes. From idea to export. That's all it took to do this. It's not perfect, but it's still impressive what you can achieve with Sora and Kling AI today:

Alex Patrascu

3,852,600 views • 1 year ago

Mark Knopfler - What It Is The drinking dens are spilling out There's staggering in the square There's lads and lasses falling about And a crackling in the air Down around the dungeon doors The shelters and the queues Everybody's looking for Somebody's arms to fall into And it's what it is It's what it is now There's frost on the graves and the monuments But the taverns are warm in town People curse the government And shovel hot food down The lights are out in city hall The castle and the keep The moon shines down upon it all The legless and asleep And it's cold on the tollgate With the wagons creeping through Cold on the tollgate God knows what I could do with you And it's what it is It's what it is now The garrison sleeps in the citadel With the ghosts and the ancient stones High up on the parapet A Scottish piper stands alone And high on the wind The highland drums begin to roll And something from the past just comes And stares into my soul And it's cold on the tollgate With the Caledonian Blues Cold on the tollgate God knows what I could do with you And it's what it is It's what it is now What it is It's what it is now There's a chink of light, there's a burning wick There's a lantern in the tower Wee Willie Winkie with a candlestick Still writing songs in the wee, wee hours On Charlotte Street I take A walking stick from my hotel The ghost of Dirty Dick Is still in search of Little Nell And it's what it is It's what it is now Oh it's what it is What it is now

Mark Knopfler - What It Is The drinking dens are spilling out There's staggering in the square There's lads and lasses falling about And a crackling in the air Down around the dungeon doors The shelters and the queues Everybody's looking for Somebody's arms to fall into And it's what it is It's what it is now There's frost on the graves and the monuments But the taverns are warm in town People curse the government And shovel hot food down The lights are out in city hall The castle and the keep The moon shines down upon it all The legless and asleep And it's cold on the tollgate With the wagons creeping through Cold on the tollgate God knows what I could do with you And it's what it is It's what it is now The garrison sleeps in the citadel With the ghosts and the ancient stones High up on the parapet A Scottish piper stands alone And high on the wind The highland drums begin to roll And something from the past just comes And stares into my soul And it's cold on the tollgate With the Caledonian Blues Cold on the tollgate God knows what I could do with you And it's what it is It's what it is now What it is It's what it is now There's a chink of light, there's a burning wick There's a lantern in the tower Wee Willie Winkie with a candlestick Still writing songs in the wee, wee hours On Charlotte Street I take A walking stick from my hotel The ghost of Dirty Dick Is still in search of Little Nell And it's what it is It's what it is now Oh it's what it is What it is now

Dire Straits 🎸

27,566 views • 1 year ago

"It's an opportunity to go: 'Do you know what, I've still got it'." Yorkshire's Dom Bess hopes the ECB's proposed change from a 'closed lid' policy sees more County cricketers selected for England, including himself. #BBCCricket | #YCCC

"It's an opportunity to go: 'Do you know what, I've still got it'." Yorkshire's Dom Bess hopes the ECB's proposed change from a 'closed lid' policy sees more County cricketers selected for England, including himself. #BBCCricket | #YCCC

BBC Sport West Yorkshire

24,178 views • 2 months ago

It's been nearly three years since it came out and the climax of Nimona still gets me every single time. Words cannot describe how much of a miracle it was that this film got released, how it is, and what it means to me. It's the film Blue Sky deserves to be remembered for.

It's been nearly three years since it came out and the climax of Nimona still gets me every single time. Words cannot describe how much of a miracle it was that this film got released, how it is, and what it means to me. It's the film Blue Sky deserves to be remembered for.

Animated Antic

300,386 views • 5 months ago

Is Meta on it's way out of business? Meta has been Stealing Millions of Dollars from it's creators for the past few months, Hundreds of Thousands of creators are now stuck in Limbo as Meta is Refusing to pay what they owe...

Is Meta on it's way out of business? Meta has been Stealing Millions of Dollars from it's creators for the past few months, Hundreds of Thousands of creators are now stuck in Limbo as Meta is Refusing to pay what they owe...

Southland Post

883,054 views • 1 year ago