Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

We're running 500 neural nets in parallel to pull this one off. We make smart glasses for the deaf and just hit a breakthrough: Real world audio event notifications on smart glasses. Laughter, speech, doorbell, phone ring, etc. on smart glasses for the deaf.

cayden 凯登

9,371 subscribers

26,614 views • 1 year ago •via X (Twitter)

Health & Wellness Education Science & Technology

Anya Rossi• Live Now

Private livecam show

11 Comments

cayden 凯登1 year ago

Checkout our smart glasses captioning solution for the deaf and hard of hearing:

SecBriefs | Making Cybersecurity Simple1 year ago

Quantum computers can break today’s encryption in seconds.🔑 Quantum tech will reshape our digital lives. Governments & hackers are preparing for the quantum era. How about you?🛡️ Don’t get left behind!🧠 Cybersecurity Dictionary for Everyone can help:

Sukanth K.1 year ago

@MentraLabs @a_israelov @IsaiahBallah @Nicolo_AI @aurorazelia_ai Wow. Assumed it would be a VLM. But this is mind-blowing...

Joseph1 year ago

@MentraLabs @a_israelov @IsaiahBallah @Nicolo_AI @aurorazelia_ai Damn this is nuts

Seth1 year ago

@MentraLabs @a_israelov @IsaiahBallah @Nicolo_AI @aurorazelia_ai Phenomenal!

Jacob 🌟1 year ago

@MentraLabs @a_israelov @IsaiahBallah @Nicolo_AI @aurorazelia_ai the sad part is you’re not even putting this infront of deaf and letting them design it. you realize this is just TTY age tech. it’s.. kinda insulting

cayden 凯登1 year ago

We are working directly with hundreds of deaf and hard of hearing users on our smart glasses captions app. Soundy is a prototyope which we'll release in beta this week to our users as we continue to codesign with them. If you want to try our smart glasses solution for the deaf and hard of hearing, check this out:

Aurora Zelia1 year ago

@MentraLabs @a_israelov @IsaiahBallah @Nicolo_AI 🔥

TokioKid.eth1 year ago

@MentraLabs @a_israelov @IsaiahBallah @Nicolo_AI @aurorazelia_ai This is fantastic, rooting for you guys ! Any chance you have a version with seamless cochlear implant integration on your product roadmap?

Manish Kumar1 year ago

@MentraLabs @a_israelov @IsaiahBallah @Nicolo_AI @aurorazelia_ai This is amazing! A breakthrough like this could truly change lives. The impact on accessibility and everyday communication for the deaf community is huge. Hats off to your team!

Pavan1 year ago

@MentraLabs @a_israelov @IsaiahBallah @Nicolo_AI @aurorazelia_ai man, this is going to sick, when is it coming to production?

Related Videos

Playing Tetris on smart glasses using a neural band.

Playing Tetris on smart glasses using a neural band.

Nathie @ AWE

15,892 views • 1 month ago

Wow! Using the neural wristband alongside the Meta Ray-Ban display glasses to text seems like a game-changer for smart glasses.

Wow! Using the neural wristband alongside the Meta Ray-Ban display glasses to text seems like a game-changer for smart glasses.

Nathie

140,420 views • 9 months ago

AI-powered smart glasses, that display live captions and translate languages, are expected to make it easier for the deaf and hard-of-hearing people to engage in conversations

AI-powered smart glasses, that display live captions and translate languages, are expected to make it easier for the deaf and hard-of-hearing people to engage in conversations

Reuters

21,187 views • 6 months ago

Smart glasses see what workers do So robots can learn to do the same work On Mentra smart glasses, we did this in a Shenzhen smartwatch factory But everything changes once you feed that live glasses audio/video to AI And let the AI whisper back assistance in workers ears ;)

Smart glasses see what workers do So robots can learn to do the same work On Mentra smart glasses, we did this in a Shenzhen smartwatch factory But everything changes once you feed that live glasses audio/video to AI And let the AI whisper back assistance in workers ears ;)

cayden 凯登

33,256 views • 11 months ago

Launching Mentra Live open-source smart glasses. Deploy smart glasses for real world work. We already shipped thousands. Now, they're generally available. Build apps that leave the screen. Let your AI step into the real world.

Launching Mentra Live open-source smart glasses. Deploy smart glasses for real world work. We already shipped thousands. Now, they're generally available. Build apps that leave the screen. Let your AI step into the real world.

cayden 凯登

78,541 views • 1 month ago

We're using smart glasses to learn Chinese. Our friend Yazen used it for 4 months in Russia - he's now conversationally fluent. Smart glasses are the next shift in intelligence augmentation.

We're using smart glasses to learn Chinese. Our friend Yazen used it for 4 months in Russia - he's now conversationally fluent. Smart glasses are the next shift in intelligence augmentation.

cayden 凯登

36,576 views • 1 year ago

The whole team just landed in Shenzhen. We came to build smart glasses and find our lost Founding Engineer Nicolo Now we found Nicolo so it's time to build smart glasses.

The whole team just landed in Shenzhen. We came to build smart glasses and find our lost Founding Engineer Nicolo Now we found Nicolo so it's time to build smart glasses.

cayden 凯登

23,940 views • 1 year ago

OpenAI just dropped a completely new kind of model gpt-realtime-translate takes in speech audio from any language and outputs speech in your target language LLMs are great, but you need specialized models for specialized use cases We're running this on our smart glasses

OpenAI just dropped a completely new kind of model gpt-realtime-translate takes in speech audio from any language and outputs speech in your target language LLMs are great, but you need specialized models for specialized use cases We're running this on our smart glasses

cayden 凯登

100,395 views • 23 days ago

Introducing the Mentra Bluetooth SDK - control smart glasses directly from your Android/iOS app. Thousands of devs built smart glasses apps. But we heard one common complaint.... the cloud. So we stripped it out and gave you direct glasses control straight from your phone app.

Introducing the Mentra Bluetooth SDK - control smart glasses directly from your Android/iOS app. Thousands of devs built smart glasses apps. But we heard one common complaint.... the cloud. So we stripped it out and gave you direct glasses control straight from your phone app.

cayden 凯登

13,012 views • 1 month ago

Stanford students developed glasses that transcribe speech in real-time for deaf people 😳

Stanford students developed glasses that transcribe speech in real-time for deaf people 😳

internet hall of fame

1,034,108 views • 1 year ago

Smart Glasses Hackathon July 12-13 At Y Combinator in SF 100 pairs of smart glasses. 100 cracked devs. 48 hours at YC. Prizes are smart glasses. Only smart glasses. 1/3 of hackers will win free smart glasses. What will you build? Sign up below.

Smart Glasses Hackathon July 12-13 At Y Combinator in SF 100 pairs of smart glasses. 100 cracked devs. 48 hours at YC. Prizes are smart glasses. Only smart glasses. 1/3 of hackers will win free smart glasses. What will you build? Sign up below.

cayden 凯登

96,510 views • 1 year ago

$META delaying the launch of Ray-Ban Display smart glasses in Europe due to higher-than-expected demand in the US is great news. The numbers are still irrelevant, but Zuck’s vision — where the ~2 billion people who already wear glasses every day eventually switch to smart glasses — is slowly starting to gain traction. A world where smart glasses become the default device for many isn’t that far away. And for now, META is years ahead of its closest competitor. All $META needs to do is successfully integrate these smart glasses with a frontier AI model.

$META delaying the launch of Ray-Ban Display smart glasses in Europe due to higher-than-expected demand in the US is great news. The numbers are still irrelevant, but Zuck’s vision — where the ~2 billion people who already wear glasses every day eventually switch to smart glasses — is slowly starting to gain traction. A world where smart glasses become the default device for many isn’t that far away. And for now, META is years ahead of its closest competitor. All $META needs to do is successfully integrate these smart glasses with a frontier AI model.

Daniel

48,317 views • 5 months ago

100 hackers. 100 pairs of camera smart glasses. At the MentraLabs Live smart glasses hackathon this weekend at the YC office in San Francisco.

100 hackers. 100 pairs of camera smart glasses. At the MentraLabs Live smart glasses hackathon this weekend at the YC office in San Francisco.

Y Combinator

28,989 views • 11 months ago

Bloomberg's Mark Gurman on the recent investigation alleging that Meta subcontractors reviewed video captured by customers’ smart glasses, including highly sensitive material: "I think it raises really big questions about the smart glasses category." "This is reminiscent of when people figured out that Apple with Siri... had these folks called annotation analysts who listen to everything you're putting into the voice assistant." "[The Meta allegations don't concern] audio. This is camera footage. This is people potentially in intimate moments. I think that raises really big questions about the smart glasses category..." "At the same time, I don't think this changes the overall equation for smart glasses. I still think that this has been a successful pioneering product for Meta. In this case, with the smart glasses, the first-mover advantage is real."

Bloomberg's Mark Gurman on the recent investigation alleging that Meta subcontractors reviewed video captured by customers’ smart glasses, including highly sensitive material: "I think it raises really big questions about the smart glasses category." "This is reminiscent of when people figured out that Apple with Siri... had these folks called annotation analysts who listen to everything you're putting into the voice assistant." "[The Meta allegations don't concern] audio. This is camera footage. This is people potentially in intimate moments. I think that raises really big questions about the smart glasses category..." "At the same time, I don't think this changes the overall equation for smart glasses. I still think that this has been a successful pioneering product for Meta. In this case, with the smart glasses, the first-mover advantage is real."

TBPN

17,035 views • 3 months ago

3D hand tracking on smart glasses Not only can we stream camera data with our Wearables SDK, but we can run MediaPipe for hand tracking, applying it in WebXR environments like Three.js and A-Frame Works with compatible smart glasses, in this case the Omi AI Omi Glass, based on the Seeed Studio XIAO ESP32-S3 Sense (running our custom Firmware)

3D hand tracking on smart glasses Not only can we stream camera data with our Wearables SDK, but we can run MediaPipe for hand tracking, applying it in WebXR environments like Three.js and A-Frame Works with compatible smart glasses, in this case the Omi AI Omi Glass, based on the Seeed Studio XIAO ESP32-S3 Sense (running our custom Firmware)

Brilliant Wear

79,410 views • 5 months ago

Subtitle glasses smart glasses turn conversations into text in real time, supporting 4 languages

Subtitle glasses smart glasses turn conversations into text in real time, supporting 4 languages

Science girl

31,753 views • 1 year ago

SMART GLASSES LET DEAF GIRL SEE CONVERSATIONS IN REAL TIME These AR glasses show live subtitles of what people are saying around her. They also help her practice speaking by checking if her words show up right on screen. It’s like closed captions for real life. Source: news.com.au

SMART GLASSES LET DEAF GIRL SEE CONVERSATIONS IN REAL TIME These AR glasses show live subtitles of what people are saying around her. They also help her practice speaking by checking if her words show up right on screen. It’s like closed captions for real life. Source: news.com.au

Mario Nawfal

632,103 views • 11 months ago

Realtime Maps on Smart Glasses Using our Wearables SDK and OpenStreetMap to display a simple map overlay, allowing us to see what places are around us (and if they’re open or not) Works with compatible smart glasses (in this case the Brilliant Labs Frame running custom firmware)

Realtime Maps on Smart Glasses Using our Wearables SDK and OpenStreetMap to display a simple map overlay, allowing us to see what places are around us (and if they’re open or not) Works with compatible smart glasses (in this case the Brilliant Labs Frame running custom firmware)

Brilliant Wear

53,763 views • 8 months ago

This developer built an assistant for smart glasses that helps you make cocktails.

This developer built an assistant for smart glasses that helps you make cocktails.

Nathie 🔜 AWE

11,244 views • 3 months ago

Meta RayBan smart glasses are getting replaced By smart glasses with an app store

Meta RayBan smart glasses are getting replaced By smart glasses with an app store

cayden 凯登

14,177 views • 1 year ago