Загрузка видео...

Не удалось загрузить видео

На главную

We're running 500 neural nets in parallel to pull this one off. We make smart glasses for the deaf and just hit a breakthrough: Real world audio event notifications on smart glasses. Laughter, speech, doorbell, phone ring, etc. on smart glasses for the deaf.

caydengineer's profile picture

cayden 凯登

9,371 subscribers

26,614 просмотров • 1 год назад •via X (Twitter)

Здоровье и велнесОбразованиеНаука и технологии
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 11

Фото профиля cayden 凯登
cayden 凯登1 год назад

Checkout our smart glasses captioning solution for the deaf and hard of hearing:

Фото профиля SecBriefs | Making Cybersecurity Simple
SecBriefs | Making Cybersecurity Simple1 год назад

Quantum computers can break today’s encryption in seconds.🔑 Quantum tech will reshape our digital lives. Governments & hackers are preparing for the quantum era. How about you?🛡️ Don’t get left behind!🧠 Cybersecurity Dictionary for Everyone can help:

Фото профиля Sukanth K.
Sukanth K.1 год назад

@MentraLabs @a_israelov @IsaiahBallah @Nicolo_AI @aurorazelia_ai Wow. Assumed it would be a VLM. But this is mind-blowing...

Фото профиля Joseph
Joseph1 год назад

@MentraLabs @a_israelov @IsaiahBallah @Nicolo_AI @aurorazelia_ai Damn this is nuts

Фото профиля Seth
Seth1 год назад

@MentraLabs @a_israelov @IsaiahBallah @Nicolo_AI @aurorazelia_ai Phenomenal!

Фото профиля Jacob 🌟
Jacob 🌟1 год назад

@MentraLabs @a_israelov @IsaiahBallah @Nicolo_AI @aurorazelia_ai the sad part is you’re not even putting this infront of deaf and letting them design it. you realize this is just TTY age tech. it’s.. kinda insulting

Фото профиля cayden 凯登
cayden 凯登1 год назад

We are working directly with hundreds of deaf and hard of hearing users on our smart glasses captions app. Soundy is a prototyope which we'll release in beta this week to our users as we continue to codesign with them. If you want to try our smart glasses solution for the deaf and hard of hearing, check this out:

Фото профиля Aurora Zelia
Aurora Zelia1 год назад

@MentraLabs @a_israelov @IsaiahBallah @Nicolo_AI 🔥

Фото профиля TokioKid.eth
TokioKid.eth1 год назад

@MentraLabs @a_israelov @IsaiahBallah @Nicolo_AI @aurorazelia_ai This is fantastic, rooting for you guys ! Any chance you have a version with seamless cochlear implant integration on your product roadmap?

Фото профиля Manish Kumar
Manish Kumar1 год назад

@MentraLabs @a_israelov @IsaiahBallah @Nicolo_AI @aurorazelia_ai This is amazing! A breakthrough like this could truly change lives. The impact on accessibility and everyday communication for the deaf community is huge. Hats off to your team!

Фото профиля Pavan
Pavan1 год назад

@MentraLabs @a_israelov @IsaiahBallah @Nicolo_AI @aurorazelia_ai man, this is going to sick, when is it coming to production?

Похожие видео

Wow! Using the neural wristband alongside the Meta Ray-Ban display glasses to text seems like a game-changer for smart glasses.
0:50

Wow! Using the neural wristband alongside the Meta Ray-Ban display glasses to text seems like a game-changer for smart glasses.

Nathie

140,420 просмотров • 10 месяцев назад

AI-powered smart glasses, that display live captions and translate languages, are expected to make it easier for the deaf and hard-of-hearing people to engage in conversations
2:16

AI-powered smart glasses, that display live captions and translate languages, are expected to make it easier for the deaf and hard-of-hearing people to engage in conversations

Reuters

21,187 просмотров • 6 месяцев назад

Smart glasses see what workers do So robots can learn to do the same work On Mentra smart glasses, we did this in a Shenzhen smartwatch factory But everything changes once you feed that live glasses audio/video to AI And let the AI whisper back assistance in workers ears ;)
0:25

Smart glasses see what workers do So robots can learn to do the same work On Mentra smart glasses, we did this in a Shenzhen smartwatch factory But everything changes once you feed that live glasses audio/video to AI And let the AI whisper back assistance in workers ears ;)

cayden 凯登

33,256 просмотров • 1 год назад

Launching Mentra Live open-source smart glasses. Deploy smart glasses for real world work. We already shipped thousands. Now, they're generally available. Build apps that leave the screen. Let your AI step into the real world.
1:27

Launching Mentra Live open-source smart glasses. Deploy smart glasses for real world work. We already shipped thousands. Now, they're generally available. Build apps that leave the screen. Let your AI step into the real world.

cayden 凯登

79,041 просмотров • 1 месяц назад

We're using smart glasses to learn Chinese. Our friend Yazen used it for 4 months in Russia - he's now conversationally fluent. Smart glasses are the next shift in intelligence augmentation.
0:58

We're using smart glasses to learn Chinese. Our friend Yazen used it for 4 months in Russia - he's now conversationally fluent. Smart glasses are the next shift in intelligence augmentation.

cayden 凯登

36,576 просмотров • 1 год назад

OpenAI just dropped a completely new kind of model gpt-realtime-translate takes in speech audio from any language and outputs speech in your target language LLMs are great, but you need specialized models for specialized use cases We're running this on our smart glasses
0:42

OpenAI just dropped a completely new kind of model gpt-realtime-translate takes in speech audio from any language and outputs speech in your target language LLMs are great, but you need specialized models for specialized use cases We're running this on our smart glasses

cayden 凯登

100,395 просмотров • 1 месяц назад

$META delaying the launch of Ray-Ban Display smart glasses in Europe due to higher-than-expected demand in the US is great news. The numbers are still irrelevant, but Zuck’s vision — where the ~2 billion people who already wear glasses every day eventually switch to smart glasses — is slowly starting to gain traction. A world where smart glasses become the default device for many isn’t that far away. And for now, META is years ahead of its closest competitor. All $META needs to do is successfully integrate these smart glasses with a frontier AI model.
0:35

$META delaying the launch of Ray-Ban Display smart glasses in Europe due to higher-than-expected demand in the US is great news. The numbers are still irrelevant, but Zuck’s vision — where the ~2 billion people who already wear glasses every day eventually switch to smart glasses — is slowly starting to gain traction. A world where smart glasses become the default device for many isn’t that far away. And for now, META is years ahead of its closest competitor. All $META needs to do is successfully integrate these smart glasses with a frontier AI model.

Daniel

48,317 просмотров • 6 месяцев назад

We made smart glasses that understand every language all the time For captions, translation, and AI On MentraOS
0:40

We made smart glasses that understand every language all the time For captions, translation, and AI On MentraOS

cayden 凯登

17,041 просмотров • 1 год назад

Bloomberg's Mark Gurman on the recent investigation alleging that Meta subcontractors reviewed video captured by customers’ smart glasses, including highly sensitive material: "I think it raises really big questions about the smart glasses category." "This is reminiscent of when people figured out that Apple with Siri... had these folks called annotation analysts who listen to everything you're putting into the voice assistant." "[The Meta allegations don't concern] audio. This is camera footage. This is people potentially in intimate moments. I think that raises really big questions about the smart glasses category..." "At the same time, I don't think this changes the overall equation for smart glasses. I still think that this has been a successful pioneering product for Meta. In this case, with the smart glasses, the first-mover advantage is real."
1:45

Bloomberg's Mark Gurman on the recent investigation alleging that Meta subcontractors reviewed video captured by customers’ smart glasses, including highly sensitive material: "I think it raises really big questions about the smart glasses category." "This is reminiscent of when people figured out that Apple with Siri... had these folks called annotation analysts who listen to everything you're putting into the voice assistant." "[The Meta allegations don't concern] audio. This is camera footage. This is people potentially in intimate moments. I think that raises really big questions about the smart glasses category..." "At the same time, I don't think this changes the overall equation for smart glasses. I still think that this has been a successful pioneering product for Meta. In this case, with the smart glasses, the first-mover advantage is real."

TBPN

17,035 просмотров • 4 месяцев назад

3D hand tracking on smart glasses Not only can we stream camera data with our Wearables SDK, but we can run MediaPipe for hand tracking, applying it in WebXR environments like Three.js and A-Frame Works with compatible smart glasses, in this case the Omi AI Omi Glass, based on the Seeed Studio XIAO ESP32-S3 Sense (running our custom Firmware)
0:30

3D hand tracking on smart glasses Not only can we stream camera data with our Wearables SDK, but we can run MediaPipe for hand tracking, applying it in WebXR environments like Three.js and A-Frame Works with compatible smart glasses, in this case the Omi AI Omi Glass, based on the Seeed Studio XIAO ESP32-S3 Sense (running our custom Firmware)

Brilliant Wear

79,410 просмотров • 6 месяцев назад

SMART GLASSES LET DEAF GIRL SEE CONVERSATIONS IN REAL TIME These AR glasses show live subtitles of what people are saying around her. They also help her practice speaking by checking if her words show up right on screen. It’s like closed captions for real life. Source: news.com.au
0:37

SMART GLASSES LET DEAF GIRL SEE CONVERSATIONS IN REAL TIME These AR glasses show live subtitles of what people are saying around her. They also help her practice speaking by checking if her words show up right on screen. It’s like closed captions for real life. Source: news.com.au

Mario Nawfal

632,103 просмотров • 11 месяцев назад

Realtime Maps on Smart Glasses Using our Wearables SDK and OpenStreetMap to display a simple map overlay, allowing us to see what places are around us (and if they’re open or not) Works with compatible smart glasses (in this case the Brilliant Labs Frame running custom firmware)
0:26

Realtime Maps on Smart Glasses Using our Wearables SDK and OpenStreetMap to display a simple map overlay, allowing us to see what places are around us (and if they’re open or not) Works with compatible smart glasses (in this case the Brilliant Labs Frame running custom firmware)

Brilliant Wear

53,763 просмотров • 9 месяцев назад

Launching full support for Even Realities G2 smart glasses in MentraOS. With Mentra, you can run multiple smart glasses apps at once. You: in a meeting in Tokyo on 82nd floor. You're running translation on your smart glasses and understanding every word. Your Notetaker is running in the background capturing ideas as they're spoken. Your proactive AI agent is listening in, hears someone ask a question, and automatically overlays the answer on your vision. That's what's Mentra unlocks. MentraOS is the open source OS for smart glasses. We give users an app store and allow developers to write one app that runs on any pair of smart glasses. It's 100% open source, private, and free. How to use: Download the Mentra app, connect your G2, and get instant access to captions, AI notetaker, Merge proactive AI, translation, and other apps. You can switch back to the Even app at anytime. If you want to unlock your Even G2, then downalod Mentra on the Google or Apple App Store.
2:27

Launching full support for Even Realities G2 smart glasses in MentraOS. With Mentra, you can run multiple smart glasses apps at once. You: in a meeting in Tokyo on 82nd floor. You're running translation on your smart glasses and understanding every word. Your Notetaker is running in the background capturing ideas as they're spoken. Your proactive AI agent is listening in, hears someone ask a question, and automatically overlays the answer on your vision. That's what's Mentra unlocks. MentraOS is the open source OS for smart glasses. We give users an app store and allow developers to write one app that runs on any pair of smart glasses. It's 100% open source, private, and free. How to use: Download the Mentra app, connect your G2, and get instant access to captions, AI notetaker, Merge proactive AI, translation, and other apps. You can switch back to the Even app at anytime. If you want to unlock your Even G2, then downalod Mentra on the Google or Apple App Store.

cayden 凯登

38,419 просмотров • 1 месяц назад

We put 1000s of hours into building open-source camera glasses And now we're giving away everything we learned for free. Checkout this in-depth teardown of the Mentra Live smart glasses. As an OS company, our goal is to spread our OS. That goal encourages us to do crazy things, like build the world's best AI glasses for business and then show you how we made them... all in the name of spreading the OS. It also convinced us to make it 100% open source, so adoption is faster and easier. We're at risk of our competitors easily copypasting our code now... all in the name of spreading our OS. Now we've built the glasses for you, and we've taken the risk, and we've released an open SDK. Now your AI apps and agents can enter the real world on smart glasses. So now, what will you build?
13:19

We put 1000s of hours into building open-source camera glasses And now we're giving away everything we learned for free. Checkout this in-depth teardown of the Mentra Live smart glasses. As an OS company, our goal is to spread our OS. That goal encourages us to do crazy things, like build the world's best AI glasses for business and then show you how we made them... all in the name of spreading the OS. It also convinced us to make it 100% open source, so adoption is faster and easier. We're at risk of our competitors easily copypasting our code now... all in the name of spreading our OS. Now we've built the glasses for you, and we've taken the risk, and we've released an open SDK. Now your AI apps and agents can enter the real world on smart glasses. So now, what will you build?

cayden 凯登

20,387 просмотров • 1 месяц назад

I’m shocked these smart glasses I just tried aren’t more popular. Has a green text overlay which shows notifications, teleprompts, navigation, note taking and even talk to AI. No cameras. As light as normal glasses. 1.5 days of battery life. They’re the Even G1 Glasses. $600.
0:47

I’m shocked these smart glasses I just tried aren’t more popular. Has a green text overlay which shows notifications, teleprompts, navigation, note taking and even talk to AI. No cameras. As light as normal glasses. 1.5 days of battery life. They’re the Even G1 Glasses. $600.

Deedy

111,681 просмотров • 1 год назад

This open-source Github repo gives your ClawdBot eyes! 🦞 Real-time AI assistant for Meta Ray-Ban smart glasses. Voice + vision + agentic actions via Gemini Live and OpenClaw Put on your glasses, tap the AI button, and talk: - Gemini sees through your glasses camera and describes the scene - delegates to OpenClaw, which adds it via your connected apps - Can route through OpenClaw to WhatsApp/Telegram/iMessage - web search via OpenClaw, results spoken back The glasses camera streams at ~1fps to Gemini for visual context, while audio flows bidirectionally in real-time.
0:26

This open-source Github repo gives your ClawdBot eyes! 🦞 Real-time AI assistant for Meta Ray-Ban smart glasses. Voice + vision + agentic actions via Gemini Live and OpenClaw Put on your glasses, tap the AI button, and talk: - Gemini sees through your glasses camera and describes the scene - delegates to OpenClaw, which adds it via your connected apps - Can route through OpenClaw to WhatsApp/Telegram/iMessage - web search via OpenClaw, results spoken back The glasses camera streams at ~1fps to Gemini for visual context, while audio flows bidirectionally in real-time.

Rohan Paul

119,605 просмотров • 3 месяцев назад

Life is a game…pick your world skin 🎮✨ We’re only scratching the surface of video-to-video. Imagine seeing this in real-time through smart glasses!
0:33

Life is a game…pick your world skin 🎮✨ We’re only scratching the surface of video-to-video. Imagine seeing this in real-time through smart glasses!

Justine Moore

55,694 просмотров • 1 год назад

Kendyl Pool was born with malformations in her inner ears leaving her deaf. Her mother first discovered Hearview Smart Glasses from Chrissy Marshall's TikTok video (video attached in quoted post), and gave her a pair for her 10th birthday:
0:58

Kendyl Pool was born with malformations in her inner ears leaving her deaf. Her mother first discovered Hearview Smart Glasses from Chrissy Marshall's TikTok video (video attached in quoted post), and gave her a pair for her 10th birthday:

Christopher Grayson

17,240 просмотров • 1 год назад

We built the open source alternative to the Meta Raybans: Last year, I dropped out of MIT This year, we raised $8 million to build open source smart glasses Now, we’re launching our first smart glasses for devs: open source, with a software development kit, and an app store. A canvas for makers to easily build the upgrades we dreamed of as kids. Tools at your fingertips to expand our minds and unlock new powers And we're just getting started. Peep the website and join the movement with MentraLabs
0:35

We built the open source alternative to the Meta Raybans: Last year, I dropped out of MIT This year, we raised $8 million to build open source smart glasses Now, we’re launching our first smart glasses for devs: open source, with a software development kit, and an app store. A canvas for makers to easily build the upgrades we dreamed of as kids. Tools at your fingertips to expand our minds and unlock new powers And we're just getting started. Peep the website and join the movement with MentraLabs

cayden 凯登

108,321 просмотров • 10 месяцев назад