Loading video...

Video Failed to Load

Go Home

DiffusionGemma-as-Jev (aka djev) running near-real-time vision detection from a mobile phone using its native vision tower. Please don't fall down the stairs!

104,402 views • 17 days ago •via X (Twitter)

15 Comments

Matt Mastracci's profile picture
Matt Mastracci17 days ago

You can even try it yourself! This is the shipping docker container with a packaged server and examples:

Matt Mastracci's profile picture
Matt Mastracci17 days ago

Each image is captured from the webcam, tokenized by the model, and the structured query gets answered by DiffusionGemma in about ~300-400ms. This is the stock DiffusionGemma model, no fine tuning, running practically stock vLLM with only a few patches.

Mike Petch's profile picture
Mike Petch17 days ago

It didn't do very well identifying the owner of the house (the furry one). Pet????? I'm sure th cat has something to say about that ;-)

Inch's profile picture
Inch17 days ago

it could be useful for blind

Richelle🧬's profile picture
Richelle🧬17 days ago

We just shipped open weights jev:

Matt Mastracci's profile picture
Matt Mastracci17 days ago

We should chat - would be great to share a single server implementation and make sure we align on multimodal Jev (mmJev?)! Feel free to reach out (DM or email)

Richelle🧬's profile picture
Richelle🧬17 days ago

dm me!

JB's profile picture
JB17 days ago

Was setting up a pipeline with YOLO26 + Jev but going to run this and compare.

Chalkers's profile picture
Chalkers17 days ago

I’m going to put it in to my robot dog

johnny, INFINITE FUN ENTHUSIAST's profile picture
johnny, INFINITE FUN ENTHUSIAST17 days ago

keep going, Matt!

unsever's profile picture
unsever17 days ago

Please give it perception of depth and try this again I'll wait

Latent's profile picture
Latent17 days ago

I have been following your posts since yesterday. Amazing

AD3 Digital Marketing's profile picture
AD3 Digital Marketing17 days ago

Very cool but to big for my 12gb vram Ç_Ç

Simplicity's profile picture
Simplicity17 days ago

Do you want T-800s? Because that's how you get T-800s.

ego's profile picture
ego17 days ago

I really need to know how much vram jev uses

Related Videos