Skip navigation
DiffusionGemma-as-Jev (aka djev) running near-real-time vision detection from a mobile phone using…
0:00 / 0:58

DiffusionGemma-as-Jev (aka djev) running near-real-time vision detection from a mobile phone using…

Matt Mastracci

@mmastrac12K followers

Visit on X
977 likesDownloadOriginal post

105,036 views

DiffusionGemma-as-Jev (aka djev) running near-real-time vision detection from a mobile phone using its native vision tower. Please don't fall down the stairs!

15 Comments

Comments from the original post on X (Twitter)

  • Matt Mastracci's profile picture

    @mmastrac

    You can even try it yourself! This is the shipping docker container with a packaged server and examples:

    29 likes

  • Matt Mastracci's profile picture

    @mmastrac

    Each image is captured from the webcam, tokenized by the model, and the structured query gets answered by DiffusionGemma in about ~300-400ms. This is the stock DiffusionGemma model, no fine tuning, running practically stock vLLM with only a few patches.

    15 likes

  • Mike Petch's profile picture

    @mpetch

    It didn't do very well identifying the owner of the house (the furry one). Pet????? I'm sure th cat has something to say about that ;-)

    2 likes

  • Inch's profile picture

    @ininchch

    it could be useful for blind

    2 likes

  • Richelle🧬's profile picture

    @Richelle_Ji

    We just shipped open weights jev:

    2 likes

  • Matt Mastracci's profile picture

    @mmastrac

    We should chat - would be great to share a single server implementation and make sure we align on multimodal Jev (mmJev?)! Feel free to reach out (DM or email)

  • Richelle🧬's profile picture

    @Richelle_Ji

    dm me!

  • JB's profile picture

    @jbermudez5

    Was setting up a pipeline with YOLO26 + Jev but going to run this and compare.

    1 like

  • Chalkers's profile picture

    @chalkers

    I’m going to put it in to my robot dog

    1 like

  • johnny, INFINITE FUN ENTHUSIAST's profile picture

    @generativist

    keep going, Matt!

    1 like

  • unsever's profile picture

    @unseversever

    Please give it perception of depth and try this again I'll wait

  • Latent's profile picture

    @RepresenterTh

    I have been following your posts since yesterday. Amazing

  • AD3 Digital Marketing's profile picture

    @Ad3DigitalMKTIA

    Very cool but to big for my 12gb vram Ç_Ç

  • Simplicity's profile picture

    @Simplicity

    Do you want T-800s? Because that's how you get T-800s.

  • ego's profile picture

    @user_saila

    I really need to know how much vram jev uses