all three at a time, down to less than 1 sec latency
@yoheinakajima126K followers
19,486 views
9 Comments
Comments from the original post on X (Twitter)

@yoheinakajima
got object detection down to below 0.35 sec latency locally
9 likes

@yoheinakajima
live true/false on object detection is at 0.4 seconds latency locally on an M5 macbook pro
2 likes

@yoheinakajima
just object detection is much faster with .5 sec latency much snappier
4 likes

@yoheinakajima
same thing, this time running locally. inference is slower, but no network latency (above was via replicate) inference: 1.1 sec seems inference time goes up with number of possible answers, and here's that's about 14 across three questions
4 likes

@yoheinakajima
simultaneous live detection of: 😡 emotion 📕 object 🖐️ finger count single call for 3 detections, 0.2 sec inference each
95 likes

@yoheinakajima
all three at a time sub 0.5 second latency! - expression - object detection - finger count switched to qwen 8B via glance i think direct on MLX
9 likes

@MSharafH
Which model is this?
1 like

@yoheinakajima
qwen3-vl-4b via glance (no generation)
4 likes

@ethereaglehq
sub 1s for expression + objects + fingers. did you pack all three into one call, or are they still separate and the model just got faster?