Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Used gemini 2.5 pro to build a shot counter for myself + write an after effects script to create this AR style HUD overlay. Footage captured w/ my meta rayban glasses. Insane how much better 2.5 pro is at media understanding vs 1.5 pro (when I last tried this)....

121,807 görüntüleme • 1 yıl önce •via X (Twitter)

11 Yorum

Matt Wolfe profil fotoğrafı
Matt Wolfe1 yıl önce

Was this to show off the tech? Or to subtly tell people not to F with you?

Page to Pixel Publishing profil fotoğrafı
Page to Pixel Publishing2 yıl önce

The Art of Flight is a homage to 80s/90s arcade action shmups with a fresh twist on the genre. Pilot multiple ships at the same time to take on oncoming waves of enemies in this fast paced space shooter. Wishlist on Steam today!

Vikas Reddy profil fotoğrafı
Vikas Reddy1 yıl önce

This is the most Texas coded spatial computing / AI demo I've ever seen lol

bone profil fotoğrafı
bone1 yıl önce

This is dope. Gemini is so good, makes everything before it seem jank.

Bilawal Sidhu profil fotoğrafı
Bilawal Sidhu1 yıl önce

esp for multimodal reasoning - unbeatable rn

Ajaypal Cheema profil fotoğrafı
Ajaypal Cheema1 yıl önce

slick

Prashant profil fotoğrafı
Prashant1 yıl önce

This is next level. You used every tech in this

Daniel Tomberg profil fotoğrafı
Daniel Tomberg1 yıl önce

that’s impressive, using gemini 2.5 pro to build a shot counter with an ar hud overlay shows real creativityyy

Andrew profil fotoğrafı
Andrew1 yıl önce

“Target: Sarah Connor”

Dreaming Tulpa 🥓👑 profil fotoğrafı
Dreaming Tulpa 🥓👑1 yıl önce

dammmmn

Habibi 🫡 profil fotoğrafı
Habibi 🫡1 yıl önce

Wow this is incredible

Benzer Videolar

Learning from Human Demonstrations: Show the Robot How to Act! The pipeline is very similar to older experiments using Gemini & pi0 with LeRobot. Pi-zero runs locally, while Gemini Flash generates the affordances and the high-level task. (More details are in the thread.) The new component is learning from demonstrations via Gemini 2.5 Pro. I capture a video while demoing & take one of the last frames. Gemini 2.5 Pro then extracts the instructions & passes them to Gemini Flash to process the scene. The fun part is that there's no fancy insight that came from me; other than the days spent figuring out the right prompts. It's the bitter lesson hitting you in the face -> Enhanced Gemini capabilities make this possible. For example, Gemini Flash cannot do Russian doll stacking, but Gemini 2.5 Pro can do it consistently. The current limitation is low-level manipulation: - As you can see, I'm aligning the objects so they are easy to grasp using the same technique from the training data. I couldn't get Gemini Flash to consistently output an accurate grasping angle, and Gemini 1.5 Pro was too expensive and slow for real-time deployment. - Getting a symmetrical gripper should also help a lot. Adding rubber to the tips would probably also help prevent objects from slipping. Collecting & curating the data was the most time consuming & labor intensive part. Next, to improve low-level manipulation and make the system more real-time, I'm shifting to focus more on sims & synthetic data. This aligns better with my core competence. I'm open to tips and suggestions.

Shreyas Gite

22,555 görüntüleme • 1 yıl önce