正在加载视频...

视频加载失败

I made a sprite animator using Google's Gemini 2.0 flash experimental. Here's how it works: 1. Gemini 2.0 exp generates the images 2. They are uploaded each in an S3 bucket/folder 3. Then you can use WebGPU /w canvas or just img Let's watch some examples and generate some:

349,449 次观看 • 1 年前 •via X (Twitter)

12 条评论

wavefnx 的头像
wavefnx1 年前

This is actually one out of many iterations, in the other ones you could crop/decide and add the frame, auto-generated dungeons and so on. e.g. I could also imagine another vision model segmenting the characters out of each frame or sprite-sheet

wavefnx 的头像
wavefnx1 年前

gg @GoogleDeepMind

Rainmaker 的头像
Rainmaker2 年前

Can Machine Learning beat the market? Check out this post on my free Substack where I share code and commentary for an XGBoost model and a Random Forest model that both deliver powerful performances.

wavefnx 的头像
wavefnx1 年前

If you have any fun features in mind, drop them below, the more crazy and "unachievable" the better

atharva 的头像
atharva1 年前

so clean

wavefnx 的头像
wavefnx1 年前

thanks, the goblin dancing and the flower ones are crazy

Ash ▵ 的头像
Ash ▵1 年前

I wrote a script to do the same thing . UI is much better , Really cool

wavefnx 的头像
wavefnx1 年前

amazing; there's much to do to it, caching CDN etc and the UI can be even better too but very easy to develop I bet it can have great results with realistic images also, mini-veo 2.0

dan ⚡️ 的头像
dan ⚡️1 年前

so cool holy shit

wavefnx 的头像
wavefnx1 年前

early access?

Ryan Lucchese 的头像
Ryan Lucchese1 年前

whoa this is so cool

wavefnx 的头像
wavefnx1 年前

thanks a lot, can early-access you too, I think the sprite/8bit stuff it's fun but imagine: 1. being able to control the sprites e.g. assign keys to each one 2. realistic images (easy) 3. many more video is just images after all and with the edit feature you could do a lot

相关视频

GEMINI 3 LAUNCH IS HERE I got a SNEAK PEEK at Gemini 3 with Logan Kilpatrick (Google Deepmind), and it might be the most POWERFUL vibe-coding tool on the planet. A little breakdown: 1. Anyone can build 3D and casual games now You can vibecode full, playable 3D video games generated in minutes. Actual games with physics, characters, controls, and loops you can remix instantly. Pure insanity. I can see founders and brands spinning up games on the fly to ride trends and drive growth. 2. Intelligent apps are becoming the default We built apps where reasoning, memory, and multi-step planning were baked in from the start. Once you’re building apps with ACTUAL intelligence baked in, there’s a whole wave of new opportunities that weren’t possible before. 3. Gemini acts like a creative partner You describe the idea, Gemini fills in the gaps, challenges decisions, proposes alternatives, and iterates in real time. 4. Vibe coding hits a new level Gemini 3 can generate assets, code, game logic, UI, and narrative in one flow. Tools like Claude and Cursor feel fast. This feels like the next layer, the one where a single builder can compete with full teams. Logan Kilpatrick and I pushed Google Gemini 3 hard, and the outputs were solid. A few times we had to give it a few extra prompts but it took feedback really well. I think 1 year ago, a lot of people discounted Google in the AI arms race. Can you discount them anymore? Doubt it. After this, it feels like they at best leading, at worst leading. What do you think of Google's AI efforts/Gemini 3 My biggest takeaway was how it just felt like Gemini 3 had a little more vibe coding horsepower than anything I’ve used.

GREG ISENBERG

73,705 次观看 • 8 个月前

Learning from Human Demonstrations: Show the Robot How to Act! The pipeline is very similar to older experiments using Gemini & pi0 with LeRobot. Pi-zero runs locally, while Gemini Flash generates the affordances and the high-level task. (More details are in the thread.) The new component is learning from demonstrations via Gemini 2.5 Pro. I capture a video while demoing & take one of the last frames. Gemini 2.5 Pro then extracts the instructions & passes them to Gemini Flash to process the scene. The fun part is that there's no fancy insight that came from me; other than the days spent figuring out the right prompts. It's the bitter lesson hitting you in the face -> Enhanced Gemini capabilities make this possible. For example, Gemini Flash cannot do Russian doll stacking, but Gemini 2.5 Pro can do it consistently. The current limitation is low-level manipulation: - As you can see, I'm aligning the objects so they are easy to grasp using the same technique from the training data. I couldn't get Gemini Flash to consistently output an accurate grasping angle, and Gemini 1.5 Pro was too expensive and slow for real-time deployment. - Getting a symmetrical gripper should also help a lot. Adding rubber to the tips would probably also help prevent objects from slipping. Collecting & curating the data was the most time consuming & labor intensive part. Next, to improve low-level manipulation and make the system more real-time, I'm shifting to focus more on sims & synthetic data. This aligns better with my core competence. I'm open to tips and suggestions.

Shreyas Gite

22,555 次观看 • 1 年前