正在加载视频...

视频加载失败

Mistral OCR 4 just dropped with bounding boxes (their most-requested feature) so I plugged it into my form-filling test as the helper model. Qwen3.6 reasons, Mistral localizes. Result? Boxes detected, fields filled, mostly landing in the lines. Not pixel-perfect. But close? Yeah, I'll call it close.

41,473 次观看 • 4 个月前 •via X (Twitter)

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

I designed a new test specifically for multimodal models: fill out a paper form. And it's much harder than it sounds. This isn't typing into an electronic field that captures your text. The form is just an image. The model has to place each form element: text, checkmarks — at the correct pixel position on the canvas itself. Results: 🟢 Kimi K2.6 → done in 3:45, 16.7k output tokens 🟡 Step 3.7 Flash → half the fields, 57k output tokens 🔴 Gemini 3.5 Flash → 489k output tokens, never finished. I had to kill it. Gemini burned ~29x more output tokens than Kimi on the exact same task, and Kimi's was the only form that actually looked filled out. The test, a mocked application form, contains some challenging parts, such as one-character-per-box fields. I provided every model the same set of tools: > get canvas size > drop probe markers to find coordinates > add text > add checkmarks > move elements > take a screenshot anytime to check their own work > ... etc So it's vision + spatial reasoning + tool use + long context, all at once. Small models (Qwen, Gemma) can't really complete this test, so I skipped them. What happened: > Kimi nailed name, DOB, ID, gender, marital status, nationality, email, phone, address, postal code — placement slightly loose, but content correct. 15 turns. Clean. > Step got maybe half right — fields dropped, "United States" landed in the email line, data floating outside boxes. Burned 1.24M input tokens doing it (81 turns of re-reading the canvas). > Gemini almost got there visually... then spiraled. By turn 40 it was issuing a delete_elements call wiping element IDs 365–425, basically erasing its own work. 31 minutes, 489k output tokens, still streaming. Terminated. The takeaway isn't "Gemini bad." This test is indeed difficult. But token efficiency is capability now. A model that needs 30x the tokens and still can't converge is going to be 30x the cost in production. Kimi K2.6 just quietly did the thing.

stevibe

25,494 次观看 • 5 个月前

New body-physics test for the best AI video tools: The newly released Grok Imagine 1.5, the king Seedance 2.0, Google’s “revolutionary super-duper” Gemini Omni Flash, and the old-timer Kling 3.0 Pro. This time I tested how each model handles realistic running motion, body movement, fabric physics, and natural secondary motion. And the result was much less obvious than I expected. Believe it or not, I can’t call Seedance the clear winner this time. Each model got several attempts. - Grok Imagine 1.5: The new version is finally available on the official Grok website, so I could properly test it. Honestly, I didn’t notice a massive improvement over the previous version. Still, the result was acceptable. It produced the most cartoonish image, and the woman runs as if she’s wearing heels, but the body physics were decent enough. It also understood the instructions quickly and followed them correctly. - Kling 3.0 Pro: The old man decided to test my patience. It repeatedly blocked a simple running scene as adult content, then misunderstood the instructions several times. The successful result has the most realistic lighting and frame rate, but the actual body physics look strange. It almost feels like loose foam padding is bouncing inside the leggings. There are also several visible artifacts and unnatural movements. - Gemini Omni Flash: As usual, it gave me that strange slow-motion, low-FPS look that Google models seem to love. But it didn’t censor anything, understood the instructions immediately, and produced a beautiful, realistic result. Surprisingly, this is the output I liked the most in this test. - Seedance 2.0: Seedance also blocked a couple of generations, just like Kling, but eventually produced a strong result. It delivered the most beautiful and visually appealing footage, but I honestly expected better physics. The video looks great, yet I can’t confidently call it the most physically accurate result. - My ranking: 1. Gemini Omni Flash — not perfect, but the best overall result for me 2. Seedance 2.0 — visually stunning, but I preferred Omni’s physics 3. Grok Imagine 1.5 — cartoonish look and strange running, but still acceptable 4. Kling 3.0 Pro — the longest wait, the strangest physics, and the most inconsistent result Do you agree with my ranking? #AIVideo

Alpha Mom

159,187 次观看 • 4 个月前