Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Introducing MiniMax H3 Our next-gen open-weight multimodal video model, built for general intelligence, not just single-task generation. Why it matters: 1/ Understands text, image, video & audio together, motion, sound, emotion, cinematography as one language 2/ Native multimodal understanding & generation 3/ Precision editing & control 4/ Commercial-grade output:...

71,792 Aufrufe • vor 3 Tagen •via X (Twitter)

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

🇨🇳 Another great Chinese Model, OmniHuman-1.5 from ByteDance Turns 1 image plus a voice track into expressive avatar video by pairing a System 1 and System 2 inspired planner with a Diffusion Transformer, Produces coherent motion for over 1 minute with moving camera and multi character scenes. Most avatar models move to the beat of the audio but miss meaning, so gestures feel generic and emotions feel shallow. The fix here is a Multimodal LLM planner that listens to the speech and drafts a structured plan describing intent, emotions, beats, and high level actions, which gives the motion engine clear semantic targets instead of only rhythm. The motion engine is a Multimodal Diffusion Transformer that fuses the plan with audio, the single reference image, and optional text prompts, then synthesizes continuous body, face, and head motion that matches both words and tone. A key trick is a Pseudo Last Frame, a synthetic target that summarizes the next expected state, which stabilizes fusion across modalities and keeps motion consistent over long spans. From just 1 image and speech, the system outputs speaking avatars with synchronized lips, context aware gestures, and continuous camera movement, and it also supports multi character interactions without manual choreography. Reported results show strong lip sync accuracy, high video quality, natural motion, and close match to text prompts, and the same setup works on nonhuman characters too.

Rohan Paul

63,859 Aufrufe • vor 11 Monaten

I’ve used all the recent GenAI video models extensively & here’s my 2¢: 🎬 Runway Gen3 Alpha - best image quality & motion for text-to-video & embedded words. Great at prompt travel changes over the course of 10 sec. And I’m super bullish on how gen3 will evolve, hopefully adopting the features listed below. Kling - best quality for image-to-video with prompt control, like eating food. Great clip extension that accounts for character (ie walking stride) & camera movement (speed & angle), rather than just using final frame. But it’s limited availability & Chinese native language is limiting. Used for Spider-Man video below (via Midjourney). LumaLabs - best for keyframe start & end control (it can not be overstated how important this is. other services should add it ASAP!) and their high dynamic action movements are really fun. Luma was used in my viral Multiverse of Memes video. PikaLabs - they haven’t gotten as much attention as others lately. But they did update their video model a few weeks ago and it looks great. Also, they are notable for their unique & AWESOME features, like video in-painting & out-painting. My perfect AI video platform would have the following features: 1) Gen3’s quality, prompt control & text embedding. 2) KLing’s image-to-video quality, prompt control & clip extension quality. 3) Luma’s multi-keyframe control & dynamic movement ability. 4) Pika’s inpainting & outpainting ability. And a video-to-video (aka next-gen Runway gen1) could be a game changer, too. It’s an exciting time to be alive 🫶 Who will get there first? 🔉🔉

Blaine Brown

26,535 Aufrufe • vor 2 Jahren

Before the week ends, let's acknowledge one of the most INSANE week ever for open AI, with 25+ notable open-weight drops across every modality: 🧠 LLMs → NVIDIA Nemotron 3 Ultra: 550B hybrid Mamba-MoE, only 55B active, 1M context, MMLU 89.1. NVFP4 variant claims ~5x throughput on Blackwell. First openly-weighted 550B hybrid Mamba-Transformer, closing the gap with frontier closed models. → Google Gemma 4 12B: fully open dense any-to-any (text/image/audio/video), 256k context, encoder-free, 140+ languages, AIME 2026 at 77.5. Shipped with a 23-checkpoint QAT wave (mobile ONNX + MLX). Most deployable model of the week. → StepFun Step-3.7-Flash: 198B sparse MoE VLM, ~11B active, SWE-Bench PRO 56.3. Apache 2.0. → Liquid AI LFM2.5-8B-A1B: edge MoE, just 1.5B active, 128k ctx, MATH500 88.8, MLX-ready. Best on-device option this week. → JetBrains Mellum2-12B-A2.5B-Thinking: their first open MoE, near-Qwen3-14B coding at 2.5B active. Apache 2.0. 🎨 Image gen (the surprise of the week) → Ideogram 4: their FIRST-EVER open weights. 9.3B flow-matching DiT trained from scratch. #2 overall behind GPT Image 2, top open-weight model on Design Arena + LMArena. Strongest open checkpoint for text-rich images, full stop. It has taste. Still can't believe this is open weights. 🔊 Audio & Speech (a breakout week for open TTS, 4 labs shipped) → Boson Higgs Audio v3 4B: 102 languages, 21 emotions, singing/whispering/shouting, sub-second TTFA. → RedNote dots.tts: the only fully continuous (no codec) open TTS pipeline, Apache 2.0. → Google Magenta RealTime 2: real-time music gen, <200ms latency, text+audio+MIDI. multimodalart ported it to PyTorch within hours with live ZeroGPU demos. → NVIDIA Nemotron-3.5 ASR: 600M streaming, 17x more concurrent streams vs Parakeet RNNT 1.1B. 👁️ Vision & VLMs → PaddleOCR-VL-1.6: SOTA document parsing at 1B params, Apache 2.0. → Baidu NAVA: 6.3B joint audio-video gen, best-in-class A/V sync, Apache 2.0. 🎬 Video, 3D & World Models → NVIDIA Cosmos3-Super: 64B omnimodal world model coupling action trajectories with video+audio gen, for Physical AI. → JD JoyAI-Echo: up to 5-min multi-shot text-to-video on LTX-2.3. → ByteDance Bernini-R + VAST TripoSplat (single-image-to-3D Gaussian splats, MIT).

Victor M

540,420 Aufrufe • vor 2 Monaten

Fable 5 comes back!It can now build playable game prototypes. I think it is actually a signal for where AI coding is going. Making a game is not just “write some code.” Even a small browser game needs: game loop;character movement;collision logic;scoring system;UI states;physics tuning;visual feedback;bug fixing;playtesting This is why game prototyping is a great test for AI models. A model cannot fake it with a pretty answer. Either the game runs, or it does not. What impressed me about Fable 5 is that it is useful for the messy middle: turning an idea into mechanics, turning mechanics into code, debugging broken interactions, and iterating until the prototype feels playable. But here is the practical part: I would not use the strongest model for every step. For game building, I would split the workflow: 1. Fable 5 for game design + architecture 2. a fast coding model for routine implementation 3. a vision-capable model for screenshot/UI feedback 4. a cheaper model for docs, test cases, and small fixes 5. fallback when latency, cost, or output quality becomes a problem That is the real AI coding stack. Not “one magic model does everything.” More like: the right model, for the right task, at the right cost, with fallback when things break. This is why I’ve been looking at ZenMux ZenMux. ZenMux gives developers one gateway to access multiple leading AI models, with OpenAI / Anthropic / Google Vertex compatible APIs, cost tracking, quality benchmarks, auto-routing, and compensation when output quality, latency, or throughput falls short. If AI can now make games, the next question is not just “which model is strongest?” It is:how do we manage the whole model workflow Fable 5 shows the creative ceiling. ZenMux is closer to the infrastructure layer you need when AI coding becomes a real production habit.

Rachel🥥

61,143 Aufrufe • vor 1 Monat

I just ran Gemma 4 31B on @CerebrasSystems at 1,800+ tokens/sec and it's multimodal. For context: that's 35x faster than a typical GPU endpoint, and the first token (reasoning included) lands in 1.5 seconds. This isn't a benchmark slide, I recorded the inference live. Prompt I used: "Create a simulation of an iPhone. Include at least one working dummy note taking app, a functional notification pulldown, high quality graphics, single HTML file, any libs via CDN." - Generation time: 3 seconds. - Notes app worked. - Notification panel worked. - Rendered first try. This is what wafer-scale inference unlocks, not just "faster," but a different category of product. When generation is this fast, you stop waiting and start iterating in real time. Why this matters: Gemma 4 31B is Google DeepMind's flagship open weight model, Apache 2.0 licensed, dense (not MoE), and built for efficiency over raw parameter count. It scores close to Claude Haiku 4.5 on the Artificial Analysis Intelligence Index (30 vs 29) but runs ~18x faster on Cerebras. It's also the first multimodal model on Cerebras's platform, meaning you can now feed it screenshots, documents, charts, and UI states at wafer scale speed. # Applications I'm most excited about: - Screenshot → Insight: Drop in a dashboard or document screenshot, get structured findings back instantly. no waiting, no batching. - Live UI generation: Full interactive interfaces (like my iPhone sim) generated and rendered in under 2 seconds. - Screenshot -> Patch: Feed it a broken UI + console error, get a minimal code fix and verification steps back. - Computer use & agentic loops: See -> reason -> act - verify, fast enough to keep a human in the loop instead of waiting on the model. - Long context summarization: Full research reports condensed into decision ready summaries you can read and requery in one sitting. The bigger unlock isn't the speed number itself, it's that agentic and multimodal loops (see -> reason -> output -> tool call -> verify -> retry) finally run in real time instead of feeling sluggish. As Logan Kilpatrick (Logan Kilpatrick) put it: "If every model was doing 2,000 tokens per second, you wouldn't build the same product and just have it be faster, you'd build different products." Gemma 4 31B is live now on Cerebras Inference Cloud in public preview. If you're building multimodal, agentic, or real time apps, this is worth testing today. What would you build with such insane inference throughput?

Alok

12,962 Aufrufe • vor 1 Monat

📖THE STEP MOST CREATORS SKIP IS WHY THEIR AI ANIMATION LOOKS INCONSISTENT Consistency across clips doesn't come from prompting — it comes from the reference image. The pipeline, step by step: ▪ Start with ChatGPT Image 2 — generate a full character design sheet first, not just a single frame. Multiple angles, expressions, and outfit variations in one image keeps the character consistent across every scene ▪ Build a storyboard inside ChatGPT Image 2 as well — define each shot, camera angle, action, and mood before touching Seedance at all. This is the step most people skip and it's the reason clips look disconnected ▪ Define a color palette and lighting mood early — golden afternoon light, soft warm tones, dramatic shadows. Lock those values and repeat them across every prompt ▪ Take each storyboard frame into Seedance 2.0 as the reference image — one frame becomes one clip ▪ Write the Seedance prompt around the character action, not the scene description. The scene is already in the image. The prompt handles motion, camera behavior, and timing ▪ Keep clip duration between 4-6 seconds per shot — shorter clips give more control over pacing and reduce motion drift on character faces ▪ Match camera movement type across consecutive clips — if one shot dollies in, the next should hold or pull back, not dolly again The consistency across these frames comes from the character design sheet, not from luck. Seedance reads the reference image and the prompt together — if the reference is detailed enough, the output stays on-model. This video was created by ALOKXMEHTA 📥 tomorrow: the exact ChatGPT Image 2 prompt structure used to generate a multi-angle character design sheet like this one 🔖One article covers the entire workflow — it is pinned below, do not scroll past it.

Zentrix⌚️

12,846 Aufrufe • vor 1 Monat

Big win for open-source LLMs! DeepSeek V4 Pro holds the top open-weights score on SWE-bench Verified, in the GPT-5.5 range. GLM 5.2 leads the open-weight intelligence index and sits near the closed frontier on long-horizon coding. But this leaderboard number is a weak proxy for real performance. It comes from one task set, run through one harness, served at one precision. The same weights can even score differently across providers, since many hosts quantize activations to fp8 and drift the model off its reference weights. Real performance is determined based on whether a model can read a repo, make coordinated edits across files, run the tests, and recover when one breaks. By that measure, the top open models hold up, but only inside the right harness. The teams that actually put DeepSeek V4 into production pipelines as a frontier substitute got there through the harness they built around the model, not by picking a stronger model. If you want to see this in practice, Cline (64k+ stars) has actually built that harness around open models, tuned so they run at production quality. And it's tuned so that these LLMs can run at production quality, with plan and act modes, checkpoints, and terminal feedback. ClinePass is the new access layer on top of it. It runs a curated set of those models inside Cline, narrowed to the ones tested for coding-agent use, with 2 to 5x the standard rate limits and no separate provider accounts, keys, or billing to track. The video below shows the setup, and I worked with the team to put this together. It runs alongside custom keys and local models as well, not in place of them.

Avi Chawla

44,124 Aufrufe • vor 1 Monat

Google Gemini Omni is f*cking insane for UGC ads 🤯 Google just dropped their new video model and I spent the past 24 hours putting it through its paces. Multi-shot UGC ads -> Consistent creator across every scene ->Agent mode that runs the whole session. Perfect for DTC brands and agencies who need UGC creative at volume without hiring creators or paying per-video platform fees. If you're briefing creators every week, waiting days for footage, paying $150–$300 per UGC video, and still getting ads that miss the brand vibe... Gemini Omni eliminates the entire loop: → Generate a realistic AI creator from a single image prompt → Upload your creator + product image, reference both by filename in every prompt → Agent mode writes and runs your full production session → Creator stays consistent across every scene change and outfit → Product label accurate, correct color, readable text → 5-shot direct response ad in one briefing No creator briefs. No waiting for footage. No per-video platform fees. What you get: → Multi-shot UGC ads with a locked creator across every scene → AI creator image prompt tuned for realism — not plastic AI faces → Asset tagging system that keeps your product consistent shot to shot → A reusable workflow: new product, new angle, same pipeline I also built a Claude Cowork skill that writes your entire production package before you generate a single frame: Creator prompt, shot list, dialogue, asset-tagged prompts, and voiceover script. I put together a full playbook with the Claude skill file and the exact workflow to run this yourself. Want access for free? > Like this post > Comment "OMNI" And I'll send it over (must be following so I can DM)

Mike Futia

33,724 Aufrufe • vor 2 Monaten

AI Is Moving Beyond “Generating Videos” — Toward “Generating Worlds” Over the past two years, AI video models have advanced at an astonishing pace. From Runway and Pika to Sora and Veo, AI-generated videos have become increasingly realistic and more consistent with the physical laws of the real world. Many people believe the next objective is simply to generate videos that are longer, sharper, and more lifelike. But if we take a step back, we can see that the real transformation is not happening in video itself. It is happening in world models. What Is a World Model? In 1943, psychologist Kenneth Craik proposed an idea that would influence artificial intelligence research for decades. He argued that the human brain does not merely react to the outside world. Instead, it maintains an internal model of how the world works. Because we have this internal model, we can predict the outcome of an action before we actually take it. Before crossing a road, we estimate whether a car will pass by. Before catching a ball, we predict its trajectory. These abilities come from continuously simulating the world in our minds, rather than relying entirely on trial and error. This idea later became known by a more formal term: World Model. A world model does not describe a single image or a fixed video clip. It is an internal representation capable of continuously simulating the rules and dynamics of the real world. Why Is AI Research Turning Toward World Models? Because predicting “what comes next” is becoming increasingly central to how AI systems work. Language models predict the next token. Image models predict the next step in the denoising process. Video models predict the next frame. A world model, however, attempts to predict something broader: What should the world look like in the next moment? In 2018, David Ha and Jürgen Schmidhuber proposed in their paper World Models that an intelligent agent could first learn a model of the world, and then use that internal model to plan its actions. The Dreamer series later demonstrated that many complex tasks could be learned by training agents inside an “imagined world.” At the same time, the development of video models such as Sora and Veo led researchers to another realization: A model capable of continuously generating video has already learned, at least implicitly, many of the rules governing the real world. As a result, these two research directions have gradually begun to converge. But Video Is Not Yet a World This is where the distinction is often misunderstood. For a world model to support meaningful real-time interaction, it must solve several critical problems. Most video models today are essentially answering one question: What should the next frame look like? A true world model needs to answer much more: What happens if I take one step forward? If I walk behind a building and then return, will the building still be there? If I suddenly change the camera angle, will the entire space remain consistent? If I enter a command such as: “Summon a dragon.” Will the world respond immediately? In other words, a world model must do more than generate content. It must understand space. It must understand time. It must understand causality. And it must understand interaction. Moving from watching to participating is where the real difficulty of world models begins. World Models Are Entering the Interactive Era One of the latest attempts in this direction is Alaya World, recently open-sourced by Alaya World, or Alaya Lab. Instead of generating a fixed video clip, it generates a world that users can explore in real time. Users can begin with text, an image, or a video, enter the generated scene, move freely through it, and introduce new prompts at any moment during generation. The world responds immediately. According to the publicly released information, Alaya World provides: Real-time streaming generation at 720p and 24 FPS Stable continuous exploration for more than one minute The ability to switch prompts and trigger skills or events during generation Model weights and inference code released under the Apache 2.0 License Training code and datasets planned for future release What makes these capabilities important is not simply the technical specifications. It is that the generated “world” can now support continuous interaction. The official demo shows that users can genuinely control, transform, and explore the generated environment. AI Is Evolving From a Tool Into an Environment Over the past few years, most discussions around AI have focused on content generation. Generating text. Generating images. Generating videos. But world models raise a fundamentally different question: Can AI generate an environment that people can inhabit, explore, and continuously evolve? If the answer is yes, the impact will extend far beyond video generation. Game development, robotics training, embodied intelligence, digital twins, virtual production, and many other fields could be transformed by the development of world models. World models are still at a very early stage. Yet from Craik’s proposal of an internal mental model more than eighty years ago to the emergence of today’s interactive world-generation systems, a clear evolutionary path is beginning to take shape. Perhaps what AI is ultimately learning has never been limited to images, videos, or language. Perhaps it is learning the world itself. References GitHub: Technical Report:

雪踏乌云

112,114 Aufrufe • vor 19 Tagen

YOMIRGO #Product #Update YOMIRGO AI-HUB OFFICIALLY LAUNCH ---A Structural Upgrade from a Single-Product Model to an AI Agent Ecosystem Platform In its first phase, 11 AI projects have been integrated, spanning high-value sectors including finance, scientific research, enterprise services, development tools, and experiential AI. ➡️AI-Hub: This is not merely a feature expansion — it represents a critical structural upgrade from a single-product architecture to a multi-vertical AI Agent aggregation and capitalization platform. This milestone marks the initial structural formation of the YOMIRGO ecosystem. 1. Structural Distinction Between Agent Matrix Lab and AI-Hub To avoid positioning ambiguity, we formally clarify the structural division between the two: 🔘 Agent Matrix Lab — Internal AI Production & Incubation Platform Agent Matrix Lab serves as YOMIRGO’s proprietary AI development and internal incubation platform, responsible for: • R&D and testing of in-house AI products • Incubation of native AI Agents • Technical architecture experimentation and runtime validation • Testing of AI Agent models, memory systems, and runtime orchestration It functions as the production workshop and experimental engine of YOMIRGO’s “AI Super Factory.” 🔘 AI-Hub — External AI Agent Aggregation & Ecosystem Layer AI-Hub is a market-facing AI Agent aggregation and showcase platform, responsible for: • Curation and onboarding of high-quality AI projects • Cross-vertical structured ecosystem layout • Rating and classification systems • Traffic distribution and ecosystem collaboration entry points AI-Hub is not an internal incubation unit, but a standardized aggregation framework at the ecosystem level. 2. Integrated Project Structure (First Batch) ✅1. Finance & Prediction 🔹Cointoken AI — AI Agent-powered quantitative trading engine 🔹VVAI — AI-driven real-time Web3 intelligence and decision system 🔹AlphaQuant — Global financial market forecasting engine 🔹NextGoals — AI-powered global sports prediction agent This vertical forms the real-time information, trading, and predictive decision infrastructure for Web3-native users. ✅2. Science 🔹Charmen AI — Large-model-based pet acoustic recognition technology 🔹Encore Health — AI-driven health forecasting and longevity management system for high-net-worth individuals 🔹Reproducibility AI — AI expert system for financial engineering validation and academic reproducibility This sector focuses on research-grade AI capabilities, collaborating with universities and research institutions to drive real-world scientific deployment. ✅3. Business 🔹GlobalSales — B2B automated lead-generation AI Agent 🔹ResearchBot — Business intelligence and deep due diligence AI Agent This vertical targets the enterprise market, delivering scalable and commercially viable AI productivity tools. ✅4. Coding 🔹CodeMatrix — Full-stack development assistant Providing AI-driven development infrastructure and low-barrier building capabilities to global users. ✅5. Interesting 🔹Fortunetell AI — AI-powered symbolic analysis and interactive insight system Exploring the application boundaries of AI within experiential and interactive scenarios. 3. YOMIRGO Four-Layer Structural Framework YOMIRGO has now established a clearly defined four-layer structure: ▶️Layer 1: Agent Matrix Lab — Internal Production & Incubation ▶️Layer 2: AI-Hub — Ecosystem Aggregation & Rating ▶️Layer 3: LaunchPad — Capitalization Pathway ▶️Layer 4: Market — Circulation & Value Realization Together forming a complete industrial pipeline: Incubation → Validation → Aggregation → Rating → Capitalization → Market Circulation This is the structural model behind YOMIRGO’s defined “AI Super Factory.” 4. Strategic Significance The launch of AI-Hub signifies: • YOMIRGO has established standardized AI Agent aggregation capabilities • A cross-vertical ecosystem structure is now in place • Internal incubation and external aggregation mechanisms are structurally separated • The AI Agent industrial flywheel has begun operating YOMIRGO is no longer merely an AI product platform, but a structured AI Agent industrial system integrating production, aggregation, capitalization, and circulation. 5. Next Phase • Continue expanding high-utility AI Agents with real-world application value • Optimize AI-Hub’s scoring, rating, and filtering mechanisms • Strengthen synergy with LaunchPad and Market • Enable AI Agents to complete value realization within the ecosystem The first 11 projects are only the beginning. AI-Hub is designed to become a continuously expanding AI Agent gateway — not a static product showcase. Further structural expansion is underway.🔥

YOMIRGO

23,685 Aufrufe • vor 5 Monaten

Today, we're announcing a $60M Series B led by Battery Ventures, bringing our total funding to $85M in just under a year. Also joining the round are founders and operators who’ve built generational companies of the last two decades – tobi lutke (CEO, Shopify), arash ferdowsi (Dropbox), Claire Hughes Johnson (Stripe), and more. The round came together in 6 days. Here's why. Every major category in enterprise software is seeing multiple AI-native challengers. CRM, ERP, ITSM – all being rebuilt from scratch by a new generation of companies applying AI to solve persistent problems we couldn’t before. Employee Management (also known as HCM) is the exception. It’s the last frontier, and we believe the most important one. The operating layer to manage people, run payroll, benefits, compliance, and IT, for every company in the world, is still built on architecture that predates AI by decades. This fundraise is the story of how Warp is changing that. The average Warp customer is growing 5x faster than their peers, with 1/10th of the HR and admin overhead. We’re seeing a massive shift happening in how the best companies run their people operations. From the fastest-growing AI-startups to massive public companies, the winning teams are running lean: HR, finance, and ops generalists who automate as much as possible, and use their time instead for strategic work that AI can’t automate. Warp is the platform of choice for ambitious companies operating at this new pace. Legacy HCMs help humans track the work. Warp uses AI to proactively complete the work. Workday was built for the last era. We're building for the next one. And it’s working. We've – - Doubled ARR in Q1 - On track to $2B+ payroll volume this year - Signed enterprise customers with thousands of employees - Launched entire product lines back-to-back: Warp benefits brokerage and Warp Fabric (our AI-native IT automation suite built in-house). A few thank-yous: 1. Our customers, the fastest-growing companies in the world, who trust us with their most critical systems. We wouldn't be here without you. 2. Our team - 50+ people in NYC who've built this platform, taken on the hardest problems in business-critical software. We're just getting started. 3. Our investors doubling down in this round, and some of our earliest believers – Sound Ventures (ashton kutcher, Effie Epstein), Derek Grant, (Arnav Sahu), Harj Taggar at Y Combinator, Balaji, Kevin Hartz, Kyle Vogt, Amjad Masad, HOF Capital (Fady Yacoub), colinevans (OpenAI) We're here to arm ambitious American companies with Workday-grade power, but with the usability and delight of an Apple product. With this new funding, we plan to fund deeper AI agents, tax and compliance infrastructure, expand our product suite, and support even closely our fast-growing customers. Come join us.

Ayush S

1,105,838 Aufrufe • vor 1 Monat