Загрузка видео...

Не удалось загрузить видео

На главную

Why choose between autoregressive (fast, streaming) and bidirectional (high-quality) video diffusion when a single model can do both even better? Excited to share Flex-Forcing, accepted as spotlight at #ICML2026! 📍Say hi to Chao Liu at our poster: July 9 | 2:30 - 4:15 PM KST | Hall A #3909...

10,443 просмотров • 3 месяцев назад •via X (Twitter)

Комментарии: 3

Фото профиля Julius Berner
Julius Berner3 месяцев назад

At test time, Flex-Forcing allows you to dynamically change the chunk-size over frames and diffusion time-steps. 1⃣Bidirectional: Maximal context for global coherence 2⃣Autoregressive: Causal generation for fast streaming 3⃣Hybrid: Optimal tradeoff in terms of inference speed and quality

Фото профиля Julius Berner
Julius Berner3 месяцев назад

What does this mean in practice? 1⃣Better speed-quality tradeoff: Outperforms baselines in terms of both FPS and VBench score. 2⃣Coherent long video generation: Maintains stability over time while preserving a higher dynamic degree than baselines. 3⃣Any-order, any-timestep editing: Edit arbitrary video segments without triggering cascading errors in later frames.

Фото профиля Julius Berner
Julius Berner3 месяцев назад

Check out our paper and project page for more information! 📜 Paper: 💻 Project Page:

Похожие видео

🎥 Today we’re premiering Meta Movie Gen: the most advanced media foundation models to-date. Developed by AI research teams at Meta, Movie Gen delivers state-of-the-art results across a range of capabilities. We’re excited for the potential of this line of research to usher in entirely new possibilities for casual creators and creative professionals alike. More details and examples of what Movie Gen can do ➡️ 🛠️ Movie Gen models and capabilities Movie Gen Video: 30B parameter transformer model that can generate high-quality and high-definition images and videos from a single text prompt. Movie Gen Audio: A 13B parameter transformer model that can take a video input along with optional text prompts for controllability to generate high-fidelity audio synced to the video. It can generate ambient sound, instrumental background music and foley sound — delivering state-of-the-art results in audio quality, video-to-audio alignment and text-to-audio alignment. Precise video editing: Using a generated or existing video and accompanying text instructions as an input it can perform localized edits such as adding, removing or replacing elements — or global changes like background or style changes. Personalized videos: Using an image of a person and a text prompt, the model can generate a video with state-of-the-art results on character preservation and natural movement in video. We’re continuing to work closely with creative professionals from across the field to integrate their feedback as we work towards a potential release. We look forward to sharing more on this work and the creative possibilities it will enable in the future.

AI at Meta

2,267,315 просмотров • 2 лет назад

📢📢 𝐀𝐯𝐚𝐭𝟑𝐫 📢📢 Avat3r creates high-quality 3D head avatars from just a few input images in a single forward pass with a new dynamic 3DGS reconstruction model. Video: Project: Our core idea is to make Gaussian Reconstruction Models animatable. We find that a simple cross-attention to an expression code sequence is already sufficient to model complex facial expressions. We then incorporate position maps from DUSt3R and feature maps from Sapiens to facilitate the prediction task. While DUSt3R's position maps act as a pixel-aligned initialization for the Gaussians' positions, the Sapiens feature maps help the cross-view transformer to match corresponding image tokens in the 4 input images. One major challenge in creating a 3D head avatar from smartphone images comes from inconsistent facial expressions when the subject could not remain perfectly static during the capture. We eliminate this static requirement by simply showing our model input images with different facial expressions during training. This technique makes our model robust to inconsistent input images later on. Finally, we show that despite the model has been trained with 4 input images, one can even create a 3D head avatar when only a single image is available. To achieve this, we employ a pre-trained 3D GAN to lift the single image to 3D and then render the 4 input images for our model. This allows us to create 3D head avatars from single images and even highly out-of-distribution examples like AI generated faces, paintings or statues. Great work by Tobias Kirschstein from his internship at Meta with Javier Romero, Artem Sevastopolsky, and Shunsuke Saito

Matthias Niessner

74,863 просмотров • 1 год назад

BREAKING: GPT-5.5 "Spud" is out and it is a BEAST We've been testing it Every 📧 for the last 3 weeks on everything from coding, to writing, to knowledge work. Here's our day 0 vibe check: - It's a step change in coding AND it's easy to talk to. It's fast and friendly and quickly became my daily driver. But it's also a coding powerhouse—a really rare combination. - It scored 62/100 on our Senior Engineer benchmark. Opus 4.7 scored only a 33/100. (But GPT-5.5 performed best when using an Opus 4.7 plan). Naveen Naidu used over 900 million tokens during testing—and it let him ship production features for Monologue at both high speed and quality. - It has serious conceptual clarity. It can hold a complex plan in its head over hours of work, without getting distracted by existing code. This makes it the first model that we've tested that can perform well on complex refactors requiring deleting and reimagining an substantial existing codebase. - It's a very good writer. This is the first OpenAI model in about a year that got our writers Every 📧 to switch away from Claude. 5.5 has Katie Parrott's seal of approval—not an easy task. Its writing feels more organic and it's better at mimicking a writing style without going overboard. - It's great for agentic knowledge-work. This is the first OpenAI model that manages to be both a stellar senior engineer AND that can be used for everything from spreadsheets to research. It's crazy fast, and it's amazing inside of the Codex desktop app, and got much of our team to switch away from Claude Code and Cowork during the testing period. However, it's not a perfect model. - 5.5 still loses to Opus 4.7 on plan quality. It's plans are extremely readable but Opus has better attention to detail and sharper insight. - 5.5 still loses to Opus 4.7 by a bit on front-end and full-stack product work. Kieran Klaassen found that it wasn't quite as good when full-stack thinking and design are involved. And it's not great writing Ruby. - 5.5 is a great vibe coder but if you're vibe coding without a plan it's worse than Opus. Mike Taylor found that Opus is better at reading in between the lines on underspecified vibe-coding tasks. Overall GPT-5.5 is a massive achievement from OpenAI and it deserves a serious look as your daily driver. Read our full vibe check on Every 📧 here:

Dan Shipper 📧

130,382 просмотров • 5 месяцев назад

At the News18 Town Hall, I addressed a question often asked by critics: Is the #DravidianModel of high industrial growth and high welfarism sustainable? For us, the answer is not just "yes" it is the only way to build a "Good Society." As I shared, the state has three primary responsibilities: improving the quality of life through public goods, creating an environment where entrepreneurs and innovators can thrive, and keeping the gap between the rich and the poor as low as possible to ensure social cohesion. We have always prioritized the social aspects of governance, nutrition, health, and education, as the essential foundation for all growth. This is not just a welfare choice; it is a predicate for economic success. By building high-quality human capital, we ensure that global investment and jobs find us. The results speak for themselves: an 11.19% growth rate and a 700% increase in electronics exports in just the last few years. When critics highlight "better" fiscal metrics in other states, the trade-off is clear. I will always choose a path that invests in the lives and dignity of our citizens, even if it requires borrowing within manageable limits, rather than accepting models where massive capital expenditure coexists with high levels of multi-dimensional poverty. We do not measure success by the creation of a few super-rich billionaires while the average resident lags behind; we measure it by the quality of life and the capacity to aspire for every single citizen. Watch the video here: [English W\ Tamil CC]

Dr P Thiaga Rajan (PTR)

15,792 просмотров • 7 месяцев назад

We made a thing! Very happy to announce sqlcoder-pro and the Defog Alignment Platform. Available to use immediately without a wait-list, weights will be open-sourced very soon. The video does a quick show and tell comparison against ChatGPT (with gpt-4o). Read on for more details! TLDR 💪 equal (or better) performance on text-to-SQL as the most capable Claude-3.5 or GPT-4 models 🤝 You can use it today on a free plan/free trial, without a waitlist 🪽 self-hostable on a single RTX4090, with 2 second median generation times for SQL queries 🔁 exactly the same output every time, give the same prompt 👨🏻‍🏫 teachable and steerable: show the model what you want it to do 🛞 debuggable – you can understand WTF is going on inside the model, instead of treating it like a black box Let's dig into each of these one-by-one! Performance SQLCoder-8b-pro significantly exceeds the performance of our previous sqlcoder-8b model on Postgres text-to-SQL (from 88.2% to 90.2% accuracy - gpt-4o is at 87.6%, for reference). It is also better at following instructions. This was done via self-merges, hand crafted fine-tuning data, and adapting the training data to fit our tokenizer. Cost You can host this on the model on a single $3,500 RTX4090, and support ~5 requests/second via VLLM. If you're looking to host on the cloud instead, you can run it on a single L4 GPU that costs $300/mo on GCP Repeatability We have a dense 8b model with no MoE shenanigans. For the same prompt with temperature=0, you'll always get the same answer – which is critical in BI. Teachable In our alignment and feedback modes, you can give the model feedback on how it answered certain questions, and it will automatically adapt to the feedback. Debuggable You can use logprobs and attention scores to determine where, exactly is the model paying attention to inside a prompt + what it's getting confused by when generating outputs. Available today You can use Defog on the cloud today by going to docs[dot]defog[dot]ai, and getting an API key. Excited to hear what you think!

Rishabh Srivastava

13,469 просмотров • 2 лет назад

BREAKING: OpenAI just dropped GPT-6 ASTRA!!! 🚀✨ We’ve been testing it extensively at Every 📧 across coding, writing, and knowledge work. My take: it’s a big upgrade from 5.6-Sol, with some frustrating habits that keep it from matching Fable at the top end. Here’s your vibe check: - The best writing model I’ve tried. It’s fast, produces very little slop, and is easy to steer. It’s a good companion for actually working through the writing I do every day. (Not to mention, it one-shotted the first draft of its own vibe check today!) - The computer use is wild. It can go for hours at a time using complicated apps to get work done. It did the first cut of our Fable 5.1 vibe check video...kind of mindblowing - Impressive 3D games and visualizations. It can make beautiful 3D worlds from a single prompt. I one-shotted a historically accurate rendition of the Battle of Waterloo - It can overcomplicate things. (Especially at higher effort levels.) Ask for a simple interface and you get extra labels, buttons, and features everywhere. It has a habit of turning everything into a landing page. It just doesnt quite match Fable's ability to intuitively understand your prompt and do something delightful (without overcomplicating.) Net Result: If you already live in ChatGPT for Work or Codex and can afford it, it’s an easy upgrade from 5.6-Sol. The biggest proof of Astra's effectiveness at helping you do work is our vibe check. We found out it was launching at 3 AM this morning, and had a 4,000 word vibe check + video done by 2 PM. Not possible without this model. I’m reaching for Astra all day, but Fable 5.1 still gets my biggest tasks. On ambitious builds, Fable is better at understanding what I want and taking it further than I would have thought to ask. State of Play: Astra is launching to Enterprise customers today, and the rest of ChatGPT users over the coming days. Now, both OpenAI and Anthropic have a higher class of models that cost more to use. That changes who gets to use frontier AI and how. It's also a new vector of competition between them: Fable and Astra are priced at the same level. We'll see what that means for adoption in the coming days and weeks. read our full vibe check Every 📧 today:

Dan Shipper

387,938 просмотров • 1 месяц назад

April 26 It's critical that you have an accurate assessment of your own capabilities, both good and bad. This is another of the many reasons why competition is so important - because it gives you that assessment with no bullshit, sugar coating, or 30 caliber pencils. The overwhelming majority of people who don't compete think they are way better with a gun than they are - and this is especially true among those who carry as part of their profession. My opinion is that if you carry a gun you owe it to yourself and everyone around you to be extremely good with it. Not just better than the average gun owner, but excellent. Most people who carry do not share this opinion, at least in a way that makes them do anything about it. All the information required is readily available at your finger tips. I realize it takes times to build a house - you don't have to be great today, but actively moving in that direction every day is important. And a lot of people who preach training, don't do it nearly as often or intense as they should. I'm not even thinking of anyone specifically when I say that. Everyone reading this knows if it applies to them or not. I have been just as guilty of it as anyone. Warm Up - Targets: Open (10) As many sets as required until thoroughly warm - 10 reloads freestyle, 10 reloads alternating to strong/weak hand. Primary - Targets: Open (15), Partial (15), Open (35) 20 minutes - Match Mode - Draw and engage T1-3 with 2, reload and engage T1-3 with 2. Alter engagement order per rep.

Wash

11,047 просмотров • 5 месяцев назад