正在加载视频...

视频加载失败

📢 New paper and 🤗 demo! Can LLM systems solve the classic program synthesis problem - generate code from example test cases alone? We use 🌱 Synthetic data generation from seed problems and finetuning 📈 Test time compute - draw more samples and filter! (1/n)

16,305 次观看 • 2 年前 •via X (Twitter)

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

The term "continual learning" has become overloaded if you see it as an ML problem. One classic thread is about memorization: regularization-based continual learning methods, such as EWC, MAS, and SI, estimate which parameters mattered for previous tasks and resist changing them too much. One modern thread is about adaptation: test-time training and inference-time learning methods, such as TTT, adapt part of the model on the incoming test stream before making predictions. These are sometimes discussed as separate threads. But in modern scalable architectures, I think they are better seen as complementary constraints: a model that learns quickly at test time also benefits from a mechanism for deciding what not to forget. In our #ECCV2026 paper, we study this in large-scale 4D reconstruction: how to build fast spatial memory that can adapt over long observation streams while reducing collapse and forgetting. Instead of using fully plastic test-time updates, we stabilize fast-weight adaptation with an elastic prior that balances adaptation and memory. Key ideas: - Elastic Test-Time Training: Fisher-weighted consolidation for fast-weight updates - EMA anchor weights that provide a moving reference for stability - Chunk-by-chunk inference for long 3D/4D observation streams We show that this scales across large 3D/4D pretraining settings, including both LRM-style and LVSM-style models, and improves reconstruction across benchmarks including Stereo4D, NVIDIA, and DL3DV-140. We release model checkpoints across different design choices: resolution, post-training curriculum, and whether the model uses an explicit 4DGS intermediate representation. - Homepage: - Paper: - Code: - Models: This work is co-led with Xueyang Yu, contributed by Haoyu Zhen Yuncong Yang, and advised by Michigan SLED Lab Chuang Gan.

Martin Ziqiao Ma

33,526 次观看 • 1 个月前

Gemini-powered robot can now effectively debug itself! I've been obsessed with two main questions in robotics: can robots learn from their own mistakes without humans in the loop, and how much can we leverage synthetic data? Spoiler: yes, and it's surprisingly elegant once you have the right primitives in place. The architecture is fairly simple (and optimized for GPU_Poor users): Component I: Gemini Brain ♊️ - Gemini 2.0 Flash analyzes all training episodes through both camera perspectives - Gemini 2.0 Pro creates a summary of training data, highlighting biases, limitations, etc. - Train policy p0 on this initial data, run evaluation episodes - Ask Gemini to categorize successes vs. failures (more insightful than you'd expect) - Based on both analyses, Gemini generates specific augmentation recommendations What's interesting here isn't that we're using LLMs for robotics - it's that we're closing the loop between perception, failure analysis, and targeted data generation. Component II: Data Generation with Scene Consistency The tricky part was maintaining consistency across both camera perspectives while generating new data. Three current augmentations: - Frame flipping and polarity reversals - Grounded-SAM + OpenCV for object color manipulation - Gemini to identify empty space and generate distractions in the scene …and repeat, ha! I'm using the so100 robot arm and Sarah’s Vintage from Hugging Face. And the APIs and models in Gemini family are Ace! Thank you Logan Kilpatrick Patrick Loeber and team for this. In thread The Circus of Making It Actually Work🧵:

Shreyas Gite

47,245 次观看 • 1 年前

Depth Any Video with Scalable Synthetic Data AI physicists and chemists continue to make strides in depth estimation from video. Check out this new paper featuring some impressive examples. See the thread for more details (unfortunately no code yet). Abstract: Video depth estimation has long been hindered by the scarcity of consistent and scalable ground truth data, leading to inconsistent and unreliable results. In this paper, we introduce Depth Any Video, a model that tackles the challenge through two key innovations. First, we develop a scalable synthetic data pipeline, capturing real-time video depth data from diverse game environments, yielding 40,000 video clips of 5-second duration, each with precise depth annotations. Second, we leverage the powerful priors of generative video diffusion models to handle real-world videos effectively, integrating advanced techniques such as rotary position encoding and flow matching to further enhance flexibility and efficiency. Unlike previous models, which are limited to fixed-length video sequences, our approach introduces a novel mixed-duration training strategy that handles videos of varying lengths and performs robustly across different frame rates 0 - even on single frames. At inference, we propose a depth interpolation method that enables our model to infer high-resolution video depth across sequences of up to 150 frames. Our model outperforms all previous generative depth models in terms of spatial accuracy and temporal consistency.

MrNeRF

27,428 次观看 • 1 年前

OptimAI Lite Node v1.1: Built for Scale, Designed for You! 💕 In just 2 weeks since the launch, the OptimAI Network has seen explosive growth—130,000+ active node participants powering the future of decentralized AI. With this incredible momentum came a new challenge: ensuring our network could scale seamlessly to support massive concurrent connections and real-time participation. That’s why we’ve rolled out OptimAI Lite Node v1.1—a major upgrade focused on: + Stabilizing infrastructure to handle high traffic from a global community. + Enhancing performance for smoother data mining, validation, and edge compute participation. + Refining user experience with UI updates that make contributing effortless. Every line of code and infrastructure upgrade was made with one goal in mind: to support YOU—the builders, validators, and visionaries of the OptimAI ecosystem. Now’s the time to bring more friends into the journey. 🔥 The more we grow, the smarter and stronger the network becomes—and the greater the rewards. Let’s keep building, validating, scaling. Together we’re not just powering AI—we’re reshaping how it’s built. Join or revisit the node here: 🌐 Chrome Extension: 📱Telegram Mini-App: What’s Coming Next: OptimAI Edge Node & the Rise of Agentic AI 🔸OptimAI Edge Node (Mobile) We’re working hard on the next major release: the Edge Node for mobile, which will allow mining and AI tasks to run in the background—unlocking more earning opportunities and decentralized compute power from your smartphones. 🔸More Task Types & Missions Expect new types of contributions, from AI-enhanced data validation to edge inference and scraping automation—powered by autonomous mining agents. 🔸Expanded Rewards Program As we grow, more reward tiers, bonuses, and campaigns will be introduced. Your participation now paves the way for long-term benefits. Also, do not forget to checkout our article below and learn more about our latest Community Tips & Best Practices!👇 __________________ OptimAI Network #L2 #DePIN Reinforcement Data Network for #Agentic #AI Mine Data. Fuel AI. Earn Rewards. Turn Your Data into Tomorrow’s AI #Agent. Visit our website at:

OptimAI Network

76,435 次观看 • 1 年前

🚀Just launched: Amazon Q, the most capable GenAI-powered assistant is generally available today: Customers are using Q to transform how their teams get work done. When employees chat with Amazon Q, it provides immediate, relevant information and advice to help streamline tasks, speedup decision-making, and help spark creativity and innovation at work. . Early indications signal Amazon Q could help our customers’ employees become more than 80% more productive at their jobs; and with the new features we’re planning on introducing in the future, we think this will only continue to grow. 🟠 Amazon Q Developer allows developers to spend more time coding and less time on maintenance and performing other tedious, repetitive tasks. Q assists developers and IT professionals (IT pros) with all of their tasks—from coding, testing, and upgrading applications, to troubleshooting, performing security scanning and fixes, and optimizing AWS resources. Q also comes with Q Developer Agents which can autonomously perform range of tasks and we expect it to be the state of the art accuracy in benchmarks like SWE-Bench. 🟠 Amazon Q Business empowers employees to be more data-driven, and helps customers make better, faster decisions using company knowledge and data. Q Business is a generative AI–powered assistant that can answer questions, provide summaries, generate content, and securely complete tasks based on data and information in enterprise systems 🟠 Amazon Q Apps, a new and powerful capability of Amazon Q Business, enables employees to use natural language to quickly and securely build their own generative AI applications to automate daily tasks without requiring any prior coding experience. Employees simply describe the type of app they want, in natural language, and Q Apps will quickly generate an app that accomplishes their desired task, helping them streamline and automate their daily work with ease and efficiency.

Swami Sivasubramanian

25,216 次观看 • 2 年前