Загрузка видео...

Не удалось загрузить видео

На главную

To Adapt or Not to Adapt? Real-Time Adaptation for Semantic Segmentation paper page: The goal of Online Domain Adaptation for semantic segmentation is to handle unforeseeable domain changes that occur during deployment, like sudden weather events. However, the high computational costs associated with brute-force adaptation make this paradigm unfeasible...

18,871 просмотров • 3 лет назад •via X (Twitter)

Комментарии: 1

Фото профиля Pier Luigi Dovesi
Pier Luigi Dovesi3 лет назад

💀 Project page: 📜 Arxiv: 🧑🏻‍💻 Code: 📽️ Video:

Похожие видео

VideoRF: Rendering Dynamic Radiance Fields as 2D Feature Video Streams paper page: Neural Radiance Fields (NeRFs) excel in photorealistically rendering static scenes. However, rendering dynamic, long-duration radiance fields on ubiquitous devices remains challenging, due to data storage and computational constraints. In this paper, we introduce VideoRF, the first approach to enable real-time streaming and rendering of dynamic radiance fields on mobile platforms. At the core is a serialized 2D feature image stream representing the 4D radiance field all in one. We introduce a tailored training scheme directly applied to this 2D domain to impose the temporal and spatial redundancy of the feature image stream. By leveraging the redundancy, we show that the feature image stream can be efficiently compressed by 2D video codecs, which allows us to exploit video hardware accelerators to achieve real-time decoding. On the other hand, based on the feature image stream, we propose a novel rendering pipeline for VideoRF, which has specialized space mappings to query radiance properties efficiently. Paired with a deferred shading model, VideoRF has the capability of real-time rendering on mobile devices thanks to its efficiency. We have developed a real-time interactive player that enables online streaming and rendering of dynamic scenes, offering a seamless and immersive free-viewpoint experience across a range of devices, from desktops to mobile phones.

AK

38,686 просмотров • 2 лет назад

Trained a humanoid entirely in a 3D scan of the office. Zero real-world fine-tuning. It just walked in and worked. RL needs hundreds of thousands of attempts, and real robots can't afford to crash. A misjudged gap or a glass door collision breaks hardware and costs hours resetting. So you train in a sim. But sim policies usually train on randomized, untextured geometry; depth is easy to fake. The robot learns structure, not the real world: no materials, no lighting, no idea what anything actually is. RGB cameras carry all of that but training RGB policies in generic fake worlds won’t generalize to the real world. Niantic Spatial 🌎 Scaniverse reconstructs your scan of the real deployment site. One 360° camera walkthrough → photorealistic 3D Gaussian splat at metric scale → collision mesh pulled from the same reconstruction, so vision and physics match exactly. Drops straight into NVIDIA Isaac Sim/Lab, no manual conversion. Flexion simulation-first approach then seamlessly enables the training of RGB-only nav policies inside that reconstruction. With added domain randomization + large image encoders for robustness, this deploys straight to hardware. No real-world fine-tuning. Deployment: months of on-site adaptation → days. Tune into the NVIDIA livestream on 12 August to hear how these companies are closing the sim2real gap: NVIDIA Robotics ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

119,601 просмотров • 1 месяц назад

Introducing ALE-Bench, ALE-Agent! Towards Automating Long-Horizon Algorithm Engineering for Hard Optimization Problems Blog: Paper: ALE-Bench is a coding benchmark primarily focused on hard optimization (NP-hard) problems. We developed this benchmark with AtCoder Inc., a leading coding contest platform company. What makes ALE-Bench unique is its focus on hard optimization problems that demand long-horizon and creative reasoning. It’s open-ended, in the sense that true optima are out of reach (NP-hard) and scores can continuously improve. We believe this benchmark has the potential to become one of the key benchmarks for reasoning and coding in the next generation. ALE-Agent is our end-to-end agent that we specifically designed for this challenging domain. In fact, our ALE-Agent has already built an impressive track record in the wild! In May 2025, our agent participated in a live AtCoder Heuristic Competition (AHC), alongside 1,000 other participants in real-time. AHC is considered to be one of the most challenging coding competitions in this domain. Our ALE-Agent achieved an impressive ranking of 21st out of 1,000 human participants in the competition (top 2%), marking a turning point for AI discovery of solutions to hard optimization problems with a wide spectrum of important real world applications such as logistics, routing, packing, factory production planning, power-grid balancing. We look forward to applying this technology to real industrial optimization opportunities. Building on the insights from this study, Sakana AI will continue to tackle the challenge of developing AI with even greater algorithm engineering capabilities. ALE-Bench Dataset: ALE-Bench Code: This research was conducted in collaboration with AtCoder Inc. (AtCoder). We are deeply grateful for their outstanding expertise and contributions in optimization and algorithms, which were invaluable in providing data, analyzing results, and enabling our AI agent’s participation in their contests.

Sakana AI

237,195 просмотров • 1 год назад

FAU Erlangen-Nürnberg presents TRIPS Trilinear Point Splatting for Real-Time Radiance Field Rendering paper page: Point-based radiance field rendering has demonstrated impressive results for novel view synthesis, offering a compelling blend of rendering quality and computational efficiency. However, also latest approaches in this domain are not without their shortcomings. 3D Gaussian Splatting [Kerbl and Kopanas et al. 2023] struggles when tasked with rendering highly detailed scenes, due to blurring and cloudy artifacts. On the other hand, ADOP [R\"uckert et al. 2022] can accommodate crisper images, but the neural reconstruction network decreases performance, it grapples with temporal instability and it is unable to effectively address large gaps in the point cloud. In this paper, we present TRIPS (Trilinear Point Splatting), an approach that combines ideas from both Gaussian Splatting and ADOP. The fundamental concept behind our novel technique involves rasterizing points into a screen-space image pyramid, with the selection of the pyramid layer determined by the projected point size. This approach allows rendering arbitrarily large points using a single trilinear write. A lightweight neural network is then used to reconstruct a hole-free image including detail beyond splat resolution. Importantly, our render pipeline is entirely differentiable, allowing for automatic optimization of both point sizes and positions. Our evaluation demonstrate that TRIPS surpasses existing state-of-the-art methods in terms of rendering quality while maintaining a real-time frame rate of 60 frames per second on readily available hardware. This performance extends to challenging scenarios, such as scenes featuring intricate geometry, expansive landscapes, and auto-exposed footage.

AK

45,489 просмотров • 2 лет назад

#WATCH | Delhi: At the joint press conference with US Secretary of State Marco Rubio, EAM Dr S Jaishankar says, "Where defence and security cooperation is concerned, you're all aware that the 10-year major defence partnership framework agreement was recently renewed. A comprehensive underwater domain awareness roadmap was also signed. We discussed the importance of taking into account the Make in India approach and lessons drawn from recent conflicts while going forward in the defence domain. On the economic front, we spoke about the value of concluding at an early date the final text of the interim agreement regarding reciprocal and mutually beneficial trade. This will be an important step towards a comprehensive bilateral trade agreement, which was envisaged during Prime Minister Modi's visit in February 2025. We had a team recently in Washington, and our expectation is that an American team will be visiting India soon for that purpose. We spent some time today discussing energy issues, and again, you're all aware that our government's fundamental responsibility is to address the needs of 1.4 billion people. Ensuring the accessibility and affordability of energy for them is our prime objective. Secretary and I therefore welcome the expansion in our energy trade in recent months. Diversified supplies are at the heart of energy security for India. We devoted some time to nuclear energy cooperation as well. The passage of the Shanti Act has opened up new possibilities. An American delegation was recently in India. We hope to realise the potential of cooperation in the nuclear domain. I also raised with the Secretary some regulatory issues that we have on the American side..."

ANI

26,917 просмотров • 4 месяцев назад

At the panel session on “Rising Seas, Resilient Communities: Climate Adaptation Strategies in West Africa” at Harvard Business School earlier today, I had the opportunity to share Lagos State’s realities as a coastal megacity. Lagos sits on the continental shelf. Our land mass has grown from 3,577 to 4,050 square kilometres, largely through reclamation of wetlands and lagoon bodies. While this expansion has created space for real estate and infrastructure, it also comes with risks. This is why we insist that no reclamation takes place without Environmental Impact Assessments and drainage masterplans. These checks are necessary because when reclamation is done indiscriminately, it blocks stormwater pathways, destroys natural buffers like mangroves, and exposes millions of our people to flooding and erosion. As a city of over 22 million residents, we face additional pressures in managing daily waste. Lagos has long relied on a linear waste system with landfills, many of which are now decommissioned or about to be decommissioned . Today, we are deliberately shifting to a circular model that sees waste as a resource for wealth and energy. We have entered partnerships across the sub-region and beyond , including with a Ghanaian company that is helping us turn thousands of tonnes of waste into compost and reusable materials, while also setting up transfer loading stations to reduce what ends up in our landfills . We also recognize that Lagos is not alone in these challenges. The entire Gulf of Guinea shares similar threats. What happens in Togo, with its 42-mile coastline, or in Ghana, can affect us directly. That is why we have reached out to our neighbors and built regional partnerships on coastal protection, solid waste management, and climate adaptation. Our commitment is clear: to protect our environment, prosecute those who damage it, communicate with our citizens through advocacy on safe practices, and work with regional and international partners to build a Lagos that is not just surviving climate change but leading in adaptation strategies. These moves and developments are set to put Lagos on a #NewHorizon.

Tokunbo Wahab

10,221 просмотров • 1 год назад

So ai.com has a countdown timer hitting zero at Super Bowl kickoff tonight Here's why this is insane: → Kris bought the AI domain for $70M in crypto. The largest publicly disclosed domain sale in history → The domain previously redirected to ChatGPT, then xAI/Grok, then DeepSeek. Now it's launching a consumer AI agent platform → ~128M people will watch the Super Bowl tonight (in 16 hours). 18% of viewers say the ads are the main reason they tune in → A 30-second Super Bowl ad costs ~$8M this year, with some going for $10M+ Tech ad spending is 2x what it was during the 2022 "Crypto Bowl" when FTX, Crypto.com and others flooded the broadcast right before the market imploded → The product: a personal AI agent that can message, trade stocks, build projects, with a "decentralised network of billions of agents" vision This could be the mass onboarding event for personal AI Agents - the alpha will be getting your handle before it’s not available → Marszalek is running the exact same playbook as CryptoDotCom: buy a killer domain, splash on marketing, ride mainstream adoption. In 2021, he spent $700M on Staples Center naming rights, for one of the most valuable sports venue naming rights in history. Built a $1.5B revenue business → He paid for the domain entirely in crypto: ai.com traffic is about to go absolutely parabolic One of the most recognisable URLs on the internet + 128M eyeballs + a Super Bowl ad = the biggest single-day domain launch in history? This is going to provide a huge uptick in visibility to personal agents Yes we’ve seen the same playbook flop for crypto, but this time it’s far more interesting + useful to the average persons daily lives Compound this with the continued trajectory of OpenClaw developments and I strongly believe we are about to hit an inflection point in adoption

0xSammy

91,436 просмотров • 7 месяцев назад

Introducing SoftMatcha 2: A Fast and Soft Pattern Matcher for Trillion-Scale Pre-Training Corpora What lies within a trillion-scale pre-training corpus? Can you truly guarantee your benchmarks are uncontaminated simply because there are no exact string matches? Alongside several research institutions in Japan, Sakana AI is proud to have collaborated in the development of SoftMatcha 2, an ultra-fast and flexible search tool that enables search over trillion-scale natural language corpora in under 0.3 seconds, even while handling semantic variations (substitution, insertion, and deletion). No existing tool meets all these criteria, including infini-gram-mini (EMNLP’25 Best Paper) or the original SoftMatcha (ICLR’25). Our approach employs string matching based on suffix arrays that scales well with corpus size. To mitigate the combinatorial explosion induced by the semantic relaxation of queries, our method is built on two key algorithmic ideas: fast exact lookup enabled by a disk-aware design, and dynamic corpus-aware pruning. As a practical application, we demonstrate that SoftMatcha 2 identifies potential benchmark contamination in pre-training corpora that existing exact-match approaches miss. You can try searching through a 100B-scale corpus via our online demo. The system remains blazingly fast even on trillion-token corpora, so we encourage you to host it yourself for larger scales. Demo: Paper: Code: This work is a collaboration with researchers from the University of Tokyo, NII, Kyoto University, SOKENDAI, NINJAL, Tohoku University, and RIKEN.

Sakana AI

104,363 просмотров • 7 месяцев назад