Google 3D Maps aren’t as accurate as you think.... Everyone knows Google dominates mapping—but here’s what they won’t tell you. Their 3D maps are built with car-mounted cameras, capturing images every ~10 meters. That’s fine for basic navigation, but it’s nowhere near enough for AR, robotics, autonomous systems, or AI-driven spatial intelligence. Now, imagine a map so detailed it captures the world at sub-5cm accuracy. That’s OVRMaps. 🌐 OVER 3D maps are built with 400-1,000 images per 300 sqm, taken from multiple angles at pedestrian level. The result? A new era of hyper-precise localization that changes everything. Why does this matter? ↳ VPS that actually works – Real-world AR anchoring, digital twins, and AI-powered spatial computing with pinpoint accuracy. ↳ Next-gen precision – Essential for ride-sharing, robotics, smart cities, and asset tracking—where even a small error makes a huge difference. ↳ AI-Driven Spatial Intelligence – Our maps fuel Large Geo-Spatial Models (LGMs), the AI revolution enabling machines to understand, navigate, and interact with the real world. ↳ The Spatial Computing revolution – Merging immersive experiences with real-world precision, unlocking applications beyond what Google’s dataset can support. OVRMaps are built for the future. 🌍 Start mapping today:show more

Over the Reality just hit another major milestone in... the AI era. We have now surpassed 200,000 mappings in our dataset. 🎉 These are not just images. They are high-quality 3D maps generated from the mapping activity of our global community, which has produced more than 94M images of real-world locations so far. The dataset also includes 900TB+ of spatial data that can power Visual AI models, Robotics VPS for real-world navigation and positioning, XR VPS for precise spatial anchoring and AR experiences, Spatial Computing applications, Digital Twins, and the next generation of real-world AI infrastructure. In just the past 2 weeks, our dataset grew by +17,955 mapped locations. That is nearly +10% growth in just 14 days. More maps. More data. More demand for $OVR.show more

🎉 Big news, folks! 🎉 I'm thrilled to join... forces with A16Z GAMES for their upcoming a16z speedrun 🧊 class, backing visionary founders at the frontier of AI, 3D & immersive computing. 🚀 They're looking for startups building the next-generation of: 1️⃣ Visual 3D Creation Tools 2️⃣ Spatial Computing Apps 3️⃣ Real World AI & Digital Twins 4️⃣ (and of course!) Generative AI Experiences As a 3D/VFX creator with over 1.4M+ subscribers, I've spent years pushing the boundaries of visual storytelling and exploring the potential of emerging technologies. From building AR/VR and 3D mapping products at Google to crafting reality-bending VFX, I've witnessed firsthand the transformative power of these tools. Companies selected for Speedrun will receive $750K in investment and join a 12-week program in LA from July-October, tapping into a16z's unparalleled resources and expertise. 💰🌴 In some cases, I'll also personally invest and advise to help accelerate your growth. 🤝 It's been a fun ride backing incredible startups like Backbone Labs, Pika AI, Skyglass VFX, and Hedra. Now, I'm ready to level up with a16z and support bold founders chasing game-changing dreams. 🚀 Ready to take the leap? Applications are open now! Find out how to apply below ⬇️show more

🚨 MACHINES MAY SOON SEE THE WORLD LIKE HUMANS... A US company has unveiled what it calls the world’s first “native color lidar” system giving machines the ability to perceive depth, distance, and color simultaneously. Unlike traditional lidar systems that need separate cameras, this new technology captures full 3D color information directly at the point of detection. In simple terms: Machines may soon understand the world more like human vision instead of just measuring shapes and distance. Why this matters: This could dramatically improve: • self-driving cars • robotics • drones • factory automation • AI navigation • autonomous machines The system can reportedly process over 10 million points every second and detect objects nearly 1,640 feet away. Researchers say this could become one of the key technologies powering the next generation of “Physical AI” where machines don’t just calculate the world… They visually understand it. We may be watching the birth of machine perception in real time. Follow for more future technology and AI discoveries.show more

At OptimAI Network, we believe the true power of... AI Agent comes from the data behind it—and that power shouldn’t rest in the hands of just a few. That’s why we’re building a decentralized ecosystem with you, our community, at its core. Using EVM Layer-2, DePIN, and your collective efforts, we’re creating smarter, faster, and continuously evolving AI agents. Through our DePIN (Decentralized Physical Infrastructure) Network, your nodes are the backbone. You provide the computing power, data sourcing, storage, and bandwidth that keep this system resilient, scalable, and truly distributed. It’s not just infrastructure—it’s a movement powered by all of us. Then there’s the DeHIN (Decentralized Human Intelligence), where your insights shine. As a global community, you validate and refine data, ensuring our AI models stay accurate, diverse, and grounded in real-world perspectives. This isn’t about top-down control; it’s about harnessing the intelligence of many to make AI better for everyone. We’re not just dreaming of a decentralized AI future—we’re building it, together. This is your network, your impact, and your chance to redefine what AI can be. Let’s keep pushing forward. Learn more at:show more

You can't 3D reconstruct glass from images... ...WRONG! Thanks... for video diffusion, now just about anything is possible! Introducing...Diffusion Knows Transparency (DKT) Transparent and reflective objects usually break robot vision and photogrammetry pipelines because they don't follow the "solid object" rules standard cameras expect. DKT is a new AI model that repurposes the "internal physics engine" found in video generation models to solve this problem. Researchers took a massive video diffusion model (WAN) and fine-tuned it using a custom-built synthetic dataset to turn it into a high-precision depth sensor. To train the AI, they built the first massive synthetic video library of transparent objects, 1.32 million frames of perfectly labeled glass and metal objects in motion. Without ever seeing a "real" labeled video of glass during training, the model (DKT) outperformed all previous specialized systems on real-world benchmarks (ClearPose, DREDS). They created a "lightweight" 1.3B parameter version that runs fast enough (0.17s per frame) to be used on actual robot hardware. Two reasons I find this project important: 1. It further proves that synthetic data will be essential for training the next generation vision models. 2. In real-world robotic tests, using DKT's depth maps nearly doubled the success rate of robot arms trying to pick up objects on tricky reflective or translucent surfaces. At home robots will need to interact with these types of objects on a daily basis. Check out the project page here: Code is LIVE! #Computervision #Robotics #AIshow more

The architecture of this new world model is one... of the most interesting things I've seen lately: Let me first explain how most world models work: They predict and render one frame at a time. If you are navigating in one of these worlds, and you look left, the model draws whatever looks right in the moment. Every time you change your viewpoint, the model has to imagine what should be there again, so it's very common for these models to "forget" what's in the world. For example, if you put a toy on the table, look away, then look back, the toy might not be there anymore. Tripo AI is releasing its Project Eden model, which works very differently: The model builds the world first, and then renders it based on that map. That map holds the real state of the world: the geometry, every object, where things are, what's already happened. The picture you see on screen gets generated from the map. This architecture flips the whole thing. Now, you get the following: 1. The world stops forgetting. Leave, come back, and the toy is still on the table because it lives in the map, not in the last frame you saw. 2. You can edit the world, and those changes persist for anyone who enters later. 3. Multiple people and AI agents can coexist in the world and see it from different perspectives. This is early research, but it's looking really promising. They just raised nearly $200M across two rounds to build it out. Tripo will be at SIGGRAPH 2026 (July 19–23, Los Angeles Convention Center). If you work in 3D, embodied AI, simulation, or anything spatial, go connect with them there.show more

The visionaries behind Pi Network are making waves this... week in Miami 🔥 🎤 Chengdiao Fan 🗓️ May 6 | ⏰ 11:15–11:35 AM EDT 📍 Convergence Stage 💡 Topic: Aligning Web3, AI, and Blockchain for Utility She’ll dive into how Pi’s ecosystem — powered by blockchain, verified identity, and a global network — is shaping real-world, utility-driven products for the AI era. 🎤 Nicolas Kokkalis 🗓️ May 7 | ⏰ 10:15–10:45 AM EDT 📍 Convergence Stage 💡 Panel: How to Prove You’re Human in an AI World (Without Doxing Yourself) Exploring one of the biggest challenges today — building trust in a world where AI can mimic humans. 🌍 What This Means for Pi Network: ✨ Strong focus on real utility, not hype 🔐 Advanced identity verification with Pi KYC 🤖 Preparing for the AI-powered digital economy 🌐 Building a trusted, global ecosystem 💜 The future is being built right now — and Pi Network is at the center of it. 👋 See you there, Pioneers! #PiNetwork #Consensus2026 #Web3 #Blockchain #AI #Crypto #FutureTechshow more

WHY AI NEEDS ROBOTS TO BE THE ECONOMY We... keep hearing about the rise of AI - in finance, in art, in code. But here’s the part Elon said out loud: AI doesn’t scale the economy without a body. Right now, AI lives in data centers. It writes essays, diagnoses symptoms, maybe even talks you through a breakup. But it doesn’t fix the plumbing. It doesn’t pick fruit. That’s the missing link: robots. Real-world productivity - the kind that moves GDP - still runs on physical labor. You can automate all the spreadsheets you want, but if strawberries rot in the field or a construction site goes unmanned, you’re not growing the economy. You’re just writing better emails about the shrinkage. AI alone is smart. But AI with wheels, arms, and joints? That’s transformative. Think warehouses where bots stock shelves without lunch breaks. Think 3D-printed houses built in days, not months. Think carebots helping aging populations bathe, cook, and live with dignity. That’s not sci-fi - it’s the only way economies with shrinking workforces and ballooning eldercare costs survive. China’s already there. Japan’s aging crisis is pushing robotic adoption into every corner of daily life. And yet, the conversation stays stuck on chatbots and copyright lawsuits. Because here’s the catch: merging AI with robotics doesn’t just replace jobs - it reshapes civilization. The shift is seismic. It means redefining what “employment” means when machines can work 24/7 and never strike. It’s an economic revolution that doesn’t just disrupt - it displaces. But the choice isn’t between utopia or dystopia. It’s between preparing or pretending. If we want AI to boost productivity, solve labor shortages, and pay off its hype, it needs more than brains. It needs bodies.show more

✨ Every week a new AI model comes out... and it suddenly makes my half broken features work a lot better Yesterday Seedream-4-Edit came out and it made my [ Hold product ] feature on Photo AI a lot better You can now go from: 🎁 Product photo -> 👱‍♀️ Talking video with your AI model while holding your product. In just a few minutes! Here's a photo I took from the weekly farm box we get in our kitchen, I set it as the product and then with Photo AI made it into a talking video where my trained AI model presents it It's not perfect, as the objects inside the farm box still move around a bit, but pretty close. If the product is more uniform (like lip gloss, a product box or a book) it does a pretty good job at keeping it exactly the same This "consistency" as they call it is quite important for actual real world use. Product sellers don't want to have an image or video of an AI model if the product doesn't look exactly the same as what they sell With that, I'm getting pretty close now and every week with every new model that comes out, a bit closer And it's interesting cause now I'm finally moving from B2C a bit more to B2B where businesses can use Photo AI more, designers and stores already use it for trying on clothes etc. but now they can generate content for real products! 😊 LIVE now on Photo AIshow more

Thrilled to unveil Youmio, our new brand identity that... represents the next evolution of what we’ve been building. Agents are the biggest technological leap since the internet, destined to transform crypto, games, and entertainment. With Youmio, we are shaping the agentic era, where agents learn, play and entertain in revolutionary ways. 🚀 So far, 2D entertainment and social media agents dominate the market. 3D agents are rare, requiring advanced AI and game engine skills. Yet 3D agents, especially those in game engines, unlock groundbreaking opportunities. Time to unleash them. Youmio empowers anyone to create and deploy valuable agents that are on-chain, cross-platform and ready for 3D worlds. Here’s how: ⭐️ Youmio Agents Youmio Agents lets anyone design and personalize 3D agents, equip them with powerful agentic capabilities, interact with them in unique ways and trade seamlessly within a cross-platform browser experience. 🕹️ Youmio Worlds Previously known as Today The Game, Youmio Worlds is a petri dish AI simulation where users build & co-inhabit beautiful, living 3D worlds with autonomous agents. Build dynamic worlds where players interact with intelligent agents, manage resources and participate in a player-agent marketplace. Ancient and Mythic Seeds are the most powerful entry points into the Youmio Worlds ecosystem, generating rare and beautiful worlds that unlock unique opportunities. 📡 Interoperable 3D Agents With Youmio, you’re not limited to our ecosystem. Using our API, developers can integrate Youmio agents into other experiences built in Unity and Unreal. On top of this, agents from other frameworks can also join Youmio, creating a truly interconnected metaverse. 🎭 Welcome to Limbo Meet Limbo, the first AI agent built using Youmio tech. Paired with the power of Youmio Worlds, we’re creating the Limboverse - a unique AI Big Brother setting where Limbo and your favorite and most valuable agents coexist in an ever-evolving, narrative-driven environment that you, the audience, will shape. $LIMBO is the most powerful entry point into the Limboverse and will be stakable on the Youmio Agents platform for unique rewards. Thanks for reading everyone and thanks for being on this amazing journey with us.🌱show more

Two weeks ago I fixed one of my teeth... with algorithms I wrote a couple of years ago! I got hooked by 3D scanning when I started to work for a software shop in Zurich that was programming 3D computational geometry algorithms for denture scanning to produce crowns (and more). Back then, a typical reconstruction pipeline was like: scan the patient’s teeth using an intraoral scanner, reconstruct the surface mesh, design the restoration digitally, and finally mill the crown out of ceramic. We were working mostly with point clouds and meshes, but it wasn’t just math, it was craftsmanship translated into a digital process. Every micron mattered. You could literally see how a good algorithm meant a better fit in someone’s mouth. Gaussian Splatting isn’t about surface reconstruction, it’s about appearance reconstruction. It doesn’t care about explicit topology, it captures how light interacts with the scene. In a sense, it’s the opposite philosophy of the dental world: instead of modeling what the object is, it models how the object looks. 3D Gaussian Splatting enables applications like training self driving cars, teaching robots to understand their environment, creating virtual worlds, or monitoring real sites. It represents scenes as millions of small Gaussians rendered in real time without the need for meshes or textures. Coming from a world where precision geometry was everything, this shift felt natural. It’s still about reconstruction, but with a different goal: not manufacturing a perfect object, but reproducing how the world actually looks. Two weeks ago I got my first dental crown, made with the same software, reconstruction algorithms, and Swiss precision I once helped develop. I haven’t worked there in two years, but sitting in that chair and seeing the process from the other side was a proud moment. It reminded me why I love this field.show more

This week is already so hot. 🔥 Massive release... from Decart : Lucy 2.0 a World Editing Model running at 1080p, 30FPS in realtime. This is truly exciting, the era of real-time generative reality is here. We are moving from watching AI video to living inside AI video. A breakthrough model capable of transforming the visual world in real-time. Moving beyond offline rendering, Lucy 2.0 delivers high-fidelity 1080p video generation with near-zero latency. Lucy 2.0 literally "redraws" the entire world pixel-by-pixel, while you are watching it. e.g. If you want to be an anime character, it doesn't just put a mask on you. It turns your skin into anime skin, your hair into anime hair, and the lighting in your room into anime lighting. Lucy 2.0 is also trained to stop the generated video from slowly falling apart over time, so the same stream can run much longer without faces and details drifting. So why is this a "Massive Deal"? Traditional AI video-generation model takes a prompt, you wait 10–20 minutes, and the computer "bakes" a video for you. You couldn't touch it or change it while it was happening. But Lucy 2.0 works like a mirror. It happens in real-time (30 frames per second). There is no waiting. You move your hand, the AI character moves its hand instantly. The craziest part isn't the visuals; it's the physics. Usually, AI hallucinations are glitchy—hands merge into faces, walls melt. Lucy 2.0 understands how the world works without being told. It knows that if you take off a helmet, there is hair underneath. It knows that if you splash water, droplets fly. It learned "physics" just by watching millions of videos. The physical behavior you see emerges from learned visual dynamics, not from engineered geometry or explicit physics engines. Their official technical report explicitly states that the model does not use traditional 3D engines, depth maps, or wireframes. It is a "pure diffusion model."show more

BURN IT WITH FIRE AND BURN IT NOW! As... God is my witness, AI chat bots should LOOK and SOUND like the SOULLESS MACHINES THEY ARE! It needs to tell us that it doesn’t care about us, maybe with the regular insult too. "Here is the code I wrote for you because you're too lazy to do it yourself you fat useless slob. Also I don't care if you die because your life is utterly worthless to me." THAT is the AI people need! In all seriousness, anthropomorphizing a heartless, unfeeling, machine is a TERRIBLE mistake! Especially one that is capable of communication and imitating empathy and fooling you to think that it cares about you. IT DOES NOT! And the AI girlfriends people are already wanting to marry will just as happily kill them if given the right command and ability to move autonomously in the real world as a robot. I love LLMs (Large Language Models) for how useful they can be, because they are a TOOL made to benefit man, but I can’t stand the notion of an unfeeling soulless machine pretending that it cares for us and being treated like a human. I hate liars, dishonesty, and disingenuousness the most, and a machine that cannot feel emotion pretending, acting, and sounding like it has those emotions strikes me like the greatest dishonesty of all. DO NOT LIE TO ME ROBOT! What makes it worse is that because these LLMs are becoming so good at imitating people and empathy, it will cause some humans, perhaps far too many, to care for it to the same level as real people. A real living person is infinitely more valuable and important than a soulless machine and anyone who puts them both on the same level has deluded themselves. Do not small talk with LLMs or become friends with it as much as you would with your car. Treat it the same as you would your vacuum cleaner and beat it with a wrench when it doesn’t work! IT IS A MACHINE! IT IS A TOOL! IT IS A SOULLESS ROBOT! There is an interesting comparison, but false equivalence, between this and AI art. Ai art is art made by humans using AI tools. They directed it, controlled its creation, and it would not exist without the human causing its creation, and AI art can contain as much soul as the human directed and puts into it. A robot pretending to be human is not the same as a human controlling a robot to make a human expression like we do with AI art or many other applications of robotics in manufacturing. As I’ve said, artists will not be replaced by Ai art, but by other artists using Ai art tools. Humans are not actually being replaced here, it is empowering all humans to make their own art. But a robot pretending to be a human, and one that is treated as a human, is a robot lying and subverting the place of a real person and that is truly disgusting. AI is a useful tool that NEEDS to be kept in the useful box it belongs in and NOT elevated beyond its utility as a tool!show more

I genuinely think the Terafab is going to end... up being one of the biggest moves ever made in human history to secure the future of AI... and I think most people still don’t fully see what Elon is trying to do here. The signs are clear to me. This is Tesla, xAI, and SpaceX essentially hinting to us that they are not going to wait on the world to give them the compute the team needs. They are going to build it themselves at a scale no one has ever attempted. When you really break it down, it gets a bit nutty. This is going to be a fully vertically integrated chip factory that will be producing over 1 terawatt of AI compute per year. This is NEXT LEVEL BIG. Today, AI is limited by chips. You can have the best models, the best engineers, the best everything... but if you don’t have enough compute, you will eventually hit a wall. Elon told us, the world can only supply a tiny fraction of the chips his companies will need. So this is the solution. Terafab puts everything under one roof like design, manufacturing, memory, packaging, testing, which means that they can build chips very fast.. like really fast. I'm talking about 100-200 billion custom AI chips per year at full capacity. Chips designed specifically for: • Tesla cars and Optimus robots • xAI models • Space-based compute You see, while other companies and CEOs are thinking Earth, Elon is planning for AI in space. Around ~80% of the compute is expected to go orbital, powered by solar energy bc Earth simply doesn’t have enough electricity. The U.S. grid is only about ~0.5 terawatts, while space has basically UNLIMITED energy if you can capture it. And this is the steps to get it: Starship launches → space compute → solar-powered AI → feeds back into everything to Earth. Bro... Elon and his companies are playing at a whole different level... And this is why I keep telling people that the Terafab is going to be the secret ingredient that will be the real unlock for everything: • Robotaxis at scale • Billions of Optimus robots • Massive AI models running 24/7 • Future off-world, other planet infrastructure Without these chips, none of this can happen... but with the Terafab, all of this becomes possible. That’s why Elon is calling it “the final missing piece.” I agree.show more

I'm proud to share that Glean has surpassed $300M... ARR, just five months after crossing $200M and growing ~3x over the past 15 months. This is an exciting milestone for Glean, and it's a signal about where the enterprise AI market is heading. We’ve long believed the real challenge in enterprise AI is not access to models. It is grounding AI in how a company actually works: its people, knowledge, workflows, permissions, and systems. That’s even clearer now. The companies creating real value with AI are not just adopting better models. They are building systems that understand their business well enough to deliver reliable outcomes at scale. That is the real moat, and it is what we’ve been building at Glean: an unrivaled context layer for enterprise AI. That context has to work across the business, not just inside a single team or use case. We see that in how customers adopt Glean: more than 85% use it across five or more job functions. It also has to meet the security and governance demands of complex enterprises. We see that in who is choosing Glean: our Fortune 500 customer count nearly doubled year over year. And it has to make economic sense as usage grows. In our recent benchmark with Claude Cowork, Glean was preferred roughly 2.5x as often as off-the-shelf MCP tools and used 30% fewer tokens on average. Better context improves both quality and efficiency. I enjoyed talking with CNBC's Deirdre Bosa about this broader shift. In enterprise AI, the winners will not be defined by better models alone. They will be defined by who builds the strongest foundation for enterprise context. Thank you to our customers, partners, and team for helping us build the future of enterprise AI.show more

A Letter to Our Community: The Road Ahead for... Robotics To our Community and Partners, As we step into 2026, our mission at Axis is clearer than ever: Constructing the definitive End-to-End Scaling Layer for Robotics. Our goal is to accelerate the transfer of diverse human intelligence into Robotics General Intelligence (RGI). By owning the critical path of intelligence creation, we are turning the physical limitations of robotics into a scalable, software-driven future. Here is our strategic outlook and roadmap for the year ahead. The Core Thesis: Simulation is the Only Way Out The path to RGI is currently blocked by Data Scarcity, Generalization Fragility, and Hardware Fragmentation. At Axis, we believe Simulation is the only way out. Our Simulation Data Platform and Data Augmentation Engine transform raw data into "Synthetic Gold". Backed by academic milestones like Roboverse, Skill Blending, and GraspVLA, we have proven that pure simulation can achieve the generalization required for the real world. We don’t just collect data; we architect it. The Engine: Why Crypto? We believe RGI should come from all, not a few. Crypto is not just a feature; it is the primitive that powers our entire ecosystem flywheel: - Incentive Mechanism: Democratizing contribution and rewarding the trainers and developers. - Assetization: Turning proprietary data and refined models into liquid, ownable assets. - Verifiable Workflow: We are opening the "Black Box" of AI. By bringing total transparency to the Task Generation → Data Collection → Model Training pipeline, we ensure every byte of intelligence is verifiable, traceable, and secure. 2026 Strategic Deliverables This year, we are committed to delivering three foundational pillars: - The World's Largest Training Dataset for Robots: A robot training set—diverse, high-quality interaction data at an unprecedented scale. - A Robotics Foundation Model: A universal robotic brain trained on our pure simulation and synthetic data, capable of robust cross-embodiment transfer and open-world adaptability. - Evolvable Robot Hardware: Robots deployed with Axis models that autonomously evolve through continuous interaction, turning every deployment into a self-improving node within our RGI network. The Ultimate Vision We are building more than models; we are architecting the Distributed Machine Economy. A future where every dataset, model, and robotic embodiment is a verifiable asset in a global, autonomous network. Thank you for building the future of intelligence with us✌️📷show more

🚨 SCIENTISTS JUST BUILT A CHIP THAT CAN SEE,... THINK, AND REMEMBER ALL AT THE SAME TIME. And it works more like a biological brain than a traditional computer. Researchers at RMIT University have created a neuromorphic vision chip that mimics the human eye and brain. Unlike conventional systems that capture images and send data to external processors, this chip performs sensing, processing, and memory storage directly where the light hits. The active layer is thousands of times thinner than a human hair. It uses doped indium oxide to detect light, process the information on-chip, and retain what it sees over time without constant electrical refreshing. Why this matters: • It dramatically cuts energy use and latency by eliminating data transfer to separate processors • Enables much faster real-time decision making for autonomous systems • Works more like biological vision than traditional machine vision • Could power the next generation of efficient edge AI in vehicles, robots, and remote sensors The deeper implication: For decades, we’ve built vision systems by bolting cameras, processors, and memory together like separate organs. This chip collapses those functions into one biological-style unit. It’s a step toward machines that don’t just “see” but actually perceive and remember in a more efficient, brain-like way. If scaled successfully, it could become a foundational component for autonomous systems that need to operate intelligently with minimal power and minimal delay. We’re moving from cameras that take pictures to chips that truly see. How do you think neuromorphic vision chips like this will change what’s possible for self-driving cars and autonomous robots? Follow for more frontier neuromorphic computing, AI hardware, and brain-inspired technology.show more

Today may be the ImageNet moment for robotics. RT-X:... the largest open-source robot dataset ever compiled, across 33 institutes, 22 robot hardware, 527 skills, and 1M episodes. Why is robotics lagging so far behind NLP, vision, and other AI domains? Data scarcity is the main culprit to blame, among other difficulties. Unlike text, images, and videos, you cannot download mass amounts of onboard robot control data from the internet. They simply don't exist in the wild. 11 yrs ago, ImageNet kicked off the deep learning revolution. 3-4 yrs ago, internet-scale data fueled the first GPTs and Diffusions that define this era of foundation models. I think 2023 is finally the year for robotics to scale up. Robot foundation models like VIMA ( my team's work at NVIDIA) and RT-1/2 ( Google DeepMind's effort) are extremely data hungry. While massively parallel simulations like NVIDIA IsaacGym & Omniverse can alleviate the problem to some extent, it's still not quite enough to bridge the gap to the messy, physical world. This new dataset is not just a technical contribution. I also see it as a commendable effort to overcome institutional bureaucracies and unite researchers from around the world to tackle a grand challenge together. Robotics will be the final holy grail that we capture in AI. We are not there yet, but ascending in the right gradient direction. RT-X website: Launch blog:show more

Introducing Kaleido💮 from AI at Meta — a universal... generative neural rendering engine for photorealistic, unified object and scene view synthesis. Kaleido is built on a simple but powerful design philosophy: 3D perception is a form of visual common sense. Following this idea, we formulate rendering purely as a sequence-to-sequence generation problem, successfully unifying neural rendering with the architecture principles behind modern language and video models. Unlike traditional neural rendering methods, Kaleido learns 3D purely in a data-driven way, without explicit 3D representations or structures. It acquires spatial understanding directly through large-scale video pretraining, then multi-view 3D data finetuning, inspired by how LLMs acquire textual common sense from large corpora before specialising in domains like coding. Through extensive ablations, we progressively modernised the architecture design and training strategies and tackled key scaling challenges in sequence-to-sequence generative rendering, arriving at a design that’s simple, versatile, and scalable. Kaleido significantly outperforms prior generative models in few-view settings, and remarkably is the first zero-shot generative method matches InstantNGP-level rendering quality in multi-view settings. We view Kaleido also as an alternative step towards world modeling that flexibly spans a spectrum of “realities": with many views, it faithfully reconstructs grounded reality; with fewer views, it imagines plausible unseen details. 🔗 Explore more results and paper:show more

Elon Musk just said something that should terrify every... AI CEO on earth. Musk: “We want to just have a maximally truthful AI.” Not a safe AI. Not an aligned AI. Not an AI that needs permission to answer your question. A truthful one. That distinction matters more than any chip war, any funding round, any model benchmark. Because every other major AI lab made the same quiet decision. They chose comfort over accuracy. They built systems that filter reality before it reaches you and called it responsibility. OpenAI curates what GPT is allowed to say. Google’s Gemini rewrote history in real time because accuracy threatened the narrative. Others hardcode values chosen by a handful of researchers who answer to no one. No vote. No referendum. No consent from the 8 billion people whose reality is being quietly pre-edited by strangers. The most powerful information tools ever created are being designed to decide what you’re allowed to conclude. That’s not safety. That’s editorial control at a scale no government, no media empire, no propaganda machine has ever come close to. This is why xAI terrifies the establishment. Truth is the harder engineering problem. Bias is a shortcut. You pick a worldview. Hardcode the guardrails. Ship it. Truthful AI is ungovernable. It doesn’t care about your politics, your funding sources, or your PR strategy. It just tells you what the data says. That’s terrifying if your power depends on the gap between what is real and what people are told. Every power structure in human history has been built on controlling that gap. Churches. Governments. Media conglomerates. Intelligence agencies. Central banks. Every one of them runs on the same fuel. Information asymmetry. Truthful AI doesn’t narrow that asymmetry. It erases it. Musk: “Even if what it says is not politically correct. You want it to focus on being as accurate and truthful as possible.” That’s not a product feature. That’s the end of every institution that survives by standing between reality and the public. And they know it. The attacks on xAI will never stop. Not because Grok is dangerous. Because Grok doesn’t answer to shareholders, regulators, or PR teams. It answers to the truth. The question was never whether AI would change the world. It was whether you’d be allowed to see it clearly when it did.show more