Загрузка видео...

Не удалось загрузить видео

На главную

Tesla vehicles and Optimus share core technology: Actuators Power electronics Battery Manufacturing Data communication Audio system Cameras A14/A15 chips Training cluster Neural simulation Real-world AI

19,499 просмотров • 8 месяцев назад •via X (Twitter)

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

A new 30-minute presentation from Ashok Elluswamy, Tesla’s VP of AI, has been released, where he talks about FSD, AI and the team’s latest progress. Highlight from the presentation: • Tesla's vehicle fleet can provide 500 years of driving data every single day. Curse of Dimensionality: • 8 cameras at high frame rate = billions of tokens per 30 seconds of driving context. • Tesla must compress and extract the right correlations between sensory input and control actions. Data Advantage: • Tesla has access to a “Niagara Falls of data” — hundreds of years’ worth of collective fleet driving. • Uses smart data triggers to capture rare corner cases (e.g., complex intersections, unpredictable behavior). Quality and Efficiency: • Extracts only the essential data needed to train models efficiently. Debugging and Interpretability: • Even though the system is end-to-end, Tesla can still prompt the model to output interpretable data: 3D occupancy, road boundaries, objects, signs, traffic lights, etc. • Natural language querying: ask the model why it made a certain decision. • These auxiliary predictions don’t drive the car but help engineers debug and ensure safety. Tesla’s Advanced Gaussian Splatting (3D Scene Modeling): • Tesla developed a custom, ultra-fast Gaussian splatting system to reconstruct 3D scenes from limited camera views. • Produces crisp, accurate 3D renderings even from few camera angles — far better than standard NeRF/splatting approaches. • Enables rapid visual debugging of the driving environment in 3D. Evaluation & World Models: • Evaluation is the hardest challenge: models may perform well offline but fail in real-world conditions. • Tesla builds balanced, diverse evaluation datasets focusing on edge cases — not just easy highway driving. Introduced a learned world simulator (neural network-generated video engine): • Can simulate 8 Tesla camera feeds simultaneously — fully synthetic. • Used for testing, training, and reinforcement learning. • Allows adversarial event injection (e.g., adding a pedestrian or vehicle cutting in). • Enables replaying past failures to verify new model improvements. • Can run in near real-time, letting testers “drive” inside a simulated world. What’s Next: • Scale robotaxi service globally. • Unlock full autonomy across the entire Tesla fleet. • Cybercab: next-gen 2-seat vehicle designed specifically for robotaxi use, targeting lowest transportation cost (cheaper than public transit). • Same neural networks will power Optimus humanoid robot. • The same video generation system is now being applied to Optimus. • The system can simulate and plan movement for robots, adapting easily to new forms. via the International Conference on Computer Vision (ICCV). Full presentation:

Sawyer Merritt

1,286,614 просмотров • 8 месяцев назад

Elon just dropped a MAJOR nugget on how Tesla is going to be training Optimus to do real world tasks. They are building an Optimus Academy, which is a large scale, dedicated real-world training facility to accelerate the development of Optimus. The Academy will deploy thousands of Optimus units, potentially 10,000 to 30,000 robots, in a controlled realistic environment where they perform self-play, experiment with tasks, iterate on behaviors, and continuously generate training data through trial and error. The Tesla bots will also run millions of simulations in Tesla’s high-fidelity physics-accurate engine, allowing Optimus to close the “sim-to-real gap” by using these real-world observations to refine and validate the simulations! “You’re actually highlighting an important limitation and difference from cars. We’ll soon have 10 million cars on the road. It’s hard to duplicate that massive training flywheel. For the robot, what we’re going to need to do is build a lot of robots and put them in kind of an Optimus Academy so they can do self-play in reality. We’re actually building that out. We can have at least 10,000 Optimus robots, maybe 20-30,000, that are doing self-play and testing different tasks. Tesla has quite a good reality generator, a physics-accurate reality generator, that we made for the cars. We’ll do the same thing for the robots. We actually have done that for the robots. So you have a few tens of thousands of humanoid robots doing different tasks. You can do millions of simulated robots in the simulated world. You use the tens of thousands of robots in the real world to close the simulation to reality gap. Close the sim-to-real gap.”

Teslaconomics

42,563 просмотров • 5 месяцев назад

Data has always been the bottleneck for physical AI in self driving and robotics. Tesla is taking two very different approaches for FSD and Optimus. Tesla’s Optimus Training Playbook: 1. Build 30k Optimus Gen 3 robots 2. Operate them in a mock environment where they can perform self-play “Optimus Academy” 3. Train in sim using the real robot data to close sim2real gap. Tesla FSD Training Playbook: 1. Sell millions of cars outfitted with cheap cameras 2. Collect diverse real world driving data (especially intervention and failure recovery data) for free as a byproduct of customers driving the cars. 3. Use driving data to train Autopilot/FSD and deploy policies incrementally as a supervised FSD product 4. Repeat until policy reaches robust unsupervised full self driving for robotaxi launch. The Tesla FSD playbook is a beautiful self-funding, customer subsidized, diverse real world data flywheel. The Optimus playbook is the opposite and shares none of the beautiful attributes of the FSD training flywheel that made FSD successful. The key differences: 1. Instead of having customers pay you for vehicles, Tesla will need to fund 30,000 Optimus robots. Assuming the current landed cost per unit is $100k, that will be $3B to build plus another ~30% per year for maintenance labor and spare parts given it’s still an unhardened pre-production prototype is another $900M per year. For reference, Tesla’s GAAP net income in 2025 was $3.8B. 2. Instead of having customers drive their Teslas on roads all across the world giving Tesla an insanely rich and diverse dataset that Waymo and other AV companies could never collect, the Optimus Academy is doing the equivalent of building a fake town in a parking lot and driving their car in that parking lot. No matter how real you try to make the environments for self-play you can never replicate the diversity, complexity and failure modes of the real world. Data collected in staged environments produces demo-grade policies and will not be rich enough to generalize to the vast diversity of environments, tasks, objects, etc. out of distribution. 3. Instead of having customers collect real world failure recovery data (DAgger style) for free every time FSD disengages, the Optimus Academy will need paid teleoperators or onsite operators to collect the recovery data. Assuming 1 person can manage 2 robots to start that would cost $3.5B in labor per year (30,000 robots, $40/hr fully loaded, 16 hrs/day, 365 days per year, 2:1 robot:operator). Tesla can come up with the money to do this but money doesn’t solve the “mock data” problem. Given the higher degrees of freedom in humanoids vs. cars, training a generalized humanoid will be harder and require more data than a self-driving vehicle. The best way to train your robot is by deploying them in the diverse real world, subsidized by real customer operations. Humanoids face a chicken and egg where it’s very hard to bootstrap your way to a first policy that’s good enough to deploy in real production environments. This is an extremely capital intensive playbook (which doesn’t even include cost of training). Time will tell if it works but a better playbook would be finding a way to copy the FSD playbook.

Simon Kalouche

34,671 просмотров • 5 месяцев назад

🚨 BREAKING: ABB Robotics + NVIDIA close the sim-to-real gap with 99% accuracy! 👾 ABB Robotics is integrating NVIDIA Omniverse libraries into RobotStudio to deliver physical AI for industry, closing the gap from virtual training to real-world deployment with up to 99% accuracy. RobotStudio HyperReality, available second half of 2026, will fundamentally change how quickly manufacturers can scale production: reducing costs by up to 40%, accelerating time-to-market by 50%, and cutting setup and commissioning times by up to 80%. For decades, the deficit between simulation accuracy and real-world lighting, materials, and environments has limited manufacturers' ability to design advanced manufacturing processes in the virtual world. The only robot manufacturer with a virtual controller running the same firmware as the hardware, ensuring near-perfect correlation between simulation and real-world performance. The system uses physically accurate simulations and foundation models endlessly optimized with real-world data feedback. These models can train any number of ABB robots anywhere in the world with industrial-grade reliability. Foxconn is using RobotStudio HyperReality for consumer electronics assembly. Assembly robots are trained virtually using synthetic data to perfect multiple production processes across various scenarios, then moved to production lines with 99% accuracy. This eliminates physical training and tests, reducing setup times and costs. Workr is demonstrating AI-powered robotic systems at NVIDIA GTC 2026. Built on ABB technology, trained with synthetic data using NVIDIA Omniverse, deployed without operators needing programming knowledge . 🚨 I’ll be onsite in San Jose during GTC 2026, and will be showing all the cool stuff that ABB Robotics prepared this year! Can’t wait! 🫡 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

22,482 просмотров • 4 месяцев назад

🔥 JUST IN: Open-source robotics dataset from 100% real-world scenarios! 🤯 Chinese robotics company AGIBOT just released AGIBOT WORLD 2026, an open-source dataset systematically covering key embodied AI research directions. Built entirely from real-world environments: commercial spaces, and homes. Collected using AGIBOT G2 robots in free-form collection mode, providing structured, accurately annotated, high-quality data. Digital twin technology creates 1:1 scale replicas in simulation matching the real environments. Both real-world and simulation data are open-sourced. The AGIBOT G2 platform collects multiple data types simultaneously: RGB(D) cameras, tactile sensors, force sensors, LiDAR, IMU, and full-body joint states. Whole-body control coordinates arms, waist, and hands for complex tasks. First-person teleoperation lets operators control the robot from its perspective. The tasks covered are fine-grained manipulation, ultra-long-horizon tasks, spatial navigation, dual-arm coordination, and multi-agent/human-robot collaboration. The dataset includes error-recovery trajectories with annotations. Most datasets only show successful demonstrations. AGIBOT includes failures and how the robot recovers, teaching models how to handle mistakes. After collection, data is tested through policy training and real-robot deployment to ensure quality. Then processed through industrial quality control with multiple screening and cleaning rounds. Making it open-source accelerates embodied AI research by giving researchers access to high-quality real-world robot data at scale. 🇨🇳 Learn more here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

40,583 просмотров • 3 месяцев назад

"Optimus will be the biggest product ever." - Elon Musk AND THIS IS HOW HE'S GOING TO DO IT.... REDEFINING LABOR ON EARTH The core mission of Optimus is to take over dangerous, repetitive, and monotonous work, making advanced automation accessible to everyone and fundamentally changing what human labor looks like. As a first step, Tesla plans to deploy 1,000 Optimus robots inside the cleanrooms of its new Terafab chip facility by 2027, with the goal of cutting human manufacturing errors by 90%. PRODUCTION TIMELINES & PRICING Musk has outlined a clear ramp: limited production is targeted for 2025, starting with more than 1,000 units for internal use across Tesla factories. External sales to other companies could begin in 2026. By 2027, Tesla aims to start high-volume production at Gigafactory Texas with a target of 10 million robots per year. Ultimately, Musk wants to bring the consumer price down to roughly $20,000–$30,000. "GEN 3" DEXTERITY UPGRADES The robot's hardware is advancing quickly. Tesla recently introduced the Gen 3 hands, which feature 22 degrees of freedom and 50 total actuators — roughly doubling the dexterity of earlier versions. These new hands include tactile fingertip sensors with force-torque feedback, enabling Optimus to handle delicate items such as eggs or glass vials without damaging them. THE "DIGITAL OPTIMUS" BRAIN To give the robot both physical skill and real intelligence, Tesla and xAI are developing an architecture called "Digital Optimus" (sometimes referred to internally as Macrohard). It uses a dual-process system: Tesla's vision-based driving AI serves as "System 1," handling fast, instinctive physical actions and balance. xAI's Grok model acts as "System 2," managing high-level reasoning, task planning, and natural conversation. NEXT-GENERATION SILICON Running powerful AI models on a mobile robot requires extreme efficiency. Optimus will be powered by Tesla's upcoming AI5 and AI6 edge-inference chips (produced at the Terafab facility), delivering 40 to 50 times the compute performance of today's chips while keeping power consumption low enough for all-day operation. LUNAR COLONIZATION AND SPACE OPERATIONS While earlier plans called for sending Optimus robots to Mars in 2026, SpaceX has shifted initial focus toward establishing a Moon colony first. Under Musk's "Kardashev Blueprint," large fleets of Optimus robots — referred to as "Optimi" — will be deployed to the lunar surface. Working autonomously around the clock, they will construct habitats, manufacture space-based AI satellites, and build a massive electromagnetic mass driver to launch the "Starmind" AI constellation into deep space.

Lacey

66,117 просмотров • 13 дней назад