Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Introducing GAIA-2 🌎Generative world modeling just stepped up a gear. GAIA-2 is the latest development of Wayve’s video-generative world model tailored for driving. GAIA-2 offers richer, more realistic, and highly controllable synthetic driving scenarios, accelerating Wayve’s path to safe driver assistance and automated driving at scale. Learn more about...

41,662 Aufrufe • vor 1 Jahr •via X (Twitter)

11 Kommentare

Profilbild von Wayve
Wayvevor 1 Jahr

5-camera view 🎦GAIA-2 is breaking new ground with this surround camera view that is reflective of a real-world camera array. Most importantly, the videos are temporally and spatially coherent, which is critical for safety tests. #GAIA2

Profilbild von Wayve
Wayvevor 1 Jahr

Increased controllability 🎮 GAIA-2 offers more control over all scene features like the ego-vehicle behavior, the behavior of other road agents, and environmental factors like road structure, weather, and time of day. See how we can manipulate the time of day and weather in the video below. #GAIA2

Profilbild von Wayve
Wayvevor 1 Jahr

Expanded Diversity! 🗺️ GAIA-2 is trained on a global dataset, multiple vehicle platforms, and various sensor configurations. That means GAIA-2 can generate driving scenes from Germany, UK, US, cars, vans, etc. #GAIA2

Profilbild von Wayve
Wayvevor 1 Jahr

Generating Safety-Critical Scenarios! 🦺You might not need emergency braking everyday, but it is a safety-critical manoeuvre. Using GAIA-2, we can simulate multiple common safety-critical scenarios, generating rare and high-risk events that can be impractical or unsafe to capture through real-world data collection alone. #GAIA2

Profilbild von Wayve
Wayvevor 1 Jahr

Learn how GAIA-2 accelerates Wayve’s path to safe driver assistance and autonomous driving at scale. Blog 🔗

Profilbild von AssemblyAI
AssemblyAIvor 1 Jahr

Announcing: Our most advanced speech-to-text model goes beyond accuracy to capture the real-world complexity of human conversation and deliver reliable, source-of-truth audio data. Explore Universal-2 updates 👇

Profilbild von James95113983
James95113983vor 1 Jahr

Sorry to keep asking this, radar? lidar? Or camera-only for future driverless operations?

Profilbild von Robert Scoble
Robert Scoblevor 1 Jahr

After going to GTC, seeing the latest autonomous driving simulator from @waabi, and watching @Wayve 's progress, it's clear that Elon was right years ago: that every auto maker will eventually be able to do AI driving. That said, even if every one of them added that capability today (they aren't, most are years away from including the computers and cameras in car to do this) they don't have the fleet size to do a Robotaxi network. And traditional automakers aren't selling enough electric cars (which is where these things will be first included) to get to a fleet of millions of cars anytime soon. And the fleet size is very important for finishing off the job, and getting rid of mistakes that can't be predicted in simulators. The fleet size is also important for another range of things, including AI assistants. Right now there are dozens of Teslas on the Golden Gate Bridge, for instance. So, if a crash happens there, who will be able to tell you first about it? Even better, who will be able to route their Robotaxis around such a thing, or give more accurate predictions for how long it'll take you to get across the bridge this morning? Or, who will be able to show you near real time videos of what's actually happening on the bridge? Right now it's not obvious about why all that is so important, but by the end of next year it will be. Robots are about to radically change our world. The one who has the most robots on the street will have information advantages for years until the others are able to sell millions of robots for the street. When I was young, my best friend was killed in a car crash when he fell asleep. I've dreamed of a day when that no longer was going to happen, and that day is coming. But when Uber was invented right in front of me in a Paris snowstorm, it set in motion a new dream: of transportation as a service because now we can see that we can make transportation much better and cheaper. Which is what the @waymo customers keep telling me: they don't want to own another car or take a ride in a vehicle with another human in it (when I'm in San Francisco and see people get out of Waymos I interview them about their experience). If you come to San Francisco you see just how deeply Waymo is changing that city. The rides per month keep going up in an exponential way. Today that hasn't hit my neighborhood, or yours, but over the next three years it probably will (Uber went from an idea in a Paris snowstorm to something that people around the world used in three years). In five, we will be in a totally different transportation world and there will be winners and losers. But, really, the market for all that that matters is China. It has nine cities larger than New York in population. So whoever wins in China will have a huge operational advantage. Last week Tesla sold 17,000 vehicles there: all robots. And I've been watching, and talking to people on the street in China that are watching this all go down and Tesla's FSD is out performing the Chinese manufacturers, none of which have announced a vehicle without a steering wheel yet. Understanding all this makes me even more bullish on Tesla, since its Cybercab will be the most efficient (translates into cheapest) to operate per mile and have the best experience while doing so. This is why Tesla's stock hasn't crashed, and has gone up about 25% in the past week, even though liberals are angry at Elon Musk (that problem doesn't exist on the streets of China). It is the only non Chinese manufacturer that is doing well in China, which really is the only market that matters. Anyone see a real Robotaxi competitor coming that will be able to get 10s of millions of vehicles onto the world's streets by 2027? I don't. But am watching, and ready to change my thesis. That all said: the news from Wayve is hugely exciting because it will lead to fewer deaths on our world's roads and is amazing AI engineering. Congrats @Jamie_Shotton and team!

Profilbild von tanguy
tanguyvor 1 Jahr

cool

Profilbild von Anda
Andavor 1 Jahr

Fascinating! A world model that learns to drive like a panda learns bamboo groves – through endless curious exploration of possible paths.

Profilbild von Nedsky
Nedskyvor 1 Jahr

Not so many yet talking about @wayve_ai!

Ähnliche Videos

Today we're announcing #GAIA1: a 9B parameter world model, trained on 4,700 hours of driving data, able to simulate complex and diverse driving scenes from video, text and action inputs. This model is 480x larger than the preview we shared earlier this year and the results are incredible. These videos are entirely synthetically generated by Wayve's generative AI, GAIA-1. But there is more here than just generating videos, GAIA is an entire world model. A world model allows us to simulate the future, conditioned on video, text and action inputs, which can be leveraged for making informed decisions when driving. Why is this game-changing for autonomous driving? 1. Safety. One limitation with AI systems like today's Large Language Models is that they are autoregressive, next-word prediction algorithms, but aren't necessarily aware of the implications of their decisions. A world model allows us to give our AI the capability to be aware of its decisions, by simulating the future, which is important for self-driving safety. 2. Synthetic training data. I believe synthetic training data is the future for AI, because it is safer, cheaper, and infinitely scalable. GAIA-1 unlocks unprecedented realism and diversity of synthetic data for self-driving. 3. Long-tail robustness. One of the biggest challenges for self-driving is long-tail robustness: dealing with the enormous magnitude of edge cases we see on the road. An advantage of generative AI is its incredible ability to recombine experiences in new ways. This is exciting for self-driving as it means we can learn from two edge case scenarios, and combine them to become a corner case. For example, we can experience driving in fog, and experience of jay-walking pedestrians, and GAIA can learn from these experiences to understand how to generate a fog+jay walking scenario. Check out many more videos in our blog or further technical details in our paper: Or come chat with our team who are at the International Conference on Computer Vision (#ICCV2023) this week in Paris in Booth 32 Jamie Shotton

Alex Kendall

631,856 Aufrufe • vor 2 Jahren

Today, we’re thrilled to introduce GAIA, a modular creation engine for the AI age. At its core, GAIA is a multiplayer creation engine designed to bring democratized Generative AI abilities to everyone, hence its name. It abstracts away the complexities of leveraging open-source software, hardware requirements, and technical intricacies, allowing creators to focus solely on creating, together. GAIA has been instrumental in powering the imagination and creative works of our studio, significantly boosting productivity, collaboration, and creativity. It has saved our team thousands of man-days in production work, enabling us to dream bigger, bolder, and execute more swiftly. When used by experienced creators, GAIA, with its ever-growing toolsets built by core contributors, stands to be the best AI creative co-pilot for industry-specific production workflows—from gaming to fashion, and from personal consumption to real estate renderings. GAIA's self-reinforcing flywheel is poised to dramatically enhance the platform's capabilities in both the near and long term: The cost of GPUs and compute will continue to improve. Open-source AI models are becoming increasingly powerful over time, as seen by the evolution from Stable Diffusion 1 to Lightning, alongside other impressive OSS creations like AnimateDiff, LoRAs, and ControlNet. The architecture of AI workflows will become more fine-grained, allowing exponentially increasing control over final outputs. The data and connections that AI workflows can make, both in-app and out-of-app, will grow more sophisticated. GAIA already allows for the chaining of Generative Image AI recipes, grouping complex node-based programs into simple consumer-facing interfaces. Soon, with multi-modality workflows, creators will be able to leverage not only images but also text and sound to create even more complex workflows. Today is the least capable GAIA will ever be. It already provides superpowers unachievable by many creators who know how to harness them. We have an extremely exciting backlog of features lined up, starting with social features. Our mission as Ather Collective core contributors is to get GAIA into the hands of as many creators and businesses as possible. While we believe in e/acc, our north star for Ather Collective remains: Equitable, Accessible, Composable, and Collaborative. If you would like to be a part of the early access users of GAIA, please register using this link: Our team will open up capacity as soon as we are able to. There is only one way AI benefits humanity, and that’s through open AI. Let’s be a part of it. ✌🏻

TIN | Sipher Odyssey & Ather Labs

14,194 Aufrufe • vor 2 Jahren

NEWS: Waymo has released a new blog post detailing their AI strategy and how it’s allowing them to bring service to more riders faster. "Achieving demonstrably safe AI — where safety is proven, not just promised — requires a holistic approach. Beyond a smart and capable Driver, you also need a closed-loop, realistic Simulator to train and rigorously test the Driver in a myriad of challenging situations, and a sharp Critic to evaluate the Driver's performance and identify areas for improvement." Waymo says that autonomous driving isn’t just a matter of building a “smart driver,” but rather creating a full AI ecosystem centered on safety from the ground up. At the core is the Waymo Foundation Model, a unified world-model that powers all major components of Waymo’s autonomous stack (Driver, Simulator, Critic). "By using a “Think Fast/Think Slow” architecture (combining rapid sensor-fusion with deep semantic reasoning), this system enables the car to detect complex and rare road scenarios (e.g. a burning vehicle ahead), reason about them, and choose safe behavior. Waymo trains large “Teacher” AI-models for driving, simulation, and evaluation, then distills them into smaller, efficient “Student” models suitable for real-world deployment, while keeping safety validation tightly integrated. The result is a continuous “flywheel” of learning: driving data (real and simulated) generate feedback, which leads to refinements, more simulation, more data, and only when safety checks pass is new code deployed. Having already exceeded 100 million fully autonomous miles, Waymo reports a more than ten-fold reduction in severe-injury crashes compared to human drivers." Full blog post:

Sawyer Merritt

83,618 Aufrufe • vor 7 Monaten