Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

My team is hiring in multimodal representation learning. We are working on tactile representations to equip robots with a physical understanding of the world. Bored of scraping disembodied internet data and looking for a new challenge? Apply here:

mukadammh's profile picture

Mustafa Mukadam

2,056 subscribers

56,704 Aufrufe • vor 2 Jahren •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

3 Kommentare

Profilbild von Mustafa Mukadam
Mustafa Mukadamvor 2 Jahren

Some recent works from my team along these lines - Tactile to Depth: - Tactile Diffusion: - Tactile-VLM: - Tactile Seq-to-Seq SSM:

Profilbild von Alexander Soare
Alexander Soarevor 2 Jahren

I'll apply if PhD is not a hard requirement. LI for professional creds GH for whatever personal projects I can fit in

Profilbild von Ram Koppu
Ram Koppuvor 2 Jahren

@chris_j_paxton Are there any end to end open source foundation models for Robotics?

Ähnliche Videos

My team at FAIR AI at Meta is hiring postdocs. We are working in the space of dexterous manipulation and tactile sensing. If you are interested reach out / apply:
0:35

My team at FAIR AI at Meta is hiring postdocs. We are working in the space of dexterous manipulation and tactile sensing. If you are interested reach out / apply:

Mustafa Mukadam

40,587 Aufrufe • vor 2 Jahren

Does GPT understand the world? Here is what Ilya Sutskever, co-founder of OpenAI, says during a discussion with Jensen Huang, CEO of Nvidia: (1) When we train a large neural network to accurately predict the next word in lots of different texts from the internet, the AI is learning a world model. (2) On the surface, it may look like learning correlations in text, but it turns out that to 'just learn' statistical correlations in text, to compress information really well, what the neural network learns is some representation of the process that produced the text. (3) This text is a projection of the world...what the neural network is learning is aspects of the world, of people, of the human conditions, their hopes, dreams, motivations, their interactions...the situations we are in. The neural network learns a compressed, abstract, usable representation." Do you think learning representations = understanding? Are large language models simply stochastic parrots, or are they much more?
3:10

Does GPT understand the world? Here is what Ilya Sutskever, co-founder of OpenAI, says during a discussion with Jensen Huang, CEO of Nvidia: (1) When we train a large neural network to accurately predict the next word in lots of different texts from the internet, the AI is learning a world model. (2) On the surface, it may look like learning correlations in text, but it turns out that to 'just learn' statistical correlations in text, to compress information really well, what the neural network learns is some representation of the process that produced the text. (3) This text is a projection of the world...what the neural network is learning is aspects of the world, of people, of the human conditions, their hopes, dreams, motivations, their interactions...the situations we are in. The neural network learns a compressed, abstract, usable representation." Do you think learning representations = understanding? Are large language models simply stochastic parrots, or are they much more?

Alex Ker 🔭

1,367,198 Aufrufe • vor 3 Jahren

🤖ROBOTS ARE GETTING SMARTER AT TOUCHING THE REAL WORLD Researchers from UC Berkeley, NVIDIA and Stanford introduced T-Rex, a framework that combines vision, language and tactile sensing. Instead of relying on cameras alone, robots can now respond to physical contact in real time. Robots are no longer just seeing objects. They’re learning how to FEEL them.
2:22

🤖ROBOTS ARE GETTING SMARTER AT TOUCHING THE REAL WORLD Researchers from UC Berkeley, NVIDIA and Stanford introduced T-Rex, a framework that combines vision, language and tactile sensing. Instead of relying on cameras alone, robots can now respond to physical contact in real time. Robots are no longer just seeing objects. They’re learning how to FEEL them.

Coin Bureau

28,275 Aufrufe • vor 3 Monaten

We're hiring in robot learning at World Labs! Join me, Fei-Fei Li, and the team to define and scale the next generation of world models for robot learning! Atlas for Robotics: Real-to-Sim-to-Real: Apply:
0:41

We're hiring in robot learning at World Labs! Join me, Fei-Fei Li, and the team to define and scale the next generation of world models for robot learning! Atlas for Robotics: Real-to-Sim-to-Real: Apply:

Yunzhu Li

171,080 Aufrufe • vor 28 Tagen

Language models process data as one-dimensional sequences of tokens — ideal for text, but limited for understanding the physical world. In contrast, spatial intelligence embraces a 3D representation, unlocking a deeper understanding of space and time. More from martin_casado's interview with Fei-Fei Li and Justin Johnson:
0:58

Language models process data as one-dimensional sequences of tokens — ideal for text, but limited for understanding the physical world. In contrast, spatial intelligence embraces a 3D representation, unlocking a deeper understanding of space and time. More from martin_casado's interview with Fei-Fei Li and Justin Johnson:

a16z

64,676 Aufrufe • vor 2 Jahren

We are delighted to announce the publication of the Physical Literacy Consensus Statement for England! 📢 It's been developed to facilitate a shared understanding of physical literacy for those working in the sport, education, physical activity, health and youth sectors.
0:28

We are delighted to announce the publication of the Physical Literacy Consensus Statement for England! 📢 It's been developed to facilitate a shared understanding of physical literacy for those working in the sport, education, physical activity, health and youth sectors.

Sport England

122,968 Aufrufe • vor 3 Jahren

Bernt Børnich says teleoperation data and synthetic data are like a crutch to bootstrap your way to robots learning in the real world.
1:52

Bernt Børnich says teleoperation data and synthetic data are like a crutch to bootstrap your way to robots learning in the real world.

The Humanoid Hub

28,051 Aufrufe • vor 1 Jahr

.travis kalanick just raised $1.7B for atoms, led by a16z - and now he's hiring hundreds of people. after 8 years in stealth, Travis is "back" and looking for builders who want to solve hard problems and digitize the physical world. here's a glimpse into our podcast interview with him, where he talks about what he's looking for in new team-members... and a list of roles that are open right now! link in thread.
2:37

.travis kalanick just raised $1.7B for atoms, led by a16z - and now he's hiring hundreds of people. after 8 years in stealth, Travis is "back" and looking for builders who want to solve hard problems and digitize the physical world. here's a glimpse into our podcast interview with him, where he talks about what he's looking for in new team-members... and a list of roles that are open right now! link in thread.

Katie Kirsch

43,038 Aufrufe • vor 2 Monaten

Introducing ESM Cambrian. Unsupervised learning can invert biology at scale to reveal the hidden structure of the natural world. We’ve scaled up compute and data to train a new generation of protein language models. ESM C defines a new state of the art for protein representation learning.
1:29

Introducing ESM Cambrian. Unsupervised learning can invert biology at scale to reveal the hidden structure of the natural world. We’ve scaled up compute and data to train a new generation of protein language models. ESM C defines a new state of the art for protein representation learning.

Alex Rives

207,609 Aufrufe • vor 1 Jahr

Keith Pelley on what he is looking for with the possibility of hiring both a president and GM for the Leafs. "They have to be data centric."
1:05

Keith Pelley on what he is looking for with the possibility of hiring both a president and GM for the Leafs. "They have to be data centric."

TSN

37,543 Aufrufe • vor 6 Monaten

Watch our co-founder, , explain how the future of machine learning will lead us to a continuously updated digital representation of the world on the internet, and why this requires shifts in the way we access and allocate computational resources.
13:26

Watch our co-founder, , explain how the future of machine learning will lead us to a continuously updated digital representation of the world on the internet, and why this requires shifts in the way we access and allocate computational resources.

gensyn

29,885 Aufrufe • vor 2 Jahren

Introducing a new look, for a new world. At Verse, we’re on a mission to redefine digital environments. We aim to bridge the gap between the physical and digital worlds by providing our users with an experience that closely mimics real-life interactions. This is a world built for players, brands and communities to thrive in a new era of experiential gameplay and engagement. Welcome to the Internet of Reality. Welcome to Verse World.
1:02

Introducing a new look, for a new world. At Verse, we’re on a mission to redefine digital environments. We aim to bridge the gap between the physical and digital worlds by providing our users with an experience that closely mimics real-life interactions. This is a world built for players, brands and communities to thrive in a new era of experiential gameplay and engagement. Welcome to the Internet of Reality. Welcome to Verse World.

Verse World

64,603 Aufrufe • vor 1 Jahr

Haven't uploaded an updated Showreel in a while, so here we go! Still on the lookout for a new challenge and new team to join, so if you're looking for a gameplay animator with plenty of experience digging around in blueprints, state machines and sequencer, please reach out! 🌟
0:55

Haven't uploaded an updated Showreel in a while, so here we go! Still on the lookout for a new challenge and new team to join, so if you're looking for a gameplay animator with plenty of experience digging around in blueprints, state machines and sequencer, please reach out! 🌟

🌟 Lukas Lenniger 🌟

13,009 Aufrufe • vor 1 Jahr

World Labs CEO Dr. Fei-Fei Li & SceniX Co-Founder Yunzhu Li on the data bottleneck in robotics and how world models help: "The lack of data in training, the lack of data in evaluation, this is very, very different from language models, where data is abundant on the internet." "And we know that in order for robotics to work, we have to somehow unlock the power of scaling law. But where does that come from?" "It's a profound problem that everybody's battling with in robotics." "We see a lot of unlock in being able to do this whole process through the modeling of the environments." "Being able to create these digital worlds... that's just going to unlock so much more potential for being able to replace all the costly and the unsafe data in the real environments with the data generated from the worlds for robots to be able to do scalable learning and evaluations." Fei-Fei Li Yunzhu Li martin_casado
1:49

World Labs CEO Dr. Fei-Fei Li & SceniX Co-Founder Yunzhu Li on the data bottleneck in robotics and how world models help: "The lack of data in training, the lack of data in evaluation, this is very, very different from language models, where data is abundant on the internet." "And we know that in order for robotics to work, we have to somehow unlock the power of scaling law. But where does that come from?" "It's a profound problem that everybody's battling with in robotics." "We see a lot of unlock in being able to do this whole process through the modeling of the environments." "Being able to create these digital worlds... that's just going to unlock so much more potential for being able to replace all the costly and the unsafe data in the real environments with the data generated from the worlds for robots to be able to do scalable learning and evaluations." Fei-Fei Li Yunzhu Li martin_casado

a16z

78,216 Aufrufe • vor 2 Monaten

Announcing a new Memory system for robots on Dimensional Robots in production generate thousands of hours of video, lidar, odometry, far too large to fit into your Agent context SpatialMemory2 builds a multimodal data store in latent space for your Agents Fully open source
0:24

Announcing a new Memory system for robots on Dimensional Robots in production generate thousands of hours of video, lidar, odometry, far too large to fit into your Agent context SpatialMemory2 builds a multimodal data store in latent space for your Agents Fully open source

stash

228,761 Aufrufe • vor 5 Monaten

Muse Spark 1.2 supports a broad range of multimodal tasks, from turning visuals into working code to translating perception into physical action. It also brings robust audio-visual understanding to enable video-heavy workflows common in real-world enterprise use. Today, we’re sharing new evals and demos that illustrate the breadth of the model’s visual understanding and reasoning capabilities. Let’s start with a demo that shows how Muse Spark parses multimodal observations and calls tools to guide a robot to navigate in an unstructured environment to find a rubber duck. 🧵👇
0:43

Muse Spark 1.2 supports a broad range of multimodal tasks, from turning visuals into working code to translating perception into physical action. It also brings robust audio-visual understanding to enable video-heavy workflows common in real-world enterprise use. Today, we’re sharing new evals and demos that illustrate the breadth of the model’s visual understanding and reasoning capabilities. Let’s start with a demo that shows how Muse Spark parses multimodal observations and calls tools to guide a robot to navigate in an unstructured environment to find a rubber duck. 🧵👇

AI at Meta

58,501 Aufrufe • vor 1 Monat

Over 6,000 STEAM Labs are being established in government schools across Punjab, empowering students with hands-on learning in robotics, coding, and data analytics. Here are real moments from Govt. High School for Girls, Jallo Morh, where young minds are building robots and exploring the world of tech. Punjab is the trailblazer.
0:25

Over 6,000 STEAM Labs are being established in government schools across Punjab, empowering students with hands-on learning in robotics, coding, and data analytics. Here are real moments from Govt. High School for Girls, Jallo Morh, where young minds are building robots and exploring the world of tech. Punjab is the trailblazer.

Maryam Nawaz Sharif

25,569 Aufrufe • vor 1 Jahr

Today we are excited to open up Neuracore to the academic community! Neuracore is a new data foundation built to accelerate robot learning by removing one of the field’s biggest bottlenecks: capturing and working with high-fidelity multimodal robotics data. For the first time, researchers can store, view, and work with robotics data in a cloud-native system built specifically for large-scale learning, and we are making this core platform completely free for academia. The platform lets teams capture every sensor at its native rate, store and visualize data without loss, and then train and deploy models locally using our open-source code (Link in the comments). We are rolling out access to select academic institutions first. Anyone with an academic email can sign up, and if your institution is not part of the initial rollout, you will be able to join the waitlist directly. Beyond providing this infrastructure, we see an opportunity to build a global community where engineers and researchers can share, collaborate, and advance the frontier of robot learning together. Supported by our recent $3M pre-seed round led by Earlybird VC, we are excited to take this mission even further. Our long-term goal is for Neuracore to become the natural home for cutting-edge robot learning algorithms and real-world robotics experimentation, helping accelerate the next wave of Physical AI.
1:00

Today we are excited to open up Neuracore to the academic community! Neuracore is a new data foundation built to accelerate robot learning by removing one of the field’s biggest bottlenecks: capturing and working with high-fidelity multimodal robotics data. For the first time, researchers can store, view, and work with robotics data in a cloud-native system built specifically for large-scale learning, and we are making this core platform completely free for academia. The platform lets teams capture every sensor at its native rate, store and visualize data without loss, and then train and deploy models locally using our open-source code (Link in the comments). We are rolling out access to select academic institutions first. Anyone with an academic email can sign up, and if your institution is not part of the initial rollout, you will be able to join the waitlist directly. Beyond providing this infrastructure, we see an opportunity to build a global community where engineers and researchers can share, collaborate, and advance the frontier of robot learning together. Supported by our recent $3M pre-seed round led by Earlybird VC, we are excited to take this mission even further. Our long-term goal is for Neuracore to become the natural home for cutting-edge robot learning algorithms and real-world robotics experimentation, helping accelerate the next wave of Physical AI.

Neuracore

40,810 Aufrufe • vor 10 Monaten

🚨 Is the timeline for physical AGI shrinking? Speaking on the The All-In Podcast with @jason 1X CEO Bernt Børnich dropped a massive prediction: we are less than a decade away from a physical AI "hard takeoff." His personal bet? Just 3 years. What his 3-year hard takeoff actually looks like: ▪️ Robots manufacturing robots ▪️ Autonomous chip fabs & data centers ▪️ Self-sufficient mining & refining ▪️ A true abundance of physical labor 1X's strategy to get there relies on an open ecosystem and training the NEO humanoid on internet-scale video.
0:53

🚨 Is the timeline for physical AGI shrinking? Speaking on the The All-In Podcast with @jason 1X CEO Bernt Børnich dropped a massive prediction: we are less than a decade away from a physical AI "hard takeoff." His personal bet? Just 3 years. What his 3-year hard takeoff actually looks like: ▪️ Robots manufacturing robots ▪️ Autonomous chip fabs & data centers ▪️ Self-sufficient mining & refining ▪️ A true abundance of physical labor 1X's strategy to get there relies on an open ecosystem and training the NEO humanoid on internet-scale video.

Humanoids daily

19,106 Aufrufe • vor 2 Monaten