Загрузка видео...

Не удалось загрузить видео

На главную

Announcing a new Memory system for robots on Dimensional Robots in production generate thousands of hours of video, lidar, odometry, far too large to fit into your Agent context SpatialMemory2 builds a multimodal data store in latent space for your Agents Fully open source

stash_pomichter's profile picture

stash

8,338 subscribers

227,736 просмотров • 1 месяц назад •via X (Twitter)

Новости и политикаОбразованиеНаука и технологии
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Vibecode your robots on Dimensional. Simple demo of our physical agent stack running on the Unitree go2 quadruped. Developers can now program physical space & build dimensional applications via natural language. Fully open source.
3:34

Vibecode your robots on Dimensional. Simple demo of our physical agent stack running on the Unitree go2 quadruped. Developers can now program physical space & build dimensional applications via natural language. Fully open source.

stash

32,271 просмотров • 4 месяцев назад

Announcing the Dimensional Residency in Shenzhen. Deploy agents into the physical world. Real customers. Real deployments. We provide robots, $10,000 of LLM credits, free housing, office space, and customer intros to jumpstart your robotics company.
0:39

Announcing the Dimensional Residency in Shenzhen. Deploy agents into the physical world. Real customers. Real deployments. We provide robots, $10,000 of LLM credits, free housing, office space, and customer intros to jumpstart your robotics company.

stash

32,495 просмотров • 2 месяцев назад

Someone just put OpenClaw inside a Unitree G1 humanoid — and it walks. Same agent framework running on your phone. Now integrated with lidar, stereo + RGB cameras, understanding 3D space and temporal context. Works on drones and quadrupeds too. Fully open source. Cool work! Video Source: stash
0:32

Someone just put OpenClaw inside a Unitree G1 humanoid — and it walks. Same agent framework running on your phone. Now integrated with lidar, stereo + RGB cameras, understanding 3D space and temporal context. Works on drones and quadrupeds too. Fully open source. Cool work! Video Source: stash

Bo Wang

102,442 просмотров • 3 месяцев назад

3rd Place: GrokWorld uses Grok Imagine as a world model to generate synthetic training data for robots — augmenting or replacing months of manual collection in hours. Aptura AI
1:48

3rd Place: GrokWorld uses Grok Imagine as a world model to generate synthetic training data for robots — augmenting or replacing months of manual collection in hours. Aptura AI

xAI

845,968 просмотров • 4 месяцев назад

We’re launching Judgment Labs today and announcing $32M in funding. As AI agents take on more of the work that creates economic value, they generate massive amounts of production data: the clearest record of how they behave with users, software, and the real world. Judgment builds infrastructure for improving AI agents from production data.
2:00

We’re launching Judgment Labs today and announcing $32M in funding. As AI agents take on more of the work that creates economic value, they generate massive amounts of production data: the clearest record of how they behave with users, software, and the real world. Judgment builds infrastructure for improving AI agents from production data.

Alex Shan

3,518,099 просмотров • 1 месяц назад

[Open Source] Unitree First View Teleoperation for Humanoid Robots In order to advance the convenience of data collection for humanoid robots, we refer to other solutions to do the adaptation development and open source. Github： #Unitree #Humanoid #AGI #AI #EmbodiedIntelligence #Manipulation #Teleoperation #DataCollection
0:38

[Open Source] Unitree First View Teleoperation for Humanoid Robots In order to advance the convenience of data collection for humanoid robots, we refer to other solutions to do the adaptation development and open source. Github： #Unitree #Humanoid #AGI #AI #EmbodiedIntelligence #Manipulation #Teleoperation #DataCollection

Unitree

116,509 просмотров • 1 год назад

Announcing Agent Bricks: auto-optimize agents for your domain tasks. Provide a high-level description of the agent’s task, and connect your enterprise data — Agent Bricks handles the rest. Agent Bricks builds out an agent system that automatically optimizes against your goals and generates domain-specific synthetic datasets, accelerating agent development without relying on manual labeling or external sources.
0:24

Announcing Agent Bricks: auto-optimize agents for your domain tasks. Provide a high-level description of the agent’s task, and connect your enterprise data — Agent Bricks handles the rest. Agent Bricks builds out an agent system that automatically optimizes against your goals and generates domain-specific synthetic datasets, accelerating agent development without relying on manual labeling or external sources.

Databricks

47,044 просмотров • 1 год назад

My team is hiring in multimodal representation learning. We are working on tactile representations to equip robots with a physical understanding of the world. Bored of scraping disembodied internet data and looking for a new challenge? Apply here:
0:30

My team is hiring in multimodal representation learning. We are working on tactile representations to equip robots with a physical understanding of the world. Bored of scraping disembodied internet data and looking for a new challenge? Apply here:

Mustafa Mukadam

56,700 просмотров • 2 лет назад

Your Openclaw / Agent can now control multiple robots in realtime. We’ve abstracted and standardized all hardware and control interfaces so your agent can run our spatial tool calls on ANY robot. Fleet command of humanoid, quadruped, xARM, and Piper arm in unison. Fully open source.
0:35

Your Openclaw / Agent can now control multiple robots in realtime. We’ve abstracted and standardized all hardware and control interfaces so your agent can run our spatial tool calls on ANY robot. Fleet command of humanoid, quadruped, xARM, and Piper arm in unison. Fully open source.

stash

16,999 просмотров • 3 месяцев назад

Excited to announce RoboCasa, a large-scale simulation framework of everyday tasks! We use generative AI tools to create diverse objects, scenes, and tasks. Simulation plays a pivotal role in our Data Pyramid for training generalist robots. Open-source at
0:34

Excited to announce RoboCasa, a large-scale simulation framework of everyday tasks! We use generative AI tools to create diverse objects, scenes, and tasks. Simulation plays a pivotal role in our Data Pyramid for training generalist robots. Open-source at

Yuke Zhu

141,478 просмотров • 2 лет назад

China begins large-scale production of AI robots for warehouses.
0:31

China begins large-scale production of AI robots for warehouses.

Globe Eye News

59,464 просмотров • 1 год назад

Announcing Dimensional: the open-source OS for physical space. Command any robot in natural language. Program atoms, not bits.
1:36

Announcing Dimensional: the open-source OS for physical space. Command any robot in natural language. Program atoms, not bits.

stash

193,329 просмотров • 7 месяцев назад

New short course Multimodal RAG: Chat with Videos, developed with Intel and taught by vasudevlal! In this course, you’ll work with LLaVA (Large Language and Vision Assistant), a Large Vision Language Model (LVLM) that can process both images and text. For example, given an image of a person doing a handstand on a skateboard at the beach, LLaVA doesn't just caption the scene, it’s able to predict possible outcomes, like the person losing balance or falling off. By understanding not just what's in a video frame, but what might happen next, your application can provide more insightful answers to questions about video. You'll build a full multimodal RAG pipeline that can chat about video content: - Use the BridgeTower model to create joint text-image embeddings in a 512-dimensional multimodal semantic space. - Learn video processing techniques to extract keyframes, generate transcripts using Whisper, and create captions. - Use the LanceDB vector database to store and retrieve high-dimensional multimodal embeddings. - Integrate the LLaVA model, combining CLIP's (Contrastive Language Image Pretraining) vision transformer with Llama, for advanced visual-textual reasoning. Your final system will ingest video data, generate embeddings for frames and text, perform similarity searches for relevant content, and use the retrieved multimodal context to inform LVLM-based response generation. The result is a system capable of answering nuanced questions about video content, effectively chatting about the video it has processed. Please sign up here!
2:40

New short course Multimodal RAG: Chat with Videos, developed with Intel and taught by vasudevlal! In this course, you’ll work with LLaVA (Large Language and Vision Assistant), a Large Vision Language Model (LVLM) that can process both images and text. For example, given an image of a person doing a handstand on a skateboard at the beach, LLaVA doesn't just caption the scene, it’s able to predict possible outcomes, like the person losing balance or falling off. By understanding not just what's in a video frame, but what might happen next, your application can provide more insightful answers to questions about video. You'll build a full multimodal RAG pipeline that can chat about video content: - Use the BridgeTower model to create joint text-image embeddings in a 512-dimensional multimodal semantic space. - Learn video processing techniques to extract keyframes, generate transcripts using Whisper, and create captions. - Use the LanceDB vector database to store and retrieve high-dimensional multimodal embeddings. - Integrate the LLaVA model, combining CLIP's (Contrastive Language Image Pretraining) vision transformer with Llama, for advanced visual-textual reasoning. Your final system will ingest video data, generate embeddings for frames and text, perform similarity searches for relevant content, and use the retrieved multimodal context to inform LVLM-based response generation. The result is a system capable of answering nuanced questions about video content, effectively chatting about the video it has processed. Please sign up here!

Andrew Ng

107,548 просмотров • 1 год назад

Agents can now understand physical space and temporality on Dimensional. Input: “Find the model airplane” With SpatioTemporal RAG, our agent has an emergent understanding of objects, stairwells, and obstacles in latent space.
0:35

Agents can now understand physical space and temporality on Dimensional. Input: “Find the model airplane” With SpatioTemporal RAG, our agent has an emergent understanding of objects, stairwells, and obstacles in latent space.

stash

10,145 просмотров • 4 месяцев назад

New short course: LLMs as Operating Systems: Agent Memory, created with Letta, and taught by its founders Charles Packer and Sarah Wooders. An LLM's input context window has limited space. Using a longer input context also costs more and results in slower processing. So, managing what's stored in this context window is important. In the innovative paper MemGPT: Towards LLMs as Operating Systems, its authors (which include the instructors) proposed using an LLM agent to manage this context window. Their system uses a large persistent memory that stores everything that could be included in the input context, and an agent decides what is actually included. Take the example of building a chatbot that needs to remember what's been said earlier in a conversation (perhaps over many days of interaction with a user). As the conversation's length grows, the memory management agent will move information from the input context to a persistent searchable database; summarize information to keep relevant facts in the input context; and restore relevant conversation elements from further back in time. This allows a chatbot to keep what's currently most relevant in its input context memory to generate the next response. When I read the original MemGPT paper, I thought it was an innovative technique for handling memory for LLMs. The open-source Letta framework, which we'll use in this course, makes MemGPT easy to implement. It adds memory to your LLM agents and gives them transparent long-term memory. In detail, you’ll learn: - How to build an agent that can edit its own limited input context memory, using tools and multi-step reasoning - What is a memory hierarchy (an idea from computer operating systems, which use a cache to speed up memory access), and how these ideas apply to managing the LLM input context (where the input context window is a "cache" storing the most relevant information; and an agent decides what to move in and out of this to/from a larger persistent storage system) - How to implement multi-agent collaboration by letting different agents share blocks of memory This course will give you a sophisticated understanding of memory management for LLMs, which is important for chatbots having long conversations, and for complex agentic workflows. Please sign up here!
2:57

New short course: LLMs as Operating Systems: Agent Memory, created with Letta, and taught by its founders Charles Packer and Sarah Wooders. An LLM's input context window has limited space. Using a longer input context also costs more and results in slower processing. So, managing what's stored in this context window is important. In the innovative paper MemGPT: Towards LLMs as Operating Systems, its authors (which include the instructors) proposed using an LLM agent to manage this context window. Their system uses a large persistent memory that stores everything that could be included in the input context, and an agent decides what is actually included. Take the example of building a chatbot that needs to remember what's been said earlier in a conversation (perhaps over many days of interaction with a user). As the conversation's length grows, the memory management agent will move information from the input context to a persistent searchable database; summarize information to keep relevant facts in the input context; and restore relevant conversation elements from further back in time. This allows a chatbot to keep what's currently most relevant in its input context memory to generate the next response. When I read the original MemGPT paper, I thought it was an innovative technique for handling memory for LLMs. The open-source Letta framework, which we'll use in this course, makes MemGPT easy to implement. It adds memory to your LLM agents and gives them transparent long-term memory. In detail, you’ll learn: - How to build an agent that can edit its own limited input context memory, using tools and multi-step reasoning - What is a memory hierarchy (an idea from computer operating systems, which use a cache to speed up memory access), and how these ideas apply to managing the LLM input context (where the input context window is a "cache" storing the most relevant information; and an agent decides what to move in and out of this to/from a larger persistent storage system) - How to implement multi-agent collaboration by letting different agents share blocks of memory This course will give you a sophisticated understanding of memory management for LLMs, which is important for chatbots having long conversations, and for complex agentic workflows. Please sign up here!

Andrew Ng

200,729 просмотров • 1 год назад

Introducing Expect Test your agent code in a real browser Works with your agent. Fully open source
0:28

Introducing Expect Test your agent code in a real browser Works with your agent. Fully open source

Aiden Bai

73,293 просмотров • 2 месяцев назад

Openclaw / Agents can now command ANY robot to grasp objects via language Integrate dimensional with your personal agent to unlock the physical world Fully open source. Join the hundreds of developers already vibecoding atoms
1:09

Openclaw / Agents can now command ANY robot to grasp objects via language Integrate dimensional with your personal agent to unlock the physical world Fully open source. Join the hundreds of developers already vibecoding atoms

stash

19,412 просмотров • 2 месяцев назад

ELON: GROK TO ORCHESTRA-CONDUCT THOUSANDS OF OPTIMUS ROBOTS BUILDING FACTORIES & REFINERIES Elon just laid out the vision: Grok will act as the "orchestra conductor" directing massive teams of Optimus robots, potentially thousands, to construct huge projects like factories or rare earth refineries. “For managing a large team of Optimus robots to build a factory or a refinery, a hypothetical rare earth refinery which we desperately need in America, you start asking who’s going to manage all of that. That’s where AI comes in.” Source: Tesla
0:57

ELON: GROK TO ORCHESTRA-CONDUCT THOUSANDS OF OPTIMUS ROBOTS BUILDING FACTORIES & REFINERIES Elon just laid out the vision: Grok will act as the "orchestra conductor" directing massive teams of Optimus robots, potentially thousands, to construct huge projects like factories or rare earth refineries. “For managing a large team of Optimus robots to build a factory or a refinery, a hypothetical rare earth refinery which we desperately need in America, you start asking who’s going to manage all of that. That’s where AI comes in.” Source: Tesla

Mario Nawfal

87,502 просмотров • 4 месяцев назад

Can robots self-improve by collecting data autonomously🤖? Introducing SOAR: a system for large-scale autonomous data collection 🚀 and autonomous improvement📈of a multi-task language-conditioned policy in diverse scenes without human interventions .
1:36

Can robots self-improve by collecting data autonomously🤖? Introducing SOAR: a system for large-scale autonomous data collection 🚀 and autonomous improvement📈of a multi-task language-conditioned policy in diverse scenes without human interventions .

Paul Zhou

47,667 просмотров • 1 год назад

The Context Cloud for agents is here. Introducing the new supermemory. A new way to do context, for your agents Everything you need for context - Memory, RAG, Filesystems, Profiles, are now available as blocks you can compose to build something for your use case
5:27

The Context Cloud for agents is here. Introducing the new supermemory. A new way to do context, for your agents Everything you need for context - Memory, RAG, Filesystems, Profiles, are now available as blocks you can compose to build something for your use case

Dhravya Shah

87,100 просмотров • 16 дней назад