Загрузка видео...

Не удалось загрузить видео

На главную

Excited to share that our work NeuralActuator: Neural Actuation Modeling for Robot Dynamics and External Force Perception has been accepted to #RSS2026! Your robot — even a low-cost one — can feel external forces without torque or tactile sensors. TL;DR: NeuralActuator is a neural actuator model that jointly predicts...

51,006 просмотров • 5 месяцев назад •via X (Twitter)

Комментарии: 10

Фото профиля Zhiyang (Frank) Dou
Zhiyang (Frank) Dou5 месяцев назад

Robot dynamics, [ M(q)\ddot q + C(q,\dot q)\dot q + g(q) = \tau + \tau_{\mathrm{ext}}, ] suggest that motion, motor torques, and external interactions are tightly coupled. In principle, this coupling enables external forces to be inferred from the robot’s state and actuation. But on low-cost robot platforms, exploiting this relationship is hard: the linear current–torque model often breaks down during target tracking due to friction, hysteresis, backlash, and thermal effects. We propose NeuralActuator, a learning-based method with differentiable simulation for actuator modeling, enabling accurate dynamics modeling, sensorless force estimation, and motor condition estimation.

Фото профиля Zhiyang (Frank) Dou
Zhiyang (Frank) Dou5 месяцев назад

Sincere thanks to all our collaborators: John U. Onyemelukwe, Hangxing Zhang, Heng Zhang, Minghao Guo @GuoMh14, Yunsheng Tian @yunshengtian, Michal Piotr Lipiec, Joshua Jacob, Chao Liu, Peter Yichen Chen @peterchencyc , Yuri Ivanov, and Wojciech Matusik. @wojmatusik 🙌

Фото профиля Jack Miller
Jack Miller5 месяцев назад

Is there a link to the paper?

Фото профиля Zhiyang (Frank) Dou
Zhiyang (Frank) Dou5 месяцев назад

Yes! We are working on the camera-ready one. Will release it very soon.

Фото профиля Junhua Yao(Watson)
Junhua Yao(Watson)5 месяцев назад

coool

Фото профиля ζ Pedram ζ
ζ Pedram ζ5 месяцев назад

@RemiCadene Awesome

Фото профиля Nick K
Nick K5 месяцев назад

@NepYope Wait… dynamixel XM motors ARE linear wrt current and torque output though???

Фото профиля Zhiyang (Frank) Dou
Zhiyang (Frank) Dou5 месяцев назад

Yes, at the motor level, torque is usually modeled as \tau = K_t I, where K_t​ is the torque constant and I is the motor current. This seems to be supported by the ROBOTIS performance graph as well: However, in practice, for these relatively low-cost servo actuators, the relationship between current and actual output torque during operation is not very cleanly linear. It can be quite noisy and nonlinear due to gearbox friction, backlash, saturation, current-control behavior, voltage variation, and other actuator-level effects. The figure below shows the simulation-based surrogate torque (derived from a differentiable simulation) and the measured current for each joint. Note that it is very difficult to directly measure ground-truth torque on this kind of robotic arm. From the plots, we can see that the surrogate torque and current do not follow a simple linear relationship very well.

Фото профиля Nick K
Nick K5 месяцев назад

@NepYope That is true, but I’ve literally measured different torque outputs from those actuators when they’re bolted down to tables. When the current controller is active, it’s linear. Like R^2=.99 linear. For lower cost servos, it’s a little curved (it’s a sqrt function), also R^2=.99

Фото профиля Zhiyang (Frank) Dou
Zhiyang (Frank) Dou5 месяцев назад

@NepYope Yes, but the measurement is taken while the entire robotic arm is moving and executing the task. In this setting, all motors are part of the articulated structure of the robotic arm, which is different from measuring each motor directly in isolation.

Похожие видео

Sharpa Robotics just dropped a new hand video and the level keeps going up. This is the Sharpa Wave running WM Craftnet on a human scale fivefinger hand with 22 active DoF. The policy combines wrist depth, tactile sensing, proprioception and previous actions. The hand can rotate different objects in-hand, recover after external pushes and continue manipulating objects it was never trained on. The numbers are strong. 175/200 successful real-world rotation trials across 20 objects. A world-model prior trained on 9 objects was transferred to 49 new objects. Fall rate went from 6% to 0.3%. The Wave hardware itself has 22 actuators, up to 20 N fingertip force, 240×240 tactile sensing at up to 180 fps and 0.02 N pressure sensitivity. What caught my attention is the recovery behavior. The fingers keep changing contact points after the object slips or gets pushed instead of replaying the same finger motion. That is the kind of dexterity I want to see more of in robotic hands. According to Sharpa’s current specifications: • DTA tactile sensors on the fingers with a resolution of up to 240 × 240 • Pressure detection • Slip detection • Force change detection • Contact point localization • 6-axis force and torque measurement: Fx, Fy, Fz, Mx, My, Mz • Tactile sensing at up to 180 fps • 20 ms reported latency • Force detection range from 0 to 30 N • Maximum sensor load of 50 N • Sharpa also describes a miniature camera integrated into each fingertip for visuo-tactile sensing.

Techniahqrobot | humanoid robots

13,500 просмотров • 17 дней назад

Force-sensing fingers! 🧤 Stanford researchers just released UMI-FT, a handheld data collection platform that puts compact six-axis force/torque sensors on each finger, enabling finger-level wrench measurements alongside RGB, depth, and pose data. Many manipulation tasks require careful force modulation: too little force and the task fails, too much and you cause damage. But commercial force/torque sensors are expensive, bulky, and fragile, which has limited large-scale force-aware policy learning. UMI-FT changes the economics. The platform uses an iPhone for RGB vision, ultrawide RGB, depth, and pose via ARKit, with each finger sensorized using a CoinFT sensor to capture per-finger wrench information during manipulation. This multimodal data trains an adaptive compliance policy that predicts position targets, grasp force, and stiffness for execution on standard compliance controllers. The learned policy runs slowest and generates reference targets, while model-based compliance and force controllers provide delicate 6D compliance control and real-time force modulation. They tested on three contact-rich, force-sensitive tasks: whiteboard wiping (locate eraser, grasp, wipe until clean), skewering zucchini (grasp slice firmly, push onto stick until punctured), and lightbulb insertion (grasp bulb, align bayonet pin with socket slit, insert while overcoming spring force, rotate to light up). The results are clear. Policies without compliance struggle to modulate contact force and trigger safety faults from excessive force. Policies without force sensing fail to grasp unseen objects or resist reaction forces, causing slippage. Here's the project page: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

12,868 просмотров • 8 месяцев назад

Excited to announce GR00T N1, the world’s first open foundation model for humanoid robots! We are on a mission to democratize Physical AI. The power of general robot brain, in the palm of your hand - with only 2B parameters, N1 learns from the most diverse physical action dataset ever compiled and punches above its weight: - Real humanoid teleoperation data. - Large-scale simulation data: we are open-sourcing 300K+ trajectories! - Neural trajectories: we apply SOTA video generation models to “hallucinate” new synthetic data that features accurate physics in pixels. Using Jensen’s words, “systematically infinite data”! - Latent actions: we develop novel algorithms to extract action tokens from in-the-wild human videos and neural generated videos. GR00T N1 is a single end-to-end neural net, from photons to actions: - Vision-Language Model (System 2) that interprets the physical world through vision and language instructions, enabling robots to reason about their environment and instructions, and plan the right actions. - Diffusion Transformer (System 1) that “renders” smooth and precise motor actions at 120 Hz, executing the latent plan made by System 2. We deploy N1 on GR1 robot, 1X Neo robot, and a large collection of simulation benchmarks. N1 achieves up to +30% boost in diverse manipulation tasks for household and industrial settings. While humanoid robots are the main focus of N1, our model also supports cross-embodiment. We finetune it to work on the $110 HuggingFace LeRobot SO100 robot arm! Open robot brain runs on open hardware. Sounds just right. Let’s solve robotics, together, one token at a time. Links to our Whitepaper, Github repo, HuggingFace model, and open dataset page in the thread: 🧵

Jim Fan

467,596 просмотров • 1 год назад