正在加载视频...

视频加载失败

Come to our #SIGGRAPH2026 talk today: Our method turns existing 3D objects into multi-touch sensors, without modifying the interior. From a scan, we sample surface-intrinsic curves that conform to mutual-cap layouts, and optimize their intersections for coverage & fabrication.

53,043 次观看 • 3 个月前 •via X (Twitter)

19 条评论

Christian Holz 的头像
Christian Holz3 个月前

Our method formulates sensor design as constrained curve routing on a 3D mesh. We generate two layers of surface-intrinsic Tx/Rx curves. Through integer optimization, we select a fabrication-ready subset with uniform coverage under sensing, hardware, and geometry constraints.

Christian Holz 的头像
Christian Holz3 个月前

For fabrication, we unfold the 3D curves into 2D traces, vinyl-cut them from thin Kapton-copper laminate, and use projection guidance for attachment. Our fabricated bunny, mouse, bowl, and spoon achieve mean touch errors of just 0.65-1.6 mm and strong SNR.

Christian Holz 的头像
Christian Holz3 个月前

Andela Ilic, J. Gao, Z. Li, Y. Jiang, R. Schuchert, M. Meier, P. Herholz, C. Holz. Retrofitting Existing 3D Objects with Surface-Conforming Capacitive Sensing. ACM SIGGRAPH 2026. project: arXiv:

LF0 的头像
LF03 个月前

Fun! 1000 great ideas possible with that

Pathetic Brook 的头像
Pathetic Brook3 个月前

This is cool as hell.

Furkan+ 的头像
Furkan+3 个月前

Wow so cool

EsotericHustler 的头像
EsotericHustler3 个月前

this is so cyberpunk (endearing) i can't even.

amy 的头像
amy3 个月前

So cool

sanjay prasad hs 的头像
sanjay prasad hs3 个月前

Oh wow! Can this also detect pressure and other things, not just touch? , But it also probably senses temperature and pressure as well. Then you could probably put this on a lot of stuff for VR and AR tech, right?

Christian Holz 的头像
Christian Holz3 个月前

It also detects pressure right now in the form of increased coupling, but more as an artifact due to our fabrication not by design. It's a clear direction for future work though, exactly for input control in AR/MR.

MrManderly 的头像
MrManderly3 个月前

Very cool. The bunny deserves to have ear rubs too though.

Christian Holz 的头像
Christian Holz3 个月前

challenging for surface routing due to bottleneck in geometry but working on this for v2

Mohamed Sami Zeghdar 的头像
Mohamed Sami Zeghdar3 个月前

Amazing concept, it can add new dimensions to input devices. Have you thought about bringing space mouse capabilities to standard ones via touch?

Frankenbyte 的头像
Frankenbyte3 个月前

Using the projection for sensor print placement is pretty innovative. Nice.

Christian Holz 的头像
Christian Holz3 个月前

Only way we found to make sure the physical sensor precisely works the way the optimized design generated, though there's got to be easier ways to get that part done in the future...

Makr3D 的头像
Makr3D3 个月前

Sampling conductive layouts along the existing surface is a clever way to keep the object geometry intact. The fabrication question is especially interesting: how tolerant is the method of rougher FDM surfaces and layer texture compared with a smooth scanned part?

Jake↑↑↑ 的头像
Jake↑↑↑3 个月前

@lushptr we need the inverse of this for robotic sensing

Christian Holz 的头像
Christian Holz3 个月前

@lushptr Yes! That's the reason we've developed this... as a labeling technique for hand-object contact and force.

Jake↑↑↑ 的头像
Jake↑↑↑3 个月前

@lushptr oh wow, youre going to do very well

相关视频

One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization paper page: Single image 3D reconstruction is an important but challenging task that requires extensive knowledge of our natural world. Many existing methods solve this problem by optimizing a neural radiance field under the guidance of 2D diffusion models but suffer from lengthy optimization time, 3D inconsistency results, and poor geometry. In this work, we propose a novel method that takes a single image of any object as input and generates a full 360-degree 3D textured mesh in a single feed-forward pass. Given a single image, we first use a view-conditioned 2D diffusion model, Zero123, to generate multi-view images for the input view, and then aim to lift them up to 3D space. Since traditional reconstruction methods struggle with inconsistent multi-view predictions, we build our 3D reconstruction module upon an SDF-based generalizable neural surface reconstruction method and propose several critical training strategies to enable the reconstruction of 360-degree meshes. Without costly optimizations, our method reconstructs 3D shapes in significantly less time than existing methods. Moreover, our method favors better geometry, generates more 3D consistent results, and adheres more closely to the input image. We evaluate our approach on both synthetic data and in-the-wild images and demonstrate its superiority in terms of both mesh quality and runtime. In addition, our approach can seamlessly support the text-to-3D task by integrating with off-the-shelf text-to-image diffusion models.

AK

179,061 次观看 • 3 年前

Blended-NeRF: Zero-Shot Object Generation and Blending in Existing Neural Radiance Fields paper page: Editing a local region or a specific object in a 3D scene represented by a NeRF is challenging, mainly due to the implicit nature of the scene representation. Consistently blending a new realistic object into the scene adds an additional level of difficulty. We present Blended-NeRF, a robust and flexible framework for editing a specific region of interest in an existing NeRF scene, based on text prompts or image patches, along with a 3D ROI box. Our method leverages a pretrained language-image model to steer the synthesis towards a user-provided text prompt or image patch, along with a 3D MLP model initialized on an existing NeRF scene to generate the object and blend it into a specified region in the original scene. We allow local editing by localizing a 3D ROI box in the input scene, and seamlessly blend the content synthesized inside the ROI with the existing scene using a novel volumetric blending technique. To obtain natural looking and view-consistent results, we leverage existing and new geometric priors and 3D augmentations for improving the visual fidelity of the final result. We test our framework both qualitatively and quantitatively on a variety of real 3D scenes and text prompts, demonstrating realistic multi-view consistent results with much flexibility and diversity compared to the baselines. Finally, we show the applicability of our framework for several 3D editing applications, including adding new objects to a scene, removing/replacing/altering existing objects, and texture conversion.

AK

62,768 次观看 • 3 年前