Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Come to our #SIGGRAPH2026 talk today: Our method turns existing 3D objects into multi-touch sensors, without modifying the interior. From a scan, we sample surface-intrinsic curves that conform to mutual-cap layouts, and optimize their intersections for coverage & fabrication.

53,043 Aufrufe • vor 3 Monaten •via X (Twitter)

19 Kommentare

Profilbild von Christian Holz
Christian Holzvor 3 Monaten

Our method formulates sensor design as constrained curve routing on a 3D mesh. We generate two layers of surface-intrinsic Tx/Rx curves. Through integer optimization, we select a fabrication-ready subset with uniform coverage under sensing, hardware, and geometry constraints.

Profilbild von Christian Holz
Christian Holzvor 3 Monaten

For fabrication, we unfold the 3D curves into 2D traces, vinyl-cut them from thin Kapton-copper laminate, and use projection guidance for attachment. Our fabricated bunny, mouse, bowl, and spoon achieve mean touch errors of just 0.65-1.6 mm and strong SNR.

Profilbild von Christian Holz
Christian Holzvor 3 Monaten

Andela Ilic, J. Gao, Z. Li, Y. Jiang, R. Schuchert, M. Meier, P. Herholz, C. Holz. Retrofitting Existing 3D Objects with Surface-Conforming Capacitive Sensing. ACM SIGGRAPH 2026. project: arXiv:

Profilbild von LF0
LF0vor 3 Monaten

Fun! 1000 great ideas possible with that

Profilbild von Pathetic Brook
Pathetic Brookvor 3 Monaten

This is cool as hell.

Profilbild von Furkan+
Furkan+vor 3 Monaten

Wow so cool

Profilbild von EsotericHustler
EsotericHustlervor 3 Monaten

this is so cyberpunk (endearing) i can't even.

Profilbild von amy
amyvor 3 Monaten

So cool

Profilbild von sanjay prasad hs
sanjay prasad hsvor 3 Monaten

Oh wow! Can this also detect pressure and other things, not just touch? , But it also probably senses temperature and pressure as well. Then you could probably put this on a lot of stuff for VR and AR tech, right?

Profilbild von Christian Holz
Christian Holzvor 3 Monaten

It also detects pressure right now in the form of increased coupling, but more as an artifact due to our fabrication not by design. It's a clear direction for future work though, exactly for input control in AR/MR.

Profilbild von MrManderly
MrManderlyvor 3 Monaten

Very cool. The bunny deserves to have ear rubs too though.

Profilbild von Christian Holz
Christian Holzvor 3 Monaten

challenging for surface routing due to bottleneck in geometry but working on this for v2

Profilbild von Mohamed Sami Zeghdar
Mohamed Sami Zeghdarvor 3 Monaten

Amazing concept, it can add new dimensions to input devices. Have you thought about bringing space mouse capabilities to standard ones via touch?

Profilbild von Frankenbyte
Frankenbytevor 3 Monaten

Using the projection for sensor print placement is pretty innovative. Nice.

Profilbild von Christian Holz
Christian Holzvor 3 Monaten

Only way we found to make sure the physical sensor precisely works the way the optimized design generated, though there's got to be easier ways to get that part done in the future...

Profilbild von Makr3D
Makr3Dvor 3 Monaten

Sampling conductive layouts along the existing surface is a clever way to keep the object geometry intact. The fabrication question is especially interesting: how tolerant is the method of rougher FDM surfaces and layer texture compared with a smooth scanned part?

Profilbild von Jake↑↑↑
Jake↑↑↑vor 3 Monaten

@lushptr we need the inverse of this for robotic sensing

Profilbild von Christian Holz
Christian Holzvor 3 Monaten

@lushptr Yes! That's the reason we've developed this... as a labeling technique for hand-object contact and force.

Profilbild von Jake↑↑↑
Jake↑↑↑vor 3 Monaten

@lushptr oh wow, youre going to do very well

Ähnliche Videos

One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization paper page: Single image 3D reconstruction is an important but challenging task that requires extensive knowledge of our natural world. Many existing methods solve this problem by optimizing a neural radiance field under the guidance of 2D diffusion models but suffer from lengthy optimization time, 3D inconsistency results, and poor geometry. In this work, we propose a novel method that takes a single image of any object as input and generates a full 360-degree 3D textured mesh in a single feed-forward pass. Given a single image, we first use a view-conditioned 2D diffusion model, Zero123, to generate multi-view images for the input view, and then aim to lift them up to 3D space. Since traditional reconstruction methods struggle with inconsistent multi-view predictions, we build our 3D reconstruction module upon an SDF-based generalizable neural surface reconstruction method and propose several critical training strategies to enable the reconstruction of 360-degree meshes. Without costly optimizations, our method reconstructs 3D shapes in significantly less time than existing methods. Moreover, our method favors better geometry, generates more 3D consistent results, and adheres more closely to the input image. We evaluate our approach on both synthetic data and in-the-wild images and demonstrate its superiority in terms of both mesh quality and runtime. In addition, our approach can seamlessly support the text-to-3D task by integrating with off-the-shelf text-to-image diffusion models.

AK

179,061 Aufrufe • vor 3 Jahren

Blended-NeRF: Zero-Shot Object Generation and Blending in Existing Neural Radiance Fields paper page: Editing a local region or a specific object in a 3D scene represented by a NeRF is challenging, mainly due to the implicit nature of the scene representation. Consistently blending a new realistic object into the scene adds an additional level of difficulty. We present Blended-NeRF, a robust and flexible framework for editing a specific region of interest in an existing NeRF scene, based on text prompts or image patches, along with a 3D ROI box. Our method leverages a pretrained language-image model to steer the synthesis towards a user-provided text prompt or image patch, along with a 3D MLP model initialized on an existing NeRF scene to generate the object and blend it into a specified region in the original scene. We allow local editing by localizing a 3D ROI box in the input scene, and seamlessly blend the content synthesized inside the ROI with the existing scene using a novel volumetric blending technique. To obtain natural looking and view-consistent results, we leverage existing and new geometric priors and 3D augmentations for improving the visual fidelity of the final result. We test our framework both qualitatively and quantitatively on a variety of real 3D scenes and text prompts, demonstrating realistic multi-view consistent results with much flexibility and diversity compared to the baselines. Finally, we show the applicability of our framework for several 3D editing applications, including adding new objects to a scene, removing/replacing/altering existing objects, and texture conversion.

AK

62,768 Aufrufe • vor 3 Jahren