“Capacitive Touch Sensing on General 3D Surfaces”
Conference:
Type(s):
Title:
- Capacitive Touch Sensing on General 3D Surfaces
Presenter(s)/Author(s):
Abstract:
The paper proposes a new method to adapt the common grid of electrodes of a mutual-capacitive sensor to generic 3D surfaces, minimizing the number of controllers and input/output pins. The tested prototypes show precise and robust multi-touch detection with excellent Signal-to-Noise Ratio and spatial accuracy.
References:
[1]
Moritz B?cher, Benjamin Hepp, Fabrizio Pece, Paul G. Kry, Bernd Bickel, Bernhard Thomaszewski, and Otmar Hilliges. 2016. DefSense: Computational Design of Customized Deformable Input Devices. In Proceedings of the CHI Conference on Human Factors in Computing Systems (San Jose, California, USA). ACM, New York, USA, 3806–3816.
[2]
Gary Barrett and Ryomei Omote. 2010. Projected-capacitive touch technology. Information Display 26, 3 (2010), 16–21.
[3]
Jesse Burstyn, Nicholas Fellion, Paul Strohmeier, and Roel Vertegaal. 2015. Printput: Resistive and capacitive input widgets for interactive 3D prints. In IFIP Conference on Human-Computer Interaction. Springer International Publishing, Cham, 332–339.
[4]
Marcel Campen. 2017. Partitioning Surfaces Into Quadrilateral Patches: A Survey. Computer Graphics Forum 36, 8 (2017), 567–588.
[5]
Marcel Campen, David Bommes, and Leif Kobbelt. 2015. Quantized Global Parametrization. ACM Trans. Graph. 34, 6, Article 192 (nov 2015), 12 pages.
[6]
Giorgio Cannata, Marco Maggiali, Giorgio Metta, and Giulio Sandini. 2008. An embedded artificial skin for humanoid robots. In IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems. IEEE, USA, 434–438.
[7]
Tingyu Cheng, Koya Narumi, Youngwook Do, Yang Zhang, Tung D. Ta, Takuya Sasatani, Eric Markvicka, Yoshihiro Kawahara, Lining Yao, Gregory D. Abowd, and HyunJoo Oh. 2020. Silver Tape: Inkjet-Printed Circuits Peeled-and-Transferred on Versatile Substrates. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 1 (March 2020), 1–17.
[8]
Burke Davison. 2010. Techniques for robust touch sensing design. Technical Report. AN1334 Microchip Technology Inc. 53 pages.
[9]
David Eppstein, Michael T. Goodrich, Ethan Kim, and Rasmus Tamstorf. 2008. Motorcycle Graphs: Canonical Quad Mesh Partitioning. Computer Graphics Forum 27, 5 (2008), 1477–1486.
[10]
Jun Gong, Olivia Seow, Cedric Honnet, Jack Forman, and Stefanie Mueller. 2021. MetaSense: Integrating Sensing Capabilities into Mechanical Metamaterial. In The 34th Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 1063–1073.
[11]
Timo G?tzelmann and Christopher Althaus. 2016. TouchSurfaceModels: Capacitive Sensing Objects through 3D Printers. In Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments. ACM, New York, NY, USA, 1–8.
[12]
Tony Gray. 2019. Projected Capacitive Touch. Springer International Publishing, Cham.
[13]
Daniel Groeger and J?rgen Steimle. 2018. ObjectSkin: Augmenting Everyday Objects with Hydroprinted Touch Sensors and Displays. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 4 (Jan. 2018), 1–23.
[14]
Tobias Grosse-Puppendahl, Yannick Berghoefer, Andreas Braun, Raphael Wimmer, and Arjan Kuijper. 2013. OpenCapSense: A rapid prototyping toolkit for pervasive interaction using capacitive sensing. In IEEE International Conference on Pervasive Computing and Communications (PerCom). IEEE Computer Society, Washington, DC, USA, 152–159.
[15]
Tobias Grosse-Puppendahl, Christian Holz, Gabe Cohn, Raphael Wimmer, Oskar Bechtold, Steve Hodges, Matthew S. Reynolds, and Joshua R. Smith. 2017. Finding Common Ground: A Survey of Capacitive Sensing in Human-Computer Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Denver, USA). ACM, New York, NY, USA, 3293–3315.
[16]
LLC Gurobi Optimization. 2018. Gurobi Optimizer Reference Manual. http://www.gurobi.com
[17]
Jefferson Y. Han. 2005. Low-cost Multi-touch Sensing Through Frustrated Total Internal Reflection. In Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology (Seattle, WA, USA). ACM, New York, NY, USA, 115–118.
[18]
Chris Harrison, Hrvoje Benko, and Andrew D. Wilson. 2011a. OmniTouch: Wearable Multitouch Interaction Everywhere. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA). ACM, New York, NY, USA, 441–450.
[19]
Chris Harrison, Julia Schwarz, and Scott E. Hudson. 2011b. TapSense: enhancing finger interaction on touch surfaces. In Proceedings of the 24th annual ACM symposium on User interface software and technology. ACM, New York, NY, USA, 627.
[20]
Liang He, Jarrid A. Wittkopf, Ji Won Jun, Kris Erickson, and Rafael Tico Ballagas. 2022. ModElec: A Design Tool for Prototyping Physical Computing Devices Using Conductive 3D Printing. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5, 4, Article 159 (dec 2022), 20 pages.
[21]
Freddie Hong, Connor Myant, and David E Boyle. 2021. Thermoformed Circuit Boards: Fabrication of Highly Conductive Freeform 3D Printed Circuit Boards with Heat Bending. In Proceedings of the CHI Conference on Human Factors in Computing Systems (Yokohama, Japan). ACM, New York, NY, USA, Article 669, 10 pages.
[22]
Yoshihiro Kawahara, Steve Hodges, Benjamin S. Cook, Cheng Zhang, and Gregory D. Abowd. 2013. Instant Inkjet Circuits: Lab-Based Inkjet Printing to Support Rapid Prototyping of UbiComp Devices. In Proceedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing (Zurich, Switzerland). ACM, New York, NY, USA, 363–372.
[23]
Arshad Khan, Joan Sol Roo, Tobias Kraus, and J?rgen Steimle. 2019. Soft Inkjet Circuits: Rapid Multi-Material Fabrication of Soft Circuits Using a Commodity Inkjet Printer. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA). ACM, New York, NY, USA, 341–354.
[24]
Konstantin Klamka, Raimund Dachselt, and J?rgen Steimle. 2020. Rapid Iron-On User Interfaces: Hands-on Fabrication of Interactive Textile Prototypes. In Proceedings of the CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA). ACM, New York, NY, USA, 1–14.
[25]
Gierad Laput, Eric Brockmeyer, Scott E. Hudson, and Chris Harrison. 2015. Acoustruments: Passive, Acoustically-Driven, Interactive Controls for Handheld Devices. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea). ACM, New York, NY, USA, 2161–2170.
[26]
Andrea Lodi, Silvano Martello, and Michele Monaci. 2002. Two-dimensional packing problems: A survey. European Journal of Operational Research 141, 2 (2002), 241–252.
[27]
Andrea Lodi, Silvano Martello, and Daniele Vigo. 1999. Heuristic and Metaheuristic Approaches for a Class of Two-Dimensional Bin Packing Problems. INFORMS Journal on Computing 11, 4 (1999), 345–357.
[28]
James J. Fitzgibbon Michael C. Brenner. 1985. Surface acoustic wave touch panel system. US Patent US4644100A.
[29]
Microchip. 2012. Sensor Design Guidelines. Retrieved April 25, 2024 from http://ww1.microchip.com/downloads/en/DeviceDoc/FAQs%20-%20Sensor%20Design%20Guidelines.pdf.
[30]
Toshiharu Mukai, Masaki Onishi, Tadashi Odashima, Shinya Hirano, and Zhiwei Luo. 2008. Development of the Tactile Sensor System of a Human-Interactive Robot “RI-MAN”. IEEE Transactions on Robotics 24, 2 (2008), 505–512.
[31]
Ken Museth. 2013. VDB: High-resolution sparse volumes with dynamic topology. ACM Trans. Graph. 32, 3, Article 27 (jul 2013), 22 pages.
[32]
Ashish Myles, Nico Pietroni, Denis Kovacs, and Denis Zorin. 2010. Feature-Aligned T-Meshes. ACM Trans. Graph. 29, 4, Article 117 (jul 2010), 11 pages.
[33]
Simon Olberding, Michael Wessely, and J?rgen Steimle. 2014. PrintScreen: fabricating highly customizable thin-film touch-displays. In Proceedings of the 27th annual ACM symposium on User interface software and technology. ACM, Honolulu, Hawaii, USA, 281–290.
[34]
Gianpaolo Palma, Sara Perry, and Paolo Cignoni. 2021. Augmented Virtuality Using Touch-Sensitive 3D-Printed Objects. Remote Sensing 13, 11 (2021), 20 pages.
[35]
Daniele Panozzo, Enrico Puppo, Marco Tarini, Nico Pietroni, and Paolo Cignoni. 2011. Automatic Construction of Quad-Based Subdivision Surfaces Using Fitmaps. IEEE Transactions on Visualization and Computer Graphics 17, 10 (oct 2011), 1510–1520.
[36]
Thiago Pereira, Szymon Rusinkiewicz, and Wojciech Matusik. 2014. Computational Light Routing: 3D Printed Optical Fibers for Sensing and Display. ACM Trans. Graph. 33, 3, Article 24 (jun 2014), 13 pages.
[37]
Nico Pietroni, Stefano Nuvoli, Thomas Alderighi, Paolo Cignoni, and Marco Tarini. 2021. Reliable Feature-Line Driven Quad-Remeshing. ACM Trans. Graph. 40, 4, Article 155 (jul 2021), 17 pages.
[38]
Nico Pietroni, Enrico Puppo, Giorgio Marcias, Roberto Roberto, and Paolo Cignoni. 2016. Tracing Field-Coherent Quad Layouts. Computer Graphics Forum 35, 7 (oct 2016), 485–496.
[39]
Narjes Pourjafarian, Marion Koelle, Fjolla Mjaku, Paul Strohmeier, and J?rgen Steimle. 2022. Print-A-Sketch: A Handheld Printer for Physical Sketching of Circuits and Sensors on Everyday Surfaces. In Proceedings of the CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA). ACM, New York, NY, USA, Article 270, 17 pages.
[40]
Faniry H. Razafindrazaka and Konrad Polthier. 2017. Optimal base complexes for quadrilateral meshes. Computer Aided Geometric Design 52–53 (2017), 63–74.
[41]
Faniry H. Razafindrazaka, Ulrich Reitebuch, and Konrad Polthier. 2015. Perfect Matching Quad Layouts for Manifold Meshes. Computer Graphics Forum 34, 5 (2015), 219–228.
[42]
Munehiko Sato, Ivan Poupyrev, and Chris Harrison. 2012. Touch?: Enhancing Touch Interaction on Humans, Screens, Liquids, and Everyday Objects. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA). ACM, New York, NY, USA, 483–492.
[43]
Valkyrie Savage, Ryan Schmidt, Tovi Grossman, George Fitzmaurice, and Bj?rn Hartmann. 2014. A series of tubes: adding interactivity to 3D prints using internal pipes. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA). ACM, New York, NY, USA, 3–12.
[44]
Nico Schertler, Daniele Panozzo, Stefan Gumhold, and Marco Tarini. 2018. Generalized Motorcycle Graphs for Imperfect Quad-Dominant Meshes. ACM Trans. Graph. 37, 4, Article 155 (jul 2018), 16 pages.
[45]
Martin Schmitz, Mohammadreza Khalilbeigi, Matthias Balwierz, Roman Lissermann, Max M?hlh?user, and J?rgen Steimle. 2015. Capricate: A Fabrication Pipeline to Design and 3D Print Capacitive Touch Sensors for Interactive Objects. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (Charlotte, NC, USA). ACM, New York, NY, USA, 253–258.
[46]
Martin Schmitz, J?rgen Steimle, Jochen Huber, Niloofar Dezfuli, and Max M?hlh?user. 2017. Flexibles: Deformation-Aware 3D-Printed Tangibles for Capacitive Touch-screens. In Proceedings of the CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA). ACM, New York, NY, USA, 1001–1014.
[47]
Martin Schmitz, Martin Stitz, Florian M?ller, Markus Funk, and Max M?hlh?user. 2019. Trilaterate: A Fabrication Pipeline to Design and 3D Print Hover-, Touch-, and Force-Sensitive Objects. In Proceedings of the CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk). ACM, New York, NY, USA, 1–13.
[48]
Paul Strohmeier, Jarrod Knibbe, Sebastian Boring, and Kasper Hornb?k. 2018. zPatch: Hybrid Resistive/Capacitive eTextile Input. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction (Stockholm, Sweden). ACM, New York, NY, USA, 188–198.
[49]
Mathias Sundholm, Jingyuan Cheng, Bo Zhou, Akash Sethi, and Paul Lukowicz. 2014. Smart-Mat: Recognizing and Counting Gym Exercises with Low-Cost Resistive Pressure Sensing Matrix. In Proceedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing (Seattle, Washington). ACM, New York, NY, USA, 373–382.
[50]
Marco Tarini, Enrico Puppo, Daniele Panozzo, Nico Pietroni, and Paolo Cignoni. 2011. Simple Quad Domains for Field Aligned Mesh Parametrization. ACM Trans. Graph. 30, 6 (dec 2011), 1–12.
[51]
Marc Teyssier, Brice Parilusyan, Anne Roudaut, and J?rgen Steimle. 2021. Human-Like Artificial Skin Sensor for Physical Human-Robot Interaction. In IEEE International Conference on Robotics and Automation. IEEE, USA, 3626–3633.
[52]
Tito Pradhono Tomo, Massimo Regoli, Alexander Schmitz, Lorenzo Natale, Harris Kristanto, Sophon Somlor, Lorenzo Jamone, Giorgio Metta, and Shigeki Sugano. 2018. A New Silicone Structure for uSkin—A Soft, Distributed, Digital 3-Axis Skin Sensor and Its Integration on the Humanoid Robot iCub. IEEE Robotics and Automation Letters 3, 3 (2018), 2584–2591.
[53]
Daiki Tone, Daisuke Iwai, Shinsaku Hiura, and Kosuke Sato. 2020. FibAR: Embedding Optical Fibers in 3D Printed Objects for Active Markers in Dynamic Projection Mapping. IEEE Transactions on Visualization and Computer Graphics 26, 5 (2020), 2030–2040.
[54]
Nobuyuki Umetani and Ryan Schmidt. 2017. SurfCuit: Surface-Mounted Circuits on 3D Prints. IEEE Computer Graphics and Applications 37, 3 (2017), 52–60.
[55]
Guanyun Wang, Fang Qin, Haolin Liu, Ye Tao, Yang Zhang, Yongjie Jessica Zhang, and Lining Yao. 2020. MorphingCircuit: An Integrated Design, Simulation, and Fabrication Workflow for Self-Morphing Electronics. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 4, Article 157 (dec 2020), 26 pages.
[56]
Tianyi Wang, Ke Huo, Pratik Chawla, Guiming Chen, Siddharth Banerjee, and Karthik Ramani. 2018. Plain2Fun: Augmenting Ordinary Objects with Interactive Functions by Auto-Fabricating Surface Painted Circuits. In Proceedings of the Designing Interactive Systems Conference (Hong Kong, China). ACM, New York, NY, USA, 1095–1106.
[57]
Michael Wessely, Ticha Sethapakdi, Carlos Castillo, Jackson C. Snowden, Ollie Hanton, Isabel P. S. Qamar, Mike Fraser, Anne Roudaut, and Stefanie Mueller. 2020. Sprayable User Interfaces: Prototyping Large-Scale Interactive Surfaces with Sensors and Displays. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1–12.
[58]
Karl Willis, Eric Brockmeyer, Scott Hudson, and Ivan Poupyrev. 2012. Printed optics: 3D printing of embedded optical elements for interactive devices. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (Cambridge, Massachusetts, USA). ACM, New York, NY, USA, 589–598.
[59]
Andrew D. Wilson. 2010. Using a depth camera as a touch sensor. In ACM International Conference on Interactive Tabletops and Surfaces (Saarbr?cken, Germany). ACM, New York, NY, USA, 69–72.
[60]
Raphael Wimmer and Patrick Baudisch. 2011. Modular and Deformable Touch-sensitive Surfaces Based on Time Domain Reflectometry. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA). ACM, New York, NY, USA, 517–526.
[61]
Jarrid A. Wittkopf, Kris Erickson, Paul Olumbummo, Aja Hartman, Howard Tom, and Lihua Zhao. 2019. 3D Printed Electronics with Multi Jet Fusion. NIP & Digital Fabrication Conference 35, 1 (2019), 29–33.
[62]
Kui Wu, Marco Tarini, Cem Yuksel, James McCann, and Xifeng Gao. 2022. Wearable 3D Machine Knitting: Automatic Generation of Shaped Knit Sheets to Cover Real-World Objects. IEEE Transactions on Visualization and Computer Graphics 28, 9 (2022), 3180–3192.
[63]
Sen Zhang, Hui Zhang, and Jun-Hai Yong. 2016. Automatic Quad Patch Layout Extraction for Quadrilateral Meshes. Computer-Aided Design and Applications 13, 3 (2016), 409–416.
[64]
Yang Zhang and Chris Harrison. 2018. Pulp Nonfiction: Low-Cost Touch Tracking for Paper. In Proceedings of the CHI Conference on Human Factors in Computing Systems (Montreal, QC, Canada,). ACM, New York, NY, USA, 1–11.
[65]
Yang Zhang, Gierad Laput, and Chris Harrison. 2017. Electrick: Low-Cost Touch Sensing Using Electric Field Tomography. In Proceedings of the CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA). ACM, New York, NY, USA, 1–14.
[66]
Qingnan Zhou, Eitan Grinspun, Denis Zorin, and Alec Jacobson. 2016. Mesh arrangements for solid geometry. ACM Trans. Graph. 35, 4, Article 39 (jul 2016), 15 pages.
[67]
Junyi Zhu, Lotta-Gili Blumberg, Yunyi Zhu, Martin Nisser, Ethan Levi Carlson, Xin Wen, Kevin Shum, Jessica Ayeley Quaye, and Stefanie Mueller. 2020a. CurveBoards: Integrating Breadboards into Physical Objects to Prototype Function in the Context of Form. In Proceedings of the CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA). ACM, New York, NY, USA, 1–13.
[68]
Junyi Zhu, Yunyi Zhu, Jiaming Cui, Leon Cheng, Jackson Snowden, Mark Chounlakone, Michael Wessely, and Stefanie Mueller. 2020b. MorphSensor: A 3D Electronic Design Tool for Reforming Sensor Modules. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 541–553.
[69]
Thomas G. Zimmerman, Joshua R. Smith, Joseph A. Paradiso, David Allport, and Neil Gershenfeld. 1995. Applying Electric Field Sensing to Human-computer Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA). ACM/Addison-Wesley, New York, NY, USA, 280–287.
