Issue

Vol. 16 (2024)

Intelligent Recognition Using Ultralight Multifunctional Nano-Layered Carbon Aerogel Sensors with Human-Like Tactile Perception

https://doi.org/10.1007/s40820-023-01216-0
Huiqi Zhao
CAS Center for Excellence in Nanoscience, Beijing Key Laboratory of Micro‑Nano Energy and Sensor, Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences, Beijing 101400, People’s Republic of China
Yizheng Zhang
Tencent Robotics X, Shenzhen 518054, People’s Republic of China
Lei Han
Tencent Robotics X, Shenzhen 518054, People’s Republic of China
Weiqi Qian
CAS Center for Excellence in Nanoscience, Beijing Key Laboratory of Micro‑Nano Energy and Sensor, Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences, Beijing 101400, People’s Republic of China
Jiabin Wang
CAS Center for Excellence in Nanoscience, Beijing Key Laboratory of Micro‑Nano Energy and Sensor, Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences, Beijing 101400, People’s Republic of China
Heting Wu
CAS Center for Excellence in Nanoscience, Beijing Key Laboratory of Micro‑Nano Energy and Sensor, Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences, Beijing 101400, People’s Republic of China
Jingchen Li
Tencent Robotics X, Shenzhen 518054, People’s Republic of China
Yuan Dai
Tencent Robotics X, Shenzhen 518054, People’s Republic of China
Zhengyou Zhang
Tencent Robotics X, Shenzhen 518054, People’s Republic of China
Chris R. Bowen
Department of Mechanical Engineering, University of Bath, Bath BA2 7AK, UK
Ya Yang
CAS Center for Excellence in Nanoscience, Beijing Key Laboratory of Micro‑Nano Energy and Sensor, Beijing Institute of Nanoenergy and Nanosystems, Chinese Academy of Sciences, Beijing 101400, People’s Republic of China

Corresponding Author: Ya Yang

yayang@binn.cas.cn

Nano-Micro Letters, Vol. 16 (2024), Article Number: 11

Abstract

Humans can perceive our complex world through multi-sensory fusion. Under limited visual conditions, people can sense a variety of tactile signals to identify objects accurately and rapidly. However, replicating this unique capability in robots remains a significant challenge. Here, we present a new form of ultralight multifunctional tactile nano-layered carbon aerogel sensor that provides pressure, temperature, material recognition and 3D location capabilities, which is combined with multimodal supervised learning algorithms for object recognition. The sensor exhibits human-like pressure (0.04–100 kPa) and temperature (21.5–66.2 °C) detection, millisecond response times (11 ms), a pressure sensitivity of 92.22 kPa−1 and triboelectric durability of over 6000 cycles. The devised algorithm has universality and can accommodate a range of application scenarios. The tactile system can identify common foods in a kitchen scene with 94.63% accuracy and explore the topographic and geomorphic features of a Mars scene with 100% accuracy. This sensing approach empowers robots with versatile tactile perception to advance future society toward heightened sensing, recognition and intelligence.


Highlights:
1 individual sensor can provide multiple tactile sensations: pressure, temperature, materials recognition, and 3D location. ThereforThe tactile performance of ultralight multifunctional sensors can reach the level of human tactile perception.
2 An e, it is no longer necessary to integrate multiple sensing modules with different functions, which greatly simplifies system complexity and reduces energy loss.
3 The tactile system with multimodal learning algorithms has universality and can accommodate object recognition tasks in various application scenarios (e.g., Mars and Kitchen).

Keywords

Multifunctional sensor Tactile perception Multimodal machine learning algorithms Universal tactile system Intelligent object recognition
Zhao, Huiqi, Yizheng Zhang, Lei Han, Weiqi Qian, Jiabin Wang, Heting Wu, Jingchen Li, Yuan Dai, Zhengyou Zhang, Chris R. Bowen, and Ya Yang. 2023. “Intelligent Recognition Using Ultralight Multifunctional Nano-Layered Carbon Aerogel Sensors With Human-Like Tactile Perception”. Nano-Micro Letters 16 (November):11. https://doi.org/10.1007/s40820-023-01216-0.
Download Citation
Endnote/Zotero/Mendeley (RIS)
BibTeX
References
  1. B.E. Stein, T.R. Stanford, Multisensory integration: current issues from the perspective of the single neuron. Nat. Rev. Neurosci. 9, 255–266 (2008). https://doi.org/10.1038/nrn2331
  2. N. Fazeli, M. Oller, J. Wu, Z. Wu, J.B. Tenenbaum, A. Rodriguez, See, feel, act: Hierarchical learning for complex manipulation skills with multisensory fusion. Sci. Robot. 4, eaav3123 (2019). https://doi.org/10.1126/scirobotics.aav3123
  3. J. Pesnot Lerousseau, C.V. Parise, M.O. Ernst, V. van Wassenhove, Multisensory correlation computations in the human brain identified by a time-resolved encoding model. Nat. Commun. 13, 2489 (2022). https://doi.org/10.1038/s41467-022-29687-6
  4. H. Tan, Y. Zhou, Q. Tao, J. Rosen, S. van Dijken, Bioinspired multisensory neural network with crossmodal integration and recognition. Nat. Commun. 12, 1120 (2021). https://doi.org/10.1038/s41467-021-21404-z
  5. A. Billard, D. Kragic, Trends and challenges in robot manipulation. Science 364, eaat8414 (2019). https://doi.org/10.1126/science.aat8414
  6. H. Sun, K.J. Kuchenbecker, G. Martius, A soft thumb-sized vision-based sensor with accurate all-round force perception. Nat. Mach. Intell. 4, 135–145 (2022). https://doi.org/10.1038/s42256-021-00439-3
  7. M. Wang, Z. Yan, T. Wang, P. Cai, S. Gao et al., Gesture recognition using a bioinspired learning architecture that integrates visual data with somatosensory data from stretchable sensors. Nat. Electron. 3, 563–570 (2020). https://doi.org/10.1038/s41928-020-0422-z
  8. P. Dudek, T. Richardson, L. Bose, S. Carey, J. Chen et al., Sensor-level computer vision with pixel processor arrays for agile robots. Sci. Robot. 7, eabl7755 (2022). https://doi.org/10.1126/scirobotics.abl7755
  9. B. Peters, N. Kriegeskorte, Capturing the objects of vision with neural networks. Nat. Hum. Behav. 5, 1127–1144 (2021). https://doi.org/10.1038/s41562-021-01194-6
  10. K. Nasr, P. Viswanathan, A. Nieder, Number detectors spontaneously emerge in a deep neural network designed for visual object recognition. Sci. Adv. 5, eaav7903 (2019). https://doi.org/10.1126/sciadv.aav7903
  11. M. Liu, Y. Zhang, J. Wang, N. Qin, H. Yang et al., A star-nose-like tactile-olfactory bionic sensing array for robust object recognition in non-visual environments. Nat. Commun. 13, 79 (2022). https://doi.org/10.1038/s41467-021-27672-z
  12. Y. Yu, J. Li, A. Solomon Samuel, J. Min, J. Tu et al., All-printed soft human-machine interface for robotic physicochemical sensing. Sci. Robot. 7, eabn0495 (2022). https://doi.org/10.1126/scirobotics.abn0495
  13. Y. Wang, H. Wu, L. Xu, H. Zhang, Y. Yang et al., Hierarchically patterned self-powered sensors for multifunctional tactile sensing. Sci. Adv. 6, abb9083 (2020). https://doi.org/10.1126/sciadv.abb9083
  14. K. Park, H. Yuk, M. Yang, J. Cho, H. Lee et al., A biomimetic elastomeric robot skin using electrical impedance and acoustic tomography for tactile sensing. Sci. Robot. 7, eabm7187 (2022). https://doi.org/10.1126/scirobotics.abm7187
  15. Y. Luo, Y. Li, P. Sharma, W. Shou, K. Wu et al., Learning human–environment interactions using conformal tactile textiles. Nat. Electron. 4, 193–201 (2021). https://doi.org/10.1038/s41928-021-00558-0
  16. Z. Sun, M. Zhu, X. Shan, C. Lee, Augmented tactile-perception and haptic-feedback rings as human-machine interfaces aiming for immersive interactions. Nat. Commun. 13, 5224 (2022). https://doi.org/10.1038/s41467-022-32745-8
  17. S. Chun, J.-S. Kim, Y. Yoo, Y. Choi, S.J. Jung et al., An artificial neural tactile sensing system. Nat. Electron. 4, 429–438 (2021). https://doi.org/10.1038/s41928-021-00585-x
  18. G. Li, S. Liu, L. Wang, R. Zhu, Skin-inspired quadruple tactile sensors integrated on a robot hand enable object recognition. Sci. Robot. 5, eabc8134 (2020). https://doi.org/10.1126/scirobotics.abc8134
  19. Y. Roh, M. Kim, S.M. Won, D. Lim, I. Hong et al., Vital signal sensing and manipulation of a microscale organ with a multifunctional soft gripper. Sci. Robot. 6, eabi6774 (2021). https://doi.org/10.1126/scirobotics.abi6774
  20. Y. Gao, C. Yan, H. Huang, T. Yang, G. Tian et al., Microchannel-confined MXene based flexible piezoresistive multifunctional micro-force sensor. Adv. Funct. Mater. 30, 1909603 (2020). https://doi.org/10.1002/adfm.201909603
  21. B. Wang, X. Lai, H. Li, C. Jiang, J. Gao et al., Multifunctional MXene/chitosan-coated cotton fabric for intelligent fire protection. ACS Appl. Mater. Interfaces 13, 23020–23029 (2021). https://doi.org/10.1021/acsami.1c05222
  22. L. Groo, D.J. Inman, H.A. Sodano, In situ damage detection for fiber-reinforced composites using integrated zinc oxide nanowires. Adv. Funct. Mater. 28, 1802846 (2018). https://doi.org/10.1002/adfm.201802846
  23. J. Wen, J. Tang, H. Ning, N. Hu, Y. Zhu et al., Multifunctional ionic skin with sensing, UV-filtering, water-retaining, and anti-freezing capabilities. Adv. Funct. Mater. 31, 2011176 (2021). https://doi.org/10.1002/adfm.202011176
  24. C.M. Boutry, M. Negre, M. Jorda, O. Vardoulis, A. Chortos et al., A hierarchically patterned, bioinspired e-skin able to detect the direction of applied pressure for robotics. Sci. Robot. 3, eaau6914 (2018). https://doi.org/10.1126/scirobotics.aau6914
  25. O. Feinerman, I. Pinkoviezky, A. Gelblum, E. Fonio, N.S. Gov, The physics of cooperative transport in groups of ants. Nat. Phys. 14, 683–693 (2018). https://doi.org/10.1038/s41567-018-0107-y
  26. T. Li, A.D. Pickel, Y. Yao, Y. Chen, Y. Zeng et al., Thermoelectric properties and performance of flexible reduced graphene oxide films up to 3,000 K. Nat. Energy 3, 148–156 (2018). https://doi.org/10.1038/s41560-018-0086-3
  27. C. Leovy, Weather and climate on Mars. Nature 412, 245–249 (2001). https://doi.org/10.1038/35084192
  28. L.K. Fenton, P.E. Geissler, R.M. Haberle, Global warming and climate forcing by recent albedo changes on Mars. Nature 446, 646–649 (2007). https://doi.org/10.1038/nature05718
  29. A.S. Yen, R. Gellert, C. Schröder, R.V. Morris, J.F. Bell et al., An integrated view of the chemistry and mineralogy of martian soils. Nature 436, 49–54 (2005). https://doi.org/10.1038/nature03637
  30. R. Rieder, T. Economou, H. Wänke, A. Turkevich, J. Crisp et al., The chemical composition of martian soil and rocks returned by the mobile alpha proton X-ray spectrometer: preliminary results from the X-ray mode. Science 278, 1771–1774 (1997). https://doi.org/10.1126/science.278.5344.1771
  31. D. Clery, Lake spied deep below polar ice cap on Mars. Science 361, 320–320 (2018). https://doi.org/10.1126/science.361.6400.320
  32. A. Diez, Liquid water on Mars. Science 361, 448–449 (2018). https://doi.org/10.1126/science.aau1829
  33. R. Orosei, S.E. Lauro, E. Pettinelli, A. Cicchetti, M. Coradini et al., Radar evidence of subglacial liquid water on Mars. Science 361, 490–493 (2018). https://doi.org/10.1126/science.aar7268
  34. S.E. Lauro, E. Pettinelli, G. Caprarelli, L. Guallini, A.P. Rossi et al., Multiple subglacial water bodies below the south pole of Mars unveiled by new MARSIS data. Nat. Astron. 5, 63–70 (2021). https://doi.org/10.1038/s41550-020-1200-6
  35. Y. Liu, X. Wu, Y.-Y.S. Zhao, L. Pan, C. Wang et al., Zhurong reveals recent aqueous activities in Utopia Planitia. Mars. Sci. Adv. 8, eabn8555 (2022). https://doi.org/10.1126/sciadv.abn8555
  36. H. Zhuo, Y. Hu, X. Tong, Z. Chen, L. Zhong et al., A supercompressible, elastic, and bendable carbon aerogel with ultrasensitive detection limits for compression strain, pressure, and bending angle. Adv. Mater. 30, 1706705 (2018). https://doi.org/10.1002/adma.201706705
  37. Z. Sun, M. Zhu, Z. Zhang, Z. Chen, Q. Shi et al., Artificial intelligence of things (AIoT) enabled virtual shop applications using self-powered sensor enhanced soft robotic manipulator. Adv. Sci. 8, 2100230 (2021). https://doi.org/10.1002/advs.202100230
  38. X. Qu, Z. Liu, P. Tan, C. Wang, Y. Liu et al., Artificial tactile perception smart finger for material identification based on triboelectric sensing. Sci. Adv. 8, eabq2521 (2022). https://doi.org/10.1126/sciadv.abq2521
  39. H. Zhuo, Y. Hu, Z. Chen, X. Peng, L. Liu et al., A carbon aerogel with super mechanical and sensing performances for wearable piezoresistive sensors. J. Mater. Chem. A 7, 8092–8100 (2019). https://doi.org/10.1039/c9ta00596j
  40. Z. Wei, D. Wang, S. Kim, S.-Y. Kim, Y. Hu et al., Nanoscale tunable reduction of graphene oxide for graphene electronics. Science 328, 1373–1376 (2010). https://doi.org/10.1126/science.1188119
  41. I. You, D.G. Mackanic, N. Matsuhisa, J. Kang, J. Kwon et al., Artificial multimodal receptors based on ion relaxation dynamics. Science 370, 961–965 (2020). https://doi.org/10.1126/science.aba5132
  42. J. Park, M. Kim, Y. Lee, H.S. Lee, H. Ko, Fingertip skin–inspired microstructured ferroelectric skins discriminate static/dynamic pressure and temperature stimuli. Sci. Adv. 1, e1500661 (2015). https://doi.org/10.1126/sciadv.1500661
  43. C. Chen, Y. Kuang, S. Zhu, I. Burgert, T. Keplinger et al., Structure–property–function relationships of natural and engineered wood. Nat. Rev. Mater. 5, 642–666 (2020). https://doi.org/10.1038/s41578-020-0195-z
  44. H. Zou, Y. Zhang, L. Guo, P. Wang, X. He et al., Quantifying the triboelectric series. Nat. Commun. 10, 1427 (2019). https://doi.org/10.1038/s41467-019-09461-x
  45. Z.L. Wang, Triboelectric nanogenerators as new energy technology for self-powered systems and as active mechanical and chemical sensors. ACS Nano 7, 9533–9557 (2013). https://doi.org/10.1021/nn404614z
  46. Z.L. Wang, On Maxwell’s displacement current for energy and sensors: the origin of nanogenerators. Mater. Today 20, 74–82 (2017). https://doi.org/10.1016/j.mattod.2016.12.001
Read More
Author biographies are not available.
Download this PDF file
PDF SUPPLEMENTARY FILE
Statistic
Read Counter : 2716 Download : 2016