Introduction
Novelty of the Project
In this project, we demonstrate a soft tactile sensor with self-decoupling and super-resolution abilities by designing a sinusoidally magnetized flexible film (with the thickness ~0.5 millimeters), whose deformation can be detected by a Hall sensor according to the change of magnetic flux densities under external forces. The sensor can accurately measure the normal force and the shear force with a single unit and achieve a 60-fold super-resolved accuracy enhanced by deep learning. By mounting our sensor at the fingertip of a robotic gripper we show that our robots can accomplish challenging tasks like stably grasping fragile objects under external disturbance and threading a needle via teleoperation.
Benefit to the Community
This research provides new insight into tactile sensor design and could be beneficial to various applications in robotics field, such as adaptive grasping, dexterous manipulation, and human-robot interaction.
Compared with the traditional tactile sensors that are either mechanically decoupled (using multiple sensing units) or decoupled by data-fitting methods (using complicated models), our sensor is able to measure both the normal and shear forces in a decoupled way, which dramatically simplifies the sensor structure and the calibration process, and is thus more suitable to be used in practical applications than other sensors that are either complex to fabricate and calibrate or not robust for practical usage.
About the Scholar
Dr Pan is current the Assistant Professor at the Department of Computer Science, HKU. His research interests are robotics and artificial intelligence.
- Yan, Z. Hu, Y. Shen*, and J. Pan*. Surface Texture Recognition by Deep Learning—enhanced Tactile Sensing. Advanced Intelligent Systems, 2021
- Yan, Z. Hu, Z. Yang, W. Yuan, C. Song, J. Pan*, and Y. Shen. A soft magnetic skin for self-decoupled and super-resolved tactile sensing. Science Robotics, 6(51), 2021
- Yan and J. Pan*. Fast localization and segmentation of tissue abnormalities by autonomous robotic palpation. lEEERobotics andAutomat/on Letters, 6(2):1707 – 1714, 2021
- US Patent: Jia Pan, Yajing Shen, Youcan Yan (2021). A soft tactile sensor by flexible magnetic film, USA patent, filed.
- The team has established connections with the industries including Huawei 2021 Lab and Delta Electronics.
Please feel free to give your enquiry / feedbacks to the research team by filling the form (https://forms.gle/mzfb3KT1912nbby7A). Thank you!