High Resolution Tactile Sensing For Robotic Perception PDF Download

Are you looking for read ebook online? Search for your book and save it on your Kindle device, PC, phones or tablets. Download High Resolution Tactile Sensing For Robotic Perception PDF full book. Access full book title High Resolution Tactile Sensing For Robotic Perception.

High-resolution Tactile Sensing for Robotic Perception

High-resolution Tactile Sensing for Robotic Perception
Author: Wenzhen Yuan (Ph. D.)
Publisher:
Total Pages: 113
Release: 2018
Genre:
ISBN:

Download High-resolution Tactile Sensing for Robotic Perception Book in PDF, ePub and Kindle

Why is it so difficult for the present-day robots to act intelligently in the real-world environment? A major challenge lies in the lack of adequate tactile sensing technologies. Robots need tactile sensing to understand the physical environment, and detect the contact states during manipulation. A recently developed high-resolution tactile sensor, GelSight, which measures detailed information about the geometry and traction field on the contact surface, shows substantial potential for extending the application of tactile sensing in robotics. The major questions are: (1) What physical information is available from the high-resolution sensor? (2) How can the robot interpret and use this information? This thesis aims at addressing the two questions above. On the one hand, the tactile feedback helps robots to interact better with the environment, i.e., perform better exploration and manipulation. I investigate various techniques for detecting incipient slip and full slip during contact with objects, which helps a robot to grasp them securely. On the other hand, tactile sensing also helps a robot to better understand the physical environment. That can be reflected in estimating the material properties of the surrounding objects. I will present my work on using tactile sensing to estimate the hardness of arbitrary objects, and making a robot autonomously explore the comprehensive properties of common clothing. I also show our work on the unsupervised exploration of latent properties of fabrics through cross-modal learning with vision and touch.


Robotic Tactile Sensing

Robotic Tactile Sensing
Author: Ravinder S. Dahiya
Publisher: Springer Science & Business Media
Total Pages: 258
Release: 2012-07-29
Genre: Technology & Engineering
ISBN: 9400705794

Download Robotic Tactile Sensing Book in PDF, ePub and Kindle

Future robots are expected to work closely and interact safely with real-world objects and humans alike. Sense of touch is important in this context, as it helps estimate properties such as shape, texture, hardness, material type and many more; provides action related information, such as slip detection; and helps carrying out actions such as rolling an object between fingers without dropping it. This book presents an in-depth description of the solutions available for gathering tactile data, obtaining aforementioned tactile information from the data and effectively using the same in various robotic tasks. The efforts during last four decades or so have yielded a wide spectrum of tactile sensing technologies and engineered solutions for both intrinsic and extrinsic touch sensors. Nowadays, new materials and structures are being explored for obtaining robotic skin with physical features like bendable, conformable, and stretchable. Such features are important for covering various body parts of robots or 3D surfaces. Nonetheless, there exist many more hardware, software and application related issues that must be considered to make tactile sensing an effective component of future robotic platforms. This book presents an in-depth analysis of various system related issues and presents the trade-offs one may face while developing an effective tactile sensing system. For this purpose, human touch sensing has also been explored. The design hints coming out of the investigations into human sense of touch can be useful in improving the effectiveness of tactile sensory modality in robotics and other machines. Better integration of tactile sensors on a robot’s body is prerequisite for the effective utilization of tactile data. The concept of semiconductor devices based sensors is an interesting one, as it allows compact and fast tactile sensing systems with capabilities such as human-like spatio-temporal resolution. This book presents a comprehensive description of semiconductor devices based tactile sensing. In particular, novel Piezo Oxide Semiconductor Field Effect Transistor (POSFET) based approach for high resolution tactile sensing has been discussed in detail. Finally, the extension of semiconductors devices based sensors concept to large and flexile areas has been discussed for obtaining robotic or electronic skin. With its multidisciplinary scope, this book is suitable for graduate students and researchers coming from diverse areas such robotics (bio-robots, humanoids, rehabilitation etc.), applied materials, humans touch sensing, electronics, microsystems, and instrumentation. To better explain the concepts the text is supported by large number of figures.


Tactile Sensing, Skill Learning, and Robotic Dexterous Manipulation

Tactile Sensing, Skill Learning, and Robotic Dexterous Manipulation
Author: Qiang Li
Publisher: Academic Press
Total Pages: 374
Release: 2022-04-02
Genre: Computers
ISBN: 0323904173

Download Tactile Sensing, Skill Learning, and Robotic Dexterous Manipulation Book in PDF, ePub and Kindle

Tactile Sensing, Skill Learning and Robotic Dexterous Manipulation focuses on cross-disciplinary lines of research and groundbreaking research ideas in three research lines: tactile sensing, skill learning and dexterous control. The book introduces recent work about human dexterous skill representation and learning, along with discussions of tactile sensing and its applications on unknown objects’ property recognition and reconstruction. Sections also introduce the adaptive control schema and its learning by imitation and exploration. Other chapters describe the fundamental part of relevant research, paying attention to the connection among different fields and showing the state-of-the-art in related branches. The book summarizes the different approaches and discusses the pros and cons of each. Chapters not only describe the research but also include basic knowledge that can help readers understand the proposed work, making it an excellent resource for researchers and professionals who work in the robotics industry, haptics and in machine learning. Provides a review of tactile perception and the latest advances in the use of robotic dexterous manipulation Presents the most detailed work on synthesizing intelligent tactile perception, skill learning and adaptive control Introduces recent work on human’s dexterous skill representation and learning and the adaptive control schema and its learning by imitation and exploration Reveals and illustrates how robots can improve dexterity by modern tactile sensing, interactive perception, learning and adaptive control approaches


High-resolution Tactile Sensing for Reactive Robotic Manipulation

High-resolution Tactile Sensing for Reactive Robotic Manipulation
Author: Siyuan Dong (Ph. D.)
Publisher:
Total Pages: 122
Release: 2021
Genre:
ISBN:

Download High-resolution Tactile Sensing for Reactive Robotic Manipulation Book in PDF, ePub and Kindle

This thesis explores tactile sensing to enable reactive behavior in robotic manipulation. More specifically, we focus on developing high-resolution vision-based tactile sensing hardware, perceptual algorithms, and controller designs for robotic manipulation. Tactile sensing plays a key role in human manipulation. However, the existing artificial tactile sensors have multiple limitations in terms of form factor, robustness, and sparse measurement. Tactile sensors are rarely integrated into the current robotic manipulation systems. In this thesis, we design new vision-based tactile sensors that capture the contact surface with high-resolution images and reconstruct the 3D geometry of the contact surface. We first design a variation of the GelSight sensor that improves the accuracy of the depth map reconstruction. To further optimize the form factor and enhance the robustness, we designed another vision-based tactile sensor, GelSlim, which keeps the high-resolution sensing output but has a slimmer former, sharper tip, and improved robustness. Based on the new sensor, we propose algorithms to distill useful contact information from the raw signal output. The key challenge is connecting the contact geometry directly observed from the raw image to contact signals that have meanings in the context of contact mechanics, e.g., contact forces, contact slip. We use an algorithm to track the gel deformation and compare it with a rigid body motion to detect incipient slip. We deploy an inverse Finite Element Method (iFEM) to reconstruct the contact force distribution. Finally, we explore how the tactile signals can be fed into the control loop in real manipulation tasks. We choose 2 representative contact rich manipulation tasks that benefit from tactile control: cable following and object insertion. We implement cable following by sensing & controlling both the state of the grasp of the cable and its configuration in realtime to allow smooth sliding of the fingers along a cable. We train a general tactile-based RL insertion policy in an end-to-end fashion to align the object pose with the insertion hole and keep sticking contact of the grasp by detecting incipient slip during the contact exploration. The RL insertion policy is capable of inserting novel objects, for which we show that tactile feedback is more informative than force-torque feedback.


Advanced Tactile Sensing for Robotics

Advanced Tactile Sensing for Robotics
Author: H.R. Nicholls
Publisher: World Scientific Publishing Company Incorporated
Total Pages: 312
Release: 1992-01-01
Genre: Technology & Engineering
ISBN: 9789810240462

Download Advanced Tactile Sensing for Robotics Book in PDF, ePub and Kindle

Advanced robot systems require sensory information to enable them to make decisions and to carry out actions in a versatile, autonomous way. Humans make considerable use of information derived through touch, and an emerging domain of robot sensing is tactile sensing. This book considers various aspects of tactile sensing, from sensor hardware design through to the use of tactile data in exploratory situations using a multi-fingered robot hand. Both introductory material and new research results are presented, providing detailed coverage of the subject. Applications from assembly automation to dextrous manipulation are examined, and a particular theme is the relevance of biological touch to robotic tactile sensing. The integration of these topics into a single volume make the book essential reading for all those interested in robotic sensing. Contents: Introduction to Tactile SensingTactile Sensor DesignsProcessing and Using Tactile Sensor Data "(H R Nicholls)"Planar Elasticity for Tactile Sensing "(R S Fearing)"Integrating Tactile Sensors — ESPRIT 278 "(Z G Rzepczynski)"Distributed Touch Sensing "(H R Nicholls & N W Hardy)"The Human Tactile System "(L Moss-Salentijn)"Lessons from the Study of Biological Touch for Robotic Tactile Sensing "(S J Lederman & D T Pawluck)"Lessons from the Study of Biological Touch for Robotic Haptic Sensing "(S J Lederman et al.)"Object Recognition Using Active Tactile Sensing "(P K Allen)"Experiments in Active Haptic Perception with the Utah-MIT Dextrous Hand "(P K Allen et al.)"Future Trends in Tactile Sensing "(H R Nicholls)"Appendix — Basic Linear Elasticity "(R S Fearing)" Readership: Computer scientists and engineers.


Tactile Sensors for Robotic Applications

Tactile Sensors for Robotic Applications
Author: Salvatore Pirozzi
Publisher: MDPI
Total Pages: 248
Release: 2021-03-17
Genre: Technology & Engineering
ISBN: 3036504249

Download Tactile Sensors for Robotic Applications Book in PDF, ePub and Kindle

The book covers different aspects: - Innovative technologies for tactile sensors development - Tactile data interpretation for control purposes - Alternative sensing technologies - Multi-sensor systems for grasping and manipulation - Sensing solutions for impaired people


Robotic Tactile Perception and Understanding

Robotic Tactile Perception and Understanding
Author: Huaping Liu
Publisher: Springer
Total Pages: 220
Release: 2018-03-20
Genre: Computers
ISBN: 9811061718

Download Robotic Tactile Perception and Understanding Book in PDF, ePub and Kindle

This book introduces the challenges of robotic tactile perception and task understanding, and describes an advanced approach based on machine learning and sparse coding techniques. Further, a set of structured sparse coding models is developed to address the issues of dynamic tactile sensing. The book then proves that the proposed framework is effective in solving the problems of multi-finger tactile object recognition, multi-label tactile adjective recognition and multi-category material analysis, which are all challenging practical problems in the fields of robotics and automation. The proposed sparse coding model can be used to tackle the challenging visual-tactile fusion recognition problem, and the book develops a series of efficient optimization algorithms to implement the model. It is suitable as a reference book for graduate students with a basic knowledge of machine learning as well as professional researchers interested in robotic tactile perception and understanding, and machine learning.


Robot Tactile Sensing

Robot Tactile Sensing
Author: R. Andrew Russell
Publisher:
Total Pages: 192
Release: 1990
Genre: Computers
ISBN:

Download Robot Tactile Sensing Book in PDF, ePub and Kindle

This work introduces tactile sensing for those engaged in advanced, sensor-based robotics, with special reference to problems of addressing arrays of sensor elements. It describes tactile sensors to register contact, surface profile, thermal properties and other tactile sensing modes. The use of robot manipulators to provide mobility for tactile sensors, and techniques for applying tactile sensing in robotic manipulation and recognition tasks are also covered. The various applications of this technology are discussed, and robot hands and grips are detailed.


Robotic Touch for Contact Perception

Robotic Touch for Contact Perception
Author: Lin, Xi
Publisher:
Total Pages: 0
Release: 2020
Genre:
ISBN:

Download Robotic Touch for Contact Perception Book in PDF, ePub and Kindle

Tactile perception subserves the impressive dexterity found in humans but also found in their robotic counterparts. Recently, a new wave of tactile sensors relying on off-the-shelf cameras, provide a dense tactile image of the contact. However, by the way these sensors operate, the link between the mechanics of the skin and the tactile images is not evident. In this thesis, we present a novel camera-based tactile sensor, named ChromaTouch, which captures physically-driven dense images of the three-dimensional interaction that happens at the interface between the artificial skin and the touched object. The sensor measures the strain field induced by the contact, by imaging the pattern and color change of two overlapping markers array, one translucent and yellow and the other opaque and magenta. The motif seen by the camera is a bijective function of the relative motion of the markers allowing a reconstruction of the stress and strain field at the interface. The sensor, boasting up to 441 sensing elements, shows high robustness to external luminosity and camera resolution, and it is able to estimate the local coefficient of friction of the contact surface with one simple press. A hemispherical version extended the results to arbitrary shapes and is able to estimate the local curvature via a simple press using Hertz contact theory. Sensing the dense 3d deformation field at the contact opens the doors to a comprehensive, physically-based measurement of the interaction. Improved artificial perception of the object and of the interaction can inform robotic exploration, dexterous grasping and manipulation.


Towards Dependable Robotic Perception

Towards Dependable Robotic Perception
Author: Anna V. Petrovskaya
Publisher: Stanford University
Total Pages: 226
Release: 2011
Genre:
ISBN:

Download Towards Dependable Robotic Perception Book in PDF, ePub and Kindle

Reliable perception is required in order for robots to operate safely in unpredictable and complex human environments. However, reliability of perceptual inference algorithms has been poorly studied so far. These algorithms capture uncertain knowledge about the world in the form of probabilistic belief distributions. A number of Monte Carlo and deterministic approaches have been developed, but their efficiency depends on the degree of smoothness of the beliefs. In the real world, the smoothness assumption often fails, leading to unreliable perceptual inference results. Motivated by concrete robotics problems, we propose two novel perceptual inference algorithms that explicitly consider local non-smoothness of beliefs and adapt to it. Both of these algorithms fall into the category of iterative divide-and-conquer methods and hence scale logarithmically with desired accuracy. The first algorithm is termed Scaling Series. It is an iterative Monte Carlo technique coupled with annealing. Local non-smoothness is accounted for by sampling strategy and by annealing schedule. The second algorithm is termed GRAB, which stands for Guaranteed Recursive Adaptive Bounding. GRAB is an iterative adaptive grid algorithm, which relies on bounds. In this case, local non-smoothness is captured in terms of local bounds and grid resolution. Scaling Series works well for beliefs with sharp transitions, but without many discontinuities. GRAB is most appropriate for beliefs with many discontinuities. Both of these algorithms far outperform the prior art in terms of reliability, efficiency, and accuracy. GRAB is also able to guarantee that a quality approximation of the belief is produced. The proposed algorithms are evaluated on a diverse set of real robotics problems: tactile perception, autonomous driving, and mobile manipulation. In tactile perception, we localize objects in 3D starting with very high initial uncertainty and estimating all 6 degrees of freedom. The localization is performed based on tactile sensory data. Using Scaling Series, we obtain highly accurate and reliable results in under 1 second. Improved tactile object localization contributes to manufacturing applications, where tactile perception is widely used for workpiece localization. It also enables robotic applications in situations where vision can be obstructed, such as rescue robotics and underwater robotics. In autonomous driving, we detect and track vehicles in the vicinity of the robot based on 2D and 3D laser range finders. In addition to estimating position and velocity of vehicles, we also model and estimate their geometric shape. The geometric model leads to highly accurate estimates of pose and velocity for each vehicle. It also greatly simplifies association of data, which are often split up into separate clusters due to occlusion. The proposed Scaling Series algorithm greatly improves reliability and ensures that the problem is solved within tight real time constraints of autonomous driving. In mobile manipulation, we achieve highly accurate robot localization based on commonly used 2D laser range finders using the GRAB algorithm. We show that the high accuracy allows robots to navigate in tight spaces and manipulate objects without having to sense them directly. We demonstrate our approach on the example of simultaneous building navigation, door handle manipulation, and door opening. We also propose hybrid environment models, which combine high resolution polygons for objects of interest with low resolution occupancy grid representations for the rest of the environment. High accuracy indoor localization contributes directly to home/office mobile robotics as well as to future robotics applications in construction, inspection, and maintenance of buildings. Based on the success of the proposed perceptual inference algorithms in the concrete robotics problems, it is our hope that this thesis will serve as a starting point for further development of highly reliable perceptual inference methods.