Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Contact-consistent visual object pose estimation for contact-rich robotic manipulation tasks

Contact-consistent visual object pose estimation for contact-rich robotic manipulation tasks The purpose of this paper is to estimate the contact-consistent object poses during contact-rich manipulation tasks based only on visual sensors.Design/methodology/approachThe method follows a four-step procedure. Initially, the raw object poses are retrieved using the available object pose estimation method and filtered using Kalman filter with nominal model; second, a group of particles are randomly generated for each pose and evaluated the corresponding object contact state using the contact simulation software. A probability guided particle averaging method is proposed to balance the accuracy and safety issues; third, the independently estimated contact states are fused in a hidden Markov model to remove the abnormal contact state observations; finally, the object poses are refined by averaging the contact state consistent particles.FindingsThe experiments are performed to evaluate the effectiveness of the proposed methods. The results show that the method can achieve smooth and accurate pose estimation results and the estimated contact states are consistent with ground truth.Originality/valueThis paper proposes a method to obtain contact-consistent poses and contact states of objects using only visual sensors. The method tries to recover the true contact state from inaccurate visual information by fusing contact simulations results and contact consistency assumptions. The method can be used to extract pose and contact information from object manipulation tasks by just observing the demonstration, which can provide a new way for the robot to learn complex manipulation tasks. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Assembly Automation Emerald Publishing

Contact-consistent visual object pose estimation for contact-rich robotic manipulation tasks

Loading next page...
 
/lp/emerald-publishing/contact-consistent-visual-object-pose-estimation-for-contact-rich-OiZ0awfU8K
Publisher
Emerald Publishing
Copyright
© Emerald Publishing Limited
ISSN
0144-5154
eISSN
0144-5154
DOI
10.1108/aa-10-2021-0128
Publisher site
See Article on Publisher Site

Abstract

The purpose of this paper is to estimate the contact-consistent object poses during contact-rich manipulation tasks based only on visual sensors.Design/methodology/approachThe method follows a four-step procedure. Initially, the raw object poses are retrieved using the available object pose estimation method and filtered using Kalman filter with nominal model; second, a group of particles are randomly generated for each pose and evaluated the corresponding object contact state using the contact simulation software. A probability guided particle averaging method is proposed to balance the accuracy and safety issues; third, the independently estimated contact states are fused in a hidden Markov model to remove the abnormal contact state observations; finally, the object poses are refined by averaging the contact state consistent particles.FindingsThe experiments are performed to evaluate the effectiveness of the proposed methods. The results show that the method can achieve smooth and accurate pose estimation results and the estimated contact states are consistent with ground truth.Originality/valueThis paper proposes a method to obtain contact-consistent poses and contact states of objects using only visual sensors. The method tries to recover the true contact state from inaccurate visual information by fusing contact simulations results and contact consistency assumptions. The method can be used to extract pose and contact information from object manipulation tasks by just observing the demonstration, which can provide a new way for the robot to learn complex manipulation tasks.

Journal

Assembly AutomationEmerald Publishing

Published: Jul 19, 2022

Keywords: Object pose estimation; Pose optimization; Contact simulation; Automatic assembly; Assembly

References