Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

An automatic occlusion handling method in augmented reality

An automatic occlusion handling method in augmented reality Purpose – To make an augmented image realistic, the virtual objects should be correctly occluded by foreground objects. The purpose of this paper is to propose a new approach that resolves occlusion problems in augmented reality (AR). The main interest is that it can automatically obtain the proper spatial relationship between virtual and real objects in real time. Design/methodology/approach – The approach is divided into two steps: off‐line disparity map constructing and on‐line occlusion handling. In the off‐line stage, the disparity map of the real scene is constructed using the global stereo matching method prior and then the disparities are refined by means of the fast mean shift method. Since the depth values of objects in different positions are different, the real object that occludes the virtual object can be specified according to the depth value. In the on‐line stage, the contour of the specified object is tracked using the real time object tracking method with the combination of feature tracking method and minimum s ‐ t cut method. The augmented image with correct occlusions is produced by redrawing all the tracked object pixels on the augmented image. Findings – Compared with the existing methods, the proposed approach can automatically resolve occlusion problem in real time. The effectiveness of the method is demonstrated with several experimental results. Originality/value – This paper makes three contributions. First, a novel framework is proposed to handle occlusion problem in AR. This framework is different to the previously proposed methods. The main procedure includes: obtain occluding real object, track the object, and redraw the pixels of the object on the composed image. It is much easier to implement and can achieve satisfactory results. Second, the disparity map is used to automatically obtain the contour of the occluding real object. To get the contour of the occluding real object precisely, the mean shift method is used to refine the disparity map. By comparing the depth value, the occluding real object can be extracted automatically. Third, the tracking method combining feature tracking method and minimum s ‐ t cut method ensures the real‐time requirement. The occlusion problem can be handled in real‐time. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Sensor Review Emerald Publishing

An automatic occlusion handling method in augmented reality

Sensor Review , Volume 30 (3): 9 – Jun 29, 2010

Loading next page...
 
/lp/emerald-publishing/an-automatic-occlusion-handling-method-in-augmented-reality-9MDGh1bmyj

References (33)

Publisher
Emerald Publishing
Copyright
Copyright © 2010 Emerald Group Publishing Limited. All rights reserved.
ISSN
0260-2288
DOI
10.1108/02602281011051399
Publisher site
See Article on Publisher Site

Abstract

Purpose – To make an augmented image realistic, the virtual objects should be correctly occluded by foreground objects. The purpose of this paper is to propose a new approach that resolves occlusion problems in augmented reality (AR). The main interest is that it can automatically obtain the proper spatial relationship between virtual and real objects in real time. Design/methodology/approach – The approach is divided into two steps: off‐line disparity map constructing and on‐line occlusion handling. In the off‐line stage, the disparity map of the real scene is constructed using the global stereo matching method prior and then the disparities are refined by means of the fast mean shift method. Since the depth values of objects in different positions are different, the real object that occludes the virtual object can be specified according to the depth value. In the on‐line stage, the contour of the specified object is tracked using the real time object tracking method with the combination of feature tracking method and minimum s ‐ t cut method. The augmented image with correct occlusions is produced by redrawing all the tracked object pixels on the augmented image. Findings – Compared with the existing methods, the proposed approach can automatically resolve occlusion problem in real time. The effectiveness of the method is demonstrated with several experimental results. Originality/value – This paper makes three contributions. First, a novel framework is proposed to handle occlusion problem in AR. This framework is different to the previously proposed methods. The main procedure includes: obtain occluding real object, track the object, and redraw the pixels of the object on the composed image. It is much easier to implement and can achieve satisfactory results. Second, the disparity map is used to automatically obtain the contour of the occluding real object. To get the contour of the occluding real object precisely, the mean shift method is used to refine the disparity map. By comparing the depth value, the occluding real object can be extracted automatically. Third, the tracking method combining feature tracking method and minimum s ‐ t cut method ensures the real‐time requirement. The occlusion problem can be handled in real‐time.

Journal

Sensor ReviewEmerald Publishing

Published: Jun 29, 2010

Keywords: Reality; Computer software; Tracking

There are no references for this article.