An Object Recall System Using RGBD Images

Abstract

Memory deterioration is a common problem, and the locations of household objects such as remote controls, medicine bottles, and teacups are sometimes forgotten despite being in frequent use. To enhance the quality of life and reduce the amount of time wasted locating these objects, this study employs depth cameras for object tracking, segmentation, and recognition using color and depth data captured in the images and positions of objects during interaction with the skeleton of a hand. This process establishes an index of features relative to object positions that can be used to assist the user in recalling the location of household objects. Preliminary experiments have demonstrated promising performance of the proposed method.