ISSN (print) 0914-4935
ISSN (online) 2435-0869
Sensors and Materials
is an international peer-reviewed open access journal to provide a forum for researchers working in multidisciplinary fields of sensing technology.
Sensors and Materials
is covered by Science Citation Index Expanded (Clarivate Analytics), Scopus (Elsevier), and other databases.

Instructions to authors
English    日本語

Instructions for manuscript preparation
English    日本語

Template
English

Publisher
 MYU K.K.
 Sensors and Materials
 1-23-3-303 Sendagi,
 Bunkyo-ku, Tokyo 113-0022, Japan
 Tel: 81-3-3827-8549
 Fax: 81-3-3827-8547

MYU Research, a scientific publisher, seeks a native English-speaking proofreader with a scientific background. B.Sc. or higher degree is desirable. In-office position; work hours negotiable. Call 03-3827-8549 for further information.


MYU Research

(proofreading and recording)


MYU K.K.
(translation service)


The Art of Writing Scientific Papers

(How to write scientific papers)
(Japanese Only)

Sensors and Materials, Volume 31, Number 6(3) (2019)
Copyright(C) MYU K.K.
pp. 2089-2101
S&M1917 Research Paper of Special Issue
https://doi.org/10.18494/SAM.2019.2307
Published: June 28, 2019

Accurate Rapid Grasping of Small Industrial Parts from Charging Tray in Clutter Scenes [PDF]

Jianmei Wang, Hang Yin, Shaoming Zhang, Popo Gui, and Kunyuan Xu

(Received January 20, 2019; Accepted May 20, 2019)

Keywords: robotic grasping, pose estimation, object segmentation, object detection, red-green-blue and depth (RGB-D) multimodal data

The rapid detection and fine pose estimation of textureless objects in red-green-blue and depth (RGB-D) images are challenging tasks, especially for small dark industrial parts on the production line in clutter scenes. In this paper, a novel practical method based on an RGB-D sensor, which includes 3D object segmentation and 6D pose estimation, is proposed. At the 3D object segmentation stage, 3D virtual and detected bounding boxes are combined to segment 3D scene point clouds. The 3D virtual bounding boxes are determined from prior information on the parts and charging tray, and the 3D detected bounding boxes are obtained from the 2D detected bounding boxes in part detection based on a Single Shot MultiBox Detector (SSD) network in an RGB image. At the 6D pose estimation stage, the coarse pose is estimated by fitting the central axis of the part from the observed 3D point clouds accompanied by a lot of noise, and then refined with part model point clouds by using the iterative closest point (ICP) algorithm. The proposed method has been successfully applied to robotic grasping on the industrial production line with a customer-leverldepth camera. The results verified that grasping speed reaches the subsecond level and that grasping accuracy reaches the millimeter level. The stability and robustness of the automation system meet the production requirement.

Corresponding author: Shaoming Zhang


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

Cite this article
Jianmei Wang, Hang Yin, Shaoming Zhang, Popo Gui, and Kunyuan Xu, Accurate Rapid Grasping of Small Industrial Parts from Charging Tray in Clutter Scenes, Sens. Mater., Vol. 31, No. 6, 2019, p. 2089-2101.



Forthcoming Regular Issues


Forthcoming Special Issues

Special Issue on Selected Papers from IS3C2018 and AUTO2018 (1)
Guest editor, Hsiung-Cheng Lin (National Chin-Yi University of Technology)


Special Issue on Design, Fabrication, Characterization, and Application MEMS
Guest editor, Hiroyuki Fujita (Tokyo City University)


Special Issue on Selected Papers from IS3C2018 and AUTO2018 (2)
Guest editor, Hsiung-Cheng Lin (National Chin-Yi University of Technology)


Special Issue on New Trend of Robotics and Applications
Guest editor, Ikuo Yamamoto (Nagasaki University)
Call for paper


Special Issue on Universal Power Supply Technologies for Trillion Sensors Era
Guest editor, Keiji Takeuchi (NTT Data Institute of Management Consulting, Inc.)
Call for paper


Special Issue on Magnetic Sensors and Applications
Guest editor, Keiji Tsukada (Okayama University)
Call for paper


Special Issue on Sensors and Materials in Manufacturing
Guest editor, Ming Yang (Tokyo Metropolitan University) and Masao Murakawa (Nippon Institute of Technology)


Special Issue on CMOS-driven Biomedical Innovations
Guest editor, Kiichi Niitsu (Nagoya University)
Call for paper


Special Issue on Smart Sensing Technology and Materials for Smart Industry and Environmental Applications
Guest editor, Somyot Kaitwanidvilai (King Mongkut’s Institute of Technology Ladkrabang)
Call for paper


Special Issue on Sensor Fusion and Environment Perception for Autonomous Systems
Guest editor, Chenguang Yang (University of the West of England, Bristol)
Call for paper


Special Issue on Remote Sensing and Geospatial Technologies for Sustainable Development
Guest editor, Dong Ha Lee and Tri Dev Acharya (Kangwon National University)
Call for paper


Special Issue on International Conference on BioSensors, BioElectronics, BioMedical Devices, BioMEMS/NEMS and Applications 2018/2019 (Bio4Apps 2018/2019)
Guest editor, Xiaojun Han (Harbin Institute of Technology)
Conference website
Call for paper


Special Issue on Environmental Sensing
Guest editor, Hiroshi Aoki and Tetsuya Nakazato (National Institute of Advanced Industrial Science and Technology, AIST)
Call for paper


Special Issue on Advanced Materials on Electronic and Mechanical Devices and their Application on Sensors
Guest editor, Teen-Hang Meen (National Formosa University), Wenbing Zhao (Cleveland State University), and Cheng-Fu Yang (National University of Kaohsiung)
Call for paper


Special Issue on Advanced Micro and Nanomaterials for various Sensor Applications (Selected Papers from ICASI 2019)
Guest editor, Sheng-Joue Young (National Formosa University), Shoou-Jinn Chang (National Cheng Kung University), Liang-Wen Ji (National Formosa University), and Yu-Jen Hsiao (Southern Taiwan University of Science and Technology)
Conference website
Call for paper


Special Issue on Innovation in Smart Sensing Control, Metrology, Optimization and Intelligent Automation
Guest editor, Cheng-Chi Wang (National Chin-Yi University of Technology)
Conference website
Call for paper


Special Issue on Materials, Devices, Circuits, Analytical Methods for Various Sensors (Selected Papers from ICSEVEN 2019)
Guest editor, Chien-Jung Huang (National University of Kaohsiung), Cheng-Hsing Hsu (National United University), Ja-Hao Chen (Feng Chia University), and Wei-Ling Hsu (Huaiyin Normal University)
Conference website
Call for paper


Special Issue on Biological Odor Sensing System and Their Applications
Guest editor, Takeshi Sakurai (Tokyo University of Agriculture)
Call for paper


Special Issue on Software, Algorithms, and Applications Using Sensors and Networks
Guest editor, Yoshito Tobe (Aoyama Gakuin University)
Call for paper


Special Issue on Novel Sensing Technologies for Point of Care, Home Care, and Personal Health Care
Guest editor, Yu-Lin Wang (National Tsing Hua University)
Call for paper


Special Issue on Advances in Shape Memory Materials
Guest editor, Ryosuke Matsui (Aichi Institute of Technology) and Hiroyuki Miki (Tohoku University)
Call for paper


Special Issue on Sensing in Medical Robots
Guest editor, Kenji Kawashima (Tokyo Medical and Dental University)
Call for paper


Special Issue on Optical Sensors: Novel Materials, Approaches, and Applications
Guest editor, Yap Wing Fen (Universiti Putra Malaysia)
Call for paper



Copyright(C) MYU K.K.