A Short Review on Vision-Based Object Grasping Automation with QR Code

Mooi Khee Teoh; Soo Fun Tan; Hou Pin Yoong.

Transactions on Science and Technology, 8(3-3), 512 - 518.

Back to main issue

ABSTRACT
Rapid development in technologies has improved our quality of life at the same time application of automation into daily activities is becoming an imperative. The online order-picking system is foreseen to be a new normal of life and thus this paper reviews various past researches with related technologies. Few topics mainly on the vision-based grasping automation and monocular vision system using QR code as labels or markers is reviewed. The application of different types of grasping automation in variety field is studied and it shows that an Eye In Hand (EIH) type grasping automation, which the camera sensor is placed together with the robot arm's end, is suitable to be applied into an order-picking system. Thereafter, the monocular vision-based system is also reviewed. Studies found that monocular system is an effective method with low cost and easy installation process. Besides, monocular vision-based automation can operate at high accuracy and efficiency, with the aid of artificial markers such as QR code. QR code technology has been widely applied including products identification, item tracing, and manufacturing management. Additionally, QR codes can be used as markers for picking and packaging products in warehouse. However, limited research is observed using vision-based grasping automation system with QR code markers. Thus, a new research direction of monocular vision-based grasping automation using QR code is expected and suggestive.

KEYWORDS: Robotics; Object grasping; Machine vision; QR code; Artificial landmark; Pick-cart




Download this PDF file

REFERENCES
  1. Atali, G., Garip, Z., Ozkan, S. S. & Karayel, D. 2018. Path Planning of Mobile Robots Based on QR Code. 6th International Symposium on Innovative Technologies in Engineering and Science (ISITES). 9-11 November, 2018, Antalya, Turkey. pp 31-38.
  2. Bone, G. M., Lambert, A. & Edwards, M. 2008. Automated Modeling and Robotic Grasping of Unknown Three-Dimensional Objects. 2008 IEEE International Conference on Robotics and Automation (ICRA). 19-23 May, 2008, California, USA. pp 292-298.
  3. Cao, Y.-T., Wang, J.-M., Sun, Y.-K. & Duan, X.-J. 2013. Circle marker based distance measurement using a single camera. Lecture Notes on Software Engineering, 1(4), 376-380.
  4. Cavanini, L., Cimini, G., Ferracuti, F., Freddi, A., Ippoliti, G., Monteriu, A. & Verdini, F. 2017. A QR-Code Localization System for Mobile Robots: Application to Smart Wheelchairs. 2017 European Conference on Mobile Robots (ECMR). 6-8 September, 2017, Parism France. pp 1-6.
  5. Chen, Z.-Y. & Chen, C.-T. 2018. A remote controlled robotic arm that reads barcodes and handles products. Inventions, 3(1), 17-28.
  6. Choi, C., Schwarting, W., DelPreto, J. & Rus, D. 2018. Learning object grasping for soft robot hands. IEEE Robotics and Automation Letters, 3(3), 2370-2377.
  7. Du, G., Wang, K., Lian, S. & Zhao, K., 2021. Vision-based robotic grasping from object localization, object pose estimation to grasp estimation for parallel grippers: A review. Artificial Intelligence Review, 54(7), 1677-1734.
  8. Fantoni, G., Santochi, M., Dini, G., Tracht, K,. Scholz-Reiter, B., Fleischer, J., Lien, T. K., Seliger, G., Reinhart, G. & Franke, J. 2014. Grasping devices and methods in automated production processes. The International Academy for Production Engineering (CIRP Annals), 63(2), 679-701.
  9. He, L., Yang, J., Kong, B. & Wang, C. 2017. An automatic measurement method for absolute depth of objects in two monocular images based on sift feature. Applied Sciences, 7(6), 517.
  10. Ishak, A. J. & Mahmood, S. N. 2019. Eye in hand robot arm based automated object grasping system. Periodicals of Engineering and Natural Sciences, 7(2), 555-566.
  11. Jaghbeer, Y., Hanson, R. & Johansson, M. I. 2020. Automated order picking systems and the links between design and performance: A systematic literature review. International Journal of Production Research, 58(15), 4489-4505.
  12. Krug, R., Stoyanov, T., Tincani,V., Andreasson, H., Mosberger, R., Fantoni, G. & Lilienthal A. J. 2016. The next step in robot commissioning: Autonomous picking and palletizing. IEEE Robotics and Automation Letters, 1(1) , 546-553.
  13. Levine, S., Pastor, P., Krizhevsky, A. & Quillen, D. 2018. Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collection. The International Journal of Robotics Research, 37(4-5), 421-436.
  14. Liang, C., Chee, K.J., Zou, Y., Zhu, H., Causo, A., Vidas, S., Teng, T., Chen, I., Low, K. & Cheah, C. 2015. Automated Robot Picking System for E-Commerce Fulfillment Warehouse Application. 2015. Proceedings of the 14th International Federation for the Promotion of Mechanism and Machine Science (IFToMM) World Congress. 30 October, 2015, Taipei, Taiwan. pp 398-403.
  15. Lin, G. & Chen, X. 2011. A robot indoor position and orientationm based on 2D barcode landmark. Journal Of Computers (JCP), 6(6), 1191-1197.
  16. Liu, F., Zhang, J., Wang, J. & Li, B. 2020. The indoor localization of a mobile platform based on monocular vision and coding images. ISPRS International Journal of Geo-Information (IJGI), 9(2), 122.
  17. Niu, Z., Zhao Y., Hu, J., Wang, D., Dong, L. & Wang, L. 2018. Explore the development and application of electrical automation control systems. Smart Construction Research, 2(4), 1-6.
  18. Ong, J. O. & Joseph, D. T. 2014. A review of order picking improvement methods. J@TI Undip: Jurnal Teknik Industri, 9(3), 135-138.
  19. Pujari, T. S. & Deosarkar, S. 2017. Design of Intelligent and Robotic Library System. 2017 2nd IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology (RTEICT). 19-20 May, 2017, Bangalore, India. pp 1903-1908.
  20. Ramnath, K. 2004. A Framework for Robotic Vision-Based Grasping Task. Project report, The Robotics Institute, Carnegie Mellon University.
  21. Saxena A., Wong L., Quigley M. & Ng A.Y. 2010. A vision-based system for grasping novel objects in cluttered environments. In: Kaneko M., Nakamura Y. (Eds.). Robotics Research. Springer Tracts in Advanced Robotics, (Vol 66). Berlin, Heidelberg, Springer.
  22. Sazdovski, V. & Silson, P. M. 2011. Inertial navigation aided by vision-based simultaneous localization and mapping. IEEE Sensors Journal, 11(8), 1646-1656.
  23. Tan, S.J. QR code. (https://foxdesignsstudio.com/uploads/pdf/Three_QR_Code.pdf). Last accessed on 15 October 2020.
  24. Yu, X., Fan, Z., Wan, H., He, Y., Du, J., Li, N., Yuan, Z. & Xiao, G. 2019. Positioning, navigation, and book accessing/returning in an autonomous library robot using integrated binocular vision and QR code identification systems. Sensors, 19(4), 783.
  25. Zhihong, C., Hebin, Z., Yanbo, W., Binyan, L. & Yu, L. 2017. A Vision-Based Robotic Grasping System Using Deep Learning for Garbage Sorting. 2017 36th Chinese Control Conference (CCC). 26-28 July, 2017, Dalian, China. pp 11223-11226.
  26. Zhong, X., Zhou, Y. & Liu, H. 2017. Design and recognition of artificial landmarks for reliable indoor self-localization of mobile robots. International Journal of Advanced Robotic Systems, 14(1), 1729881417693489.