Kiwifruit recognition at nighttime using artificial lighting based on machine vision

Fu Longsheng, Wang Bin, Cui Yongjie, Su Shuai, Yoshinori Gejima, Taiichi Kobayashi

Abstract


Most researches involved so far in kiwifruit harvesting robot suggest the scenario of harvesting in daytime for taking advantage of sunlight. A robot operating at nighttime can overcome the problem of low work efficiency and would help to minimize fruit damage. In addition, artificial lights can be used to ensure constant illumination instead of the variable natural sunlight for image capturing. This paper aims to study the kiwifruit recognition at nighttime using artificial lighting based on machine vision. Firstly, an RGB camera was placed underneath the canopy so that clusters of kiwifruits could be included in the images. Next, the images were segmented using an R-G color model. Finally, a group of image processing conventional methods, such as Canny operator were applied to detect the fruits. The image processing results showed that this capturing method could reduce the background noise and overcome any target overlapping. The experimental results showed that the optimal artificial lighting ranged approximately between 30-50 lx. The developed algorithm detected 88.3% of the fruits successfully.
Keywords: Elliptic Hough transform, image capturing method, Kiwifruit, minimal bounding rectangle, optimal illumination intensity
DOI: 10.3965/j.ijabe.20150804.1576

Citation: Fu L S, Wang B, Cui Y J, Su S, Gejima Y, Kobayashi T. Kiwifruit recognition at nighttime using artificial lighting based on machine vision. Int J Agric & Biol Eng, 2015; 8(4): 52－59.

Keywords


Elliptic Hough transform, image capturing method, Kiwifruit, minimal bounding rectangle, optimal illumination intensity

Full Text:

PDF

References


Sun Z. Fruit area and yield was increased 12 years in shannxi. China Fruit News, 2013; 30(1): 44–45. (in Chinese with English abstract)

Gao X D, Wu P T, Zhao X N, Wang J W, Shi Y G, Zhang B Q, et al. Estimation of spatial soil moisture averages in a large gully of the loess plateau of china through statistical and modeling solutions. Journal of Hydrology, 2013; 486: 466–478. Doi: 10.1016/j.jhydrol.2013.02.026.

Zhao Z, Gao X, Huang Q, Huang L, Qin H, Kang Z. Identification and characterization of the causal agent of bacterial canker of kiwifruit in the shaanxi province of china. J Plant Pathol, 2013; 95(1): 155–162. Doi: 10.4454/JPP. V95I1.005.

Miller S A, Broom F D, Thorp T G, Barnett A M. Effects of leader pruning on vine architecture, productivity and fruit quality in kiwifruit (actinidia deliciosa cv. Hayward). Sci Hortic, 2001; 91(3–4): 189–199. Doi: 10.1016/S0304- 4238(01)00259-X.

Chen Y, Chen X, Liu Y. Study on frame type of kiwifruit. North Hortic, 2012; 14: 56–57. (in Chinese with English abstract)

Fu L, Zhang F, Gejima Y, Li Z, Wang B, Cui Y. Development and experiment of end-effector for kiwifruit harvesting robot. Trans Chin Soc Agric Mach, 2015; 46(3): 1–8. Doi: 10.6041/j.issn.1000-1298.2015.03.001. (in Chinese with English abstract)

Zhao D, Lv J, Ji W, Zhang Y, Chen Y. Design and control of an apple harvesting robot. Biosyst Eng, 2011; 110(2): 112–122. Doi: 10.1016/j.biosystemseng.2011.07.005.

Ji W, Zhao D, Cheng F, Xu B, Zhang Y, Wang J. Automatic recognition vision system guided for apple harvesting robot. Comput Electr Eng, 2012; 38(5): 1186–1195. Doi: 10.1016/j.compeleceng.2011.11.005.

Lü Q, Cai J, Liu B, Deng L, Zhang Y. Identification of fruit and branch in natural scenes for citrus harvesting robot using machine vision and support vector machine. Int J Agric Biol Eng, 2014; 7(2): 115–121. Doi: 10.3965/j.ijabe.20140702. 014.

Mehta S S, Burks T F. Vision-based control of robotic manipulator for citrus harvesting. Comput Electron Agric, 2014; 102(0): 146–158. Doi: 10.1016/j.compag.2014.01.003.

Hannan M, Burks T, Bulanon D M. A machine vision algorithm combining adaptive segmentation and shape analysis for orange fruit detection. Agric Eng Int: CIGR J, 2009; XI: Manuscript 1281.

Muscato G, Prestifilippo M, Abbate N, Rizzuto I. A prototype of an orange picking robot: Past history, the new robot and experimental results. Industrial Robot: An Int J, 2005; 32(2): 128–138. Doi: 10.1108/01439910510582255.

Feng Q, Cheng W, Zhou J, Wang X. Design of structured-light vision system for tomato harvesting robot. Int J Agric Biol Eng, 2014; 7(2): 19–26. Doi: 10.3965/j.ijabe. 20140702.003.

Ding Y, Geng N, Zhou Q. Research on the object extraction of kiwifruit based on images. Microcomput Inf, 2009; 25(18): 294–295. (in Chinese with English abstract)

Scarfe A J, Flemmer R C, Bakker H, Flemmer C L, editors. Development of an autonomous kiwifruit picking robot. Autonomous Robots and Agents, 4th International Conference on; 2009: IEEE.

Wu T, Yuan C, Chen J. Research on the object extraction of kiwifruit based on machine vision. J Agric Mech Res, 2012; 34(12): 21–26. Doi: 10.3969/j.issn.1003-188X.2012.12.005. (in Chinese with English abstract)

Cui Y, Su S, Wang X, Tian Y, Li P, Zhang F. Recognition and feature extraction of kiwifruit in natural environment based on machine vision. Trans Chin Soc Agric Mach, 2013; 44(05): 247–252. Doi: 10.6041/j.issn.1000-1298.2013. 05.043. (in Chinese with English abstract)

Zhan W, He D, Shi S. Recognition of kiwifruit in field based on adaboost algorithm. Trans Chin Soc Agric Eng, 2013; 29(23): 140–146. Doi: 10.3969/j.issn.1002-6819.2013. 23.019. (in Chinese with English abstract)

Mu J, Chen J, Sun G, Liu F, Ma Y, Wang F. Characteristic parameters extraction of kiwifruit based on machine vision. J Agric Mech Res, 2014; 36(6): 138–142. Doi: 10.13427/j.cnki. njyi.2014.06.035. (in Chinese with English abstract)

Hayashi S, Shigematsu K, Yamamoto S, Kobayashi K, Kohno Y, Kamata J, et al. Evaluation of a strawberry-harvesting robot in a field test. Biosyst Eng, 2010; 105(2): 160–171. Doi: 10.1016/j.biosystemseng.2009. 09.011.

Cui Y, Su S, Lv Z, Li P, Ding X. A method for separation of kiwifruit adjacent fruits based on hough transformation. J Agric Mech Res, 2012; 34(12): 166–169. Doi: 10.3969/j.issn. 1003-188X.2012.12.041. (in Chinese with English abstract)

Otsu N. A threshold selection method from gray-level histograms. Autom, 1975; 11(285-296): 23–27. Doi: 10.1109/TSMC.1979.4310076

Canny J. A computational approach to edge detection. Pattern Analysis and Machine Intelligence, IEEE Transactions on. 1986; (6): 679–698. Doi: 10.1109/ TPAMI.1986.4767851.

Al-Mallahi A, Kataoka T, Okamoto H, Shibata Y. An image processing algorithm for detecting in-line potato tubers without singulation. Comput Electron Agric, 2010; 70(1): 239–244. Doi: 10.1016/j.compag.2009.11.001.

Pastrana J C, Rath T. Novel image processing approach for solving the overlapping problem in agriculture. Biosyst Eng, 2013; 115(1): 106–115. Doi: 10.1016/j.biosystemseng.2012. 12.006.

Wu X, Wang D, Sheng H. An algorithm and implementaion for obtaining minimum exterior rectangle of image region. Comput Eng, 2004; 30(12): 124–125, 42. Doi: 10.3969/j.issn.1000-3428.2004.12.048.

Xie Y, Ji Q, editors. A new efficient ellipse detection method. Pattern Recognition 16th International Conference on; 2002: IEEE




Copyright (c)



2023-2026 Copyright IJABE Editing and Publishing Office