Self-Supervised Leaf Segmentation under Complex Lighting Conditions

Lin, Xufeng and Li, Chang-Tsun and Adams, Scott and Kouzani, Abbas Z. and Jiang, Richard and He, Ligang and Hu, Yongjian and Vernon, Michael and Doeven, Egan H. and Webb, Lawrence and Mcclellan, Todd and Guskic, Adam (2023) Self-Supervised Leaf Segmentation under Complex Lighting Conditions. Pattern Recognition, 135: 109021. ISSN 0031-3203

[thumbnail of 2203.15943]
Text (2203.15943)
2203.15943.pdf - Accepted Version
Available under License Creative Commons Attribution-NonCommercial-NoDerivs.

Download (11MB)


As an essential prerequisite task in image-based plant phenotyping, leaf segmentation has garnered increasing attention in recent years. While self-supervised learning is emerging as an effective alternative to various computer vision tasks, its adaptation for image-based plant phenotyping remains rather unexplored. In this work, we present a self-supervised leaf segmentation framework consisting of a self-supervised semantic segmentation model, a color-based leaf segmentation algorithm, and a self-supervised color correction model. The self-supervised semantic segmentation model groups the semantically similar pixels by iteratively referring to the self-contained information, allowing the pixels of the same semantic object to be jointly considered by the color-based leaf segmentation algorithm for identifying the leaf regions. Additionally, we propose to use a self-supervised color correction model for images taken under complex illumination conditions. Experimental results on datasets of different plant species demonstrate the potential of the proposed self-supervised framework in achieving effective and generalizable leaf segmentation.

Item Type:
Journal Article
Journal or Publication Title:
Pattern Recognition
Additional Information:
This is the author’s version of a work that was accepted for publication in Pattern Recognition. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Pattern Recognition, 135, 2023 DOI: 10.1016/j.patcog.2022.109021
Uncontrolled Keywords:
?? self-supervised learningconvolutional neural networksimage-based plant phenotypingleaf segmentationcolor correctioncannabisartificial intelligencesignal processingsoftwarecomputer vision and pattern recognition ??
ID Code:
Deposited By:
Deposited On:
29 Sep 2022 11:45
Last Modified:
12 Nov 2023 01:01