Automatic detection and counting of wheat spike based on DMseg-Count

Abstract The automatic detection and counting of wheat spike images are of great significance for yield prediction and variety evaluation. Therefore, accurate and timely estimation of spike numbers is crucial for wheat production. However, in actual production, due to the susceptibility of wheat spi...

Full description

Saved in:
Bibliographic Details
Main Authors: Hecang Zang, Yilong Peng, Meng Zhou, Guoqiang Li, Guoqing Zheng, Hualei Shen
Format: Article
Language:English
Published: Nature Portfolio 2024-11-01
Series:Scientific Reports
Subjects:
Online Access:https://doi.org/10.1038/s41598-024-80244-1
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1823862128778412032
author Hecang Zang
Yilong Peng
Meng Zhou
Guoqiang Li
Guoqing Zheng
Hualei Shen
author_facet Hecang Zang
Yilong Peng
Meng Zhou
Guoqiang Li
Guoqing Zheng
Hualei Shen
author_sort Hecang Zang
collection DOAJ
description Abstract The automatic detection and counting of wheat spike images are of great significance for yield prediction and variety evaluation. Therefore, accurate and timely estimation of spike numbers is crucial for wheat production. However, in actual production, due to the susceptibility of wheat spike images to factors such as lighting conditions, shooting angles, occlusion, and overlap, the contour and features of wheat spike is unclear, which affects the accuracy of automatic detection and counting of wheat spike. In order to solve the above problems and further improve the accuracy of wheat spike counting, an improved wheat spike counting model DMseg-Count was proposed by enhancing local contextual supervision information based on existing target object counting model DM-Count. Firstly, wheat spike local segmentation branch was introduced to improve the network architecture of DM-Count, so as to extract the local contextual supervision information of wheat spike. Secondly, an element-by-element point multiplication mechanism was designed to fuse global and local contextual supervision information of wheat spike. Finally, the total loss function was constructed to optimize the model. The test results showed that the mean absolute error (MAE) and root mean square error (RMSE) of the proposed DMseg-Count model were 5.79 and 7.54, respectively, which were 9.76 and 10.91 higher than the standard distribution matching for crowd counting (DM-Count) model. Compared with other deep learning models, the proposed DMseg-Count model can detect wheat spike image in challenging situations, and has better computer vision processing capabilities and performance evaluation detection effect. In summary, the proposed DMseg-Count model can effectively detect wheat spike and has good counting performance, which provides a new method for automatic counting of wheat spike and yield prediction in complex field environments.
format Article
id doaj-art-1e7dc4da0da24a57acc9b18705517eaa
institution Kabale University
issn 2045-2322
language English
publishDate 2024-11-01
publisher Nature Portfolio
record_format Article
series Scientific Reports
spelling doaj-art-1e7dc4da0da24a57acc9b18705517eaa2025-02-09T12:37:55ZengNature PortfolioScientific Reports2045-23222024-11-0114111510.1038/s41598-024-80244-1Automatic detection and counting of wheat spike based on DMseg-CountHecang Zang0Yilong Peng1Meng Zhou2Guoqiang Li3Guoqing Zheng4Hualei Shen5Institute of Agricultural Information Technology, Henan Academy of Agricultural SciencesInstitute of Agricultural Information Technology, Henan Academy of Agricultural SciencesInstitute of Agricultural Information Technology, Henan Academy of Agricultural SciencesInstitute of Agricultural Information Technology, Henan Academy of Agricultural SciencesInstitute of Agricultural Information Technology, Henan Academy of Agricultural SciencesCollege of Computer and Information Engineering, Henan Normal UniversityAbstract The automatic detection and counting of wheat spike images are of great significance for yield prediction and variety evaluation. Therefore, accurate and timely estimation of spike numbers is crucial for wheat production. However, in actual production, due to the susceptibility of wheat spike images to factors such as lighting conditions, shooting angles, occlusion, and overlap, the contour and features of wheat spike is unclear, which affects the accuracy of automatic detection and counting of wheat spike. In order to solve the above problems and further improve the accuracy of wheat spike counting, an improved wheat spike counting model DMseg-Count was proposed by enhancing local contextual supervision information based on existing target object counting model DM-Count. Firstly, wheat spike local segmentation branch was introduced to improve the network architecture of DM-Count, so as to extract the local contextual supervision information of wheat spike. Secondly, an element-by-element point multiplication mechanism was designed to fuse global and local contextual supervision information of wheat spike. Finally, the total loss function was constructed to optimize the model. The test results showed that the mean absolute error (MAE) and root mean square error (RMSE) of the proposed DMseg-Count model were 5.79 and 7.54, respectively, which were 9.76 and 10.91 higher than the standard distribution matching for crowd counting (DM-Count) model. Compared with other deep learning models, the proposed DMseg-Count model can detect wheat spike image in challenging situations, and has better computer vision processing capabilities and performance evaluation detection effect. In summary, the proposed DMseg-Count model can effectively detect wheat spike and has good counting performance, which provides a new method for automatic counting of wheat spike and yield prediction in complex field environments.https://doi.org/10.1038/s41598-024-80244-1Field phenotypingWheatSpike countingDeep learningLocal segmentation branch
spellingShingle Hecang Zang
Yilong Peng
Meng Zhou
Guoqiang Li
Guoqing Zheng
Hualei Shen
Automatic detection and counting of wheat spike based on DMseg-Count
Scientific Reports
Field phenotyping
Wheat
Spike counting
Deep learning
Local segmentation branch
title Automatic detection and counting of wheat spike based on DMseg-Count
title_full Automatic detection and counting of wheat spike based on DMseg-Count
title_fullStr Automatic detection and counting of wheat spike based on DMseg-Count
title_full_unstemmed Automatic detection and counting of wheat spike based on DMseg-Count
title_short Automatic detection and counting of wheat spike based on DMseg-Count
title_sort automatic detection and counting of wheat spike based on dmseg count
topic Field phenotyping
Wheat
Spike counting
Deep learning
Local segmentation branch
url https://doi.org/10.1038/s41598-024-80244-1
work_keys_str_mv AT hecangzang automaticdetectionandcountingofwheatspikebasedondmsegcount
AT yilongpeng automaticdetectionandcountingofwheatspikebasedondmsegcount
AT mengzhou automaticdetectionandcountingofwheatspikebasedondmsegcount
AT guoqiangli automaticdetectionandcountingofwheatspikebasedondmsegcount
AT guoqingzheng automaticdetectionandcountingofwheatspikebasedondmsegcount
AT hualeishen automaticdetectionandcountingofwheatspikebasedondmsegcount