Research Article | Open Access
Meiyan Shu, Shuaipeng Fei, Bingyu Zhang, Xiaohong Yang, Yan Guo, Baoguo Li, Yuntao Ma, "Application of UAV Multisensor Data and Ensemble Approach for High-Throughput Estimation of Maize Phenotyping Traits", Plant Phenomics, vol. 2022, Article ID 9802585, 17 pages, 2022. https://doi.org/10.34133/2022/9802585
Application of UAV Multisensor Data and Ensemble Approach for High-Throughput Estimation of Maize Phenotyping Traits
High-throughput estimation of phenotypic traits from UAV (unmanned aerial vehicle) images is helpful to improve the screening efficiency of breeding maize. Accurately estimating phenotyping traits of breeding maize at plot scale helps to promote gene mining for specific traits and provides a guarantee for accelerating the breeding of superior varieties. Constructing an efficient and accurate estimation model is the key to the application of UAV-based multiple sensors data. This study aims to apply the ensemble learning model to improve the feasibility and accuracy of estimating maize phenotypic traits using UAV-based red-green-blue (RGB) and multispectral sensors. The UAV images of four growth stages were obtained, respectively. The reflectance of visible light bands, canopy coverage, plant height (PH), and texture information were extracted from RGB images, and the vegetation indices were calculated from multispectral images. We compared and analyzed the estimation accuracy of single-type feature and multiple features for LAI (leaf area index), fresh weight (FW), and dry weight (DW) of maize. The basic models included ridge regression (RR), support vector machine (SVM), random forest (RF), Gaussian process (GP), and K-neighbor network (K-NN). The ensemble learning models included stacking and Bayesian model averaging (BMA). The results showed that the ensemble learning model improved the accuracy and stability of maize phenotypic traits estimation. Among the features extracted from UAV RGB images, the highest accuracy was obtained by the combination of spectrum, structure, and texture features. The model had the best accuracy constructed using all features of two sensors. The estimation accuracies of ensemble learning models, including stacking and BMA, were higher than those of the basic models. The coefficient of determination () of the optimal validation results were 0.852, 0.888, and 0.929 for LAI, FW, and DW, respectively. Therefore, the combination of UAV-based multisource data and ensemble learning model could accurately estimate phenotyping traits of breeding maize at plot scale.
Leaf area index (LAI) is one of key traits of characterizing crop growth, which is highly relevant to crop photosynthesis and transpiration [1–3]. Aboveground biomass (AGB) is an important basis for crop yield formation [4, 5]. Therefore, accurate and rapid estimation of maize LAI and AGB is helpful for high-throughput screening of breeding maize.
The manual measurement of crop phenotypic traits is intensive in terms of both labor and time [6–8]. Moreover, destructive sampling of a large area in the field will affect crop growth. In recent years, unmanned aerial vehicle (UAV) imaging technology provides an effective means to obtain crop phenotypic traits at plot scale [9, 10]. UAV imaging technology has been widely used to research of phenotypic trait estimation for crop breeding, including emergence rate , LAI [12, 13], plant height , biomass , and lodging .
Many research findings revealed that the spectrum, structure, texture, temperature, and other information extracted from UAV images can be used for estimating crop phenotypic traits [17, 18]. Spectrum, structure and texture information have been widely used in estimating crop LAI, above ground biomass, yield, nitrogen content, and chlorophyll content [12, 13, 19, 20]. The fusion of multisource data can complement each other to improve the accuracy of estimating crop phenotypic traits . For example, the combination of structure and spectrum can effectively solve the problem of spectrum saturation at later crop growth stage [22–24]. The potential of multisource data fusion in estimating phenotypic traits of different breeding maize materials need to be further explored.
Machine learning methods can estimate crop phenotypic traits with high accuracy [25–27], which have strong ability to solve nonlinear problems and flexibility of integrating multisource data [28–30]. Commonly used machine learning algorithms include such as support vector machines (SVM), random forests (RF), and artificial neural networks (ANN). However, these methods are prone to overfitting in the case of limited training samples . Ensemble learning is an extension of machine learning and can improve the generalization ability by integrating the output results of each base model through secondary learning methods [30, 31]. There are three common ensemble learning methods, including bagging, boosting, and stacking [32, 33]. The ensemble methods of bagging and boosting can perform secondary learning by assigning higher weights to the samples with poor training effect, which improves the model prediction accuracy and generalization ability [34, 35]. However, these two methods can only integrate the same type of decision tree models, and have difficulty with integrating the advantages of different types of models. Stacking is a hierarchical model integration framework. Firstly, different types of basic models are used to train the dataset. Secondly, the training results obtained by each basic model are formed into a new training set as the input of the second learning to make the final decision [36, 37]. Because outputs are derived from multiple basic models, the stacking ensemble learning can increase accuracy, robustness, and overall generalization of the estimation model [32, 33, 38]. At present, there has been limited research on phenotypic traits for breeding maize materials using UAV-based multisource data and ensemble learning model. In the reported studies, various machine learning including deep learning methods have been proposed to fuse multisource image data for assessing crop traits. These models have achieved good accuracy on specific crops in specific areas, but it is difficult to prove the universality of these models. Through two phases of learning, ensemble models may have the potential to unify the result from different models, which are more beneficial than traditional machine learning methods.
Due to the uncertainty of model parameter and structure, Bayesian Model Averaging (BMA) takes the posterior probability of each basic models as weights in the secondary learning to obtain a more reliable probability distribution of predictive variables [39, 40] BMA is considered the most popular modeling method for avoiding the uncertainty in the modeling process, which can produce more reliable and accurate prediction results. At present, BMA has been widely used in various fields [41–43].
The primary objective of this study was to use UAV-based digital and multispectral data for estimating phenotypic traits of breeding maize materials across all growth stages by ensemble learning method. Specific objectives were as follows: (1) test the application potential of spectrum, texture, and structure information and their combinations in estimating maize phenotypic traits, such as LAI, FW, and DW; (2) compare the performances of five basic models of machine learning and two ensemble models; and (3) evaluate if data fusion and ensemble learning can improve the accuracy and stability of estimating phenotypic traits for breeding maize materials.
2. Material and Methods
2.1. Study Area and Experimental Setup
The experimental site lied in the Xinxiang County, Henan Province, China (113°51 E, 35°18 N) (Figure 1).
Xinxiang County belongs to warm temperate continental monsoon climate zone. The average annual temperature is 14°C in year 2020. The average precipitations are about 550 mm in year 2020 with the wettest months in July and August. Due to the flat terrain and the fertile soil, the maize yield in Xinxiang County is generally very high.
The sowed maize inbred line had extensive genetic diversity, which included 483 varieties used in the experiment. The sowing dates were June 23, 2020. Each genotypic material was sowed on a plot. Zheng58 was used as reference material and sowed every 50 plant lines. There were 492 plots in total. The width of each plot was 1.2 m, while the length was 2.5 m. The row spacing of each plot was 0.6 m, while the plant spacing was 0.25 m. The fertilization and irrigation modes in each plot were the same and consistent with the local conventional modes.
2.2. Data Acquisition
2.2.1. Sample Data Collection
According to genetic diversity estimation, we selected 55 plots as samples for measuring the phenotypic traits, including dry weight (DW), plant height (PH), LAI, and fresh weight (FW). The growth of maize plants in the sampling plots was relatively uniform. In order not to affect the grain yield measurement in the harvest stage, one plant representing the average growth in each plot was selected in each observation stage. The measuring dates include July 20, July 30, August 18, and September 18, 2020, corresponding to the , , , and , respectively. Detailed information on PH measurement is found in the study of Shu et al. . We cut off the maize plant from the root. The LAI was calculated by the maximum width and length of each leaf according to the method of Montgomery . The stem, leaves, and ears of the sampling plant were separated and measured their FW, respectively. Then the organs of the sample plant were put in envelopes, respectively, and dried to constant weight. The total FW and DW (g/m2) of the sampling plot was calculated by the planting density and the FW and DW of sample plant. Due to the inconsistency of seedling emergence rate in each observation stage, the planting density was determined by number of actual plants per plot.
2.2.2. UAV Imaging
The UAV-based RGB and multispectral images were obtained on the same day of field observation. Before imaging, we evenly arranged 11 ground control points (GCPs) (Figure 1), and fixed their position with the RTK (CHCNAV - T8, Shanghai, China).
The UAV-based RGB data were obtained using by DJI Phantom 4 Pro v2.0 (DJI, Shenzhen, China) in this study. The duration of UAV is around 30 minutes. The imaging sensor is 20 megapixels with the RGB image resolution of . The altitude was set to 30 m. The overlap ratio of images was 80%. The stitching of RGB images was carried out in Agisoft PhotoScan Professional (Agisoft LLC, St. Petersburg, Russia). During image splicing, 11 GCPs were used for geometric correction. Finally, we acquired the digital surface model (DSM) and digital orthophoto model (DOM) of the experimental site.
The multispectral images were acquired using by the Parrot Sequoia imaging system (MicaSense Inc., Seattle, USA). The Sequoia sensor can obtain four multispectral bands, including near-infrared, red edge, and red and green bands. Different bands have different bandwidths. Among the four bands, the bandwidth of red-edge band is 10 nm, and the other three are all 40 nm. The imaging system contains the sunshine sensor. During the flight, the multispectral images can be automatically calibrated by the sunshine sensor with the change of light . The flight height and overlap rate of UAV-based multispectral images were the same as the UAV-based RGB images. Radiometric calibration was performed using standard whiteboard images of four bands which were acquired before the flight. The stitching of multispectral images was carried out in the Pix4Dmapper (PIX4D, Lausanne, Switzerland). Similar to the stitching process of RGB images, 11 GCPs were used for geometric correction. Figure 2 shows the RGB (a) and multispectral (b) images of UAV acquired on July 30, 2020.
2.3. Feature Extraction
Compared with multispectral images, the RGB images obtained at the same flight height have higher spatial resolution and are more useful for texture information extraction. In this study, RGB images were used to obtain canopy coverage, PH, and texture information of each plot. The DN value of RGB images is less sensitive to the changes of light intensity. Studies showed that the spectral indices calculated based on the DN value of RGB images could be used to estimate crop phenotypic traits [12, 13]. Therefore, a series of spectral vegetation indices were calculated using the DN value of RGB images and the reflectance of multispectral images to estimate LAI, FW, and DW of maize plants. The extraction process of UAV-based feature variables is shown in Figure 3.
2.3.1. Canopy Coverage
Canopy coverage represents the proportion of crop canopy vertical projection area to ground area [7, 8, 46]. Canopy coverage can reflect the growth status of crops [2, 7, 8]. As the spatial resolution of RGB image was higher than that of the multispectral image, the canopy coverage of each plot was extracted based on the RGB image. In this study, we used the SVM classifier to extract maize pixels for calculating the canopy coverage of each plot . SVM classifier was obtained by calling scikit-learn library based on Python 3.6. The pixels of RGB image of each sample plot at each growing stage was classified into maize, soil, shadow, and others. The vector files obtained in ArcGIS 10.6 (ESRI, Redlands, USA) and SVM classifier were used to segment the images, extract maize plants, and calculate the canopy coverage of each plot in Python 3.6. The RGB images containing only maize plants were obtained through the mask.
2.3.2. Plant Height Estimation
PH is an important parameter to describe the crop growth status, which is proportional to dry weight of maize plant and is highly relevant to above-ground biomass and grain yield [48, 49]. Therefore, PH was used as an independent variable to participate in the model construction of LAI, FW, and DW. The difference between DSM and DEM can be used to estimate the crop PH . The detailed process of plant height estimation was referred to the study of Shu et al. .
2.3.3. Texture Information
Texture information is a common visual phenomenon. The texture information can quantify the attributes of surface structure and organization arrangement. Gray-level cooccurrence matrix (GLCM) is a widely used method to extract texture information [12, 13], which reflects the information of direction, distance, and gray changes of the image. The RGB image only including maize plants was transformed into the gray image. Then the texture information of each plot was extracted, and the specific parameters included mean, variance, contrast, energy, entropy, homogeneity, autocorrelation, dissimilarity, and correlation. After many attempts, the size of the sliding window was set as , and the sliding step was set as 2.
2.3.4. Vegetation Indices
The same as the RGB images processing method, we obtained the multispectral images containing only maize plants. The reflectance of each band of maize canopy in each plot was extracted from RGB images and multispectral images. In the research of crop growth, it is a common method to estimate crop phenotypic traits using vegetation indices constructed by specific bands as independent variables. These vegetation indices with certain physical significance not only enhance a certain signal of vegetation, but also reduce the influence of solar irradiance, canopy structure, soil background, and other factors . According to the vegetation indices used in previous studies on crop agronomic parameters, 15 commonly used vegetation indices were calculated from RGB images (Table 1), and 18 vegetation indices were calculated from multispectral images (Table 2).
Note: g: green; r: red; re: red-edge; nir: near-infrared.
2.4. Modeling Methods
A variety of feature variables extracted from UAV-based images were used as input variables to construct the estimation models of LAI, FW, and DW. Modeling methods included base machine learning model and ensemble learning model. The former included ridge regression (RR), SVM, random forest (RF), Gaussian process (GP), and K-neighbor network (K-NN). The uncertainty of the prediction results caused by the model structure and parameters may lead to the fact that the results of a base model may not well represent the relationship between the variables . Compared with the individual models, the ensemble learning model can comprehensively consider the performance of each model and obtain more reliable results . Therefore, two ensemble learning methods, stacked generalization and BMA, were used to compare with the basic models to improve the accuracy and reliability of LAI, FW, and DW estimation. The RR, SVR, RF, GPR, and K-NN were used as the basic models for ensemble learning.
Stacked generalization was put forward by Breiman , which is the generalization of multiple layers and models into a new model. Simple stacking generally includes primary and secondary models. The primary model is trained based on the original data, and then the output of the primary model is applied to the secondary model as a new input. In order to avoid the data overfitting, the training set is usually divided into parts, and the cross-validation is used to train each model [10, 32, 33]. In general, the stacking model outperform than that of the basic model.
BMA is a special case of stacked generalization, which uses the posterior weights instead of multiple linear regression (MLR) to combine predictions of basic learners. BMA combines the Bayesian theory with model averaging, and the final model is obtained by a posteriori probability weighted averaging based on the model mathematical structure and all unknown parameters [81, 82]. BMA considers the uncertainty caused by model selection, including parameter uncertainty and model uncertainty. BMA use Bayesian theorem to obtain the model parameter and the posterior distribution of the model itself, can not only solve the problem of singularity model, but also directly select the model .
In this study, five machine learning methods superimposed on a two-layer model were used to estimate the LAI, FW, and DW of breeding maize based on UAV-based features. All the models were verified by 5-fold cross-validation.
The estimation models of RR, SVR, RF, GPR, and KNN were first constructed, respectively, and then the prediction results were used as input variables to train and verify in the secondary layer using MLR and BMA. Finally, the estimation results of LAI, FW, and DW were obtained. The flow of ensemble learning is shown in Figure 4.
2.5. Model Performance Evaluation
A total of 220 samples were obtained at the four growth stages. 75% of the samples were used as the training set to construct the model, and the remaining 25% were used as the testing set to evaluate the model accuracy. In order to eliminate the random error, the modeling process was repeated for 100 times. The average result of the 100 repetitions was taken as the final result. The model evaluation indices include the determination coefficient () and root mean square error (RMSE).
3.1. Statistical Description of Phenotypic Traits
The statistical results of the measured PH, LAI, FW, and DW are shown in Table 3. There were five statistical indicators, including mean, maximum (Max), minimum (Min), standard deviation (SD), and coefficient of variation (CV). The dispersion degree was large for each phenotypic trait, and the CV was more than 50%, indicating that the plant line and growth stage had a great influence on the canopy structure. The large data span also provided the basis for the robustness of the model.
Note: CV: coefficient of variation; SD: standard deviation.
3.2. Plant Height Estimation
For the sample data of four growth stages, the and RMSE range of measured and estimated PH was 0.509~0.694 and 0.109~0.250 m (Figure 5). At the first three stages, there was a slight PH underestimation. At the latter stages, the measured and estimated PH had good consistency. During the whole growth stages, the and RMSE of measured and estimated PH was 0.932 and 0.191 m, respectively, indicating that the maize PH based on RGB images had high estimation accuracy and could be used for the subsequent studies of LAI, FW, and DW. Figure 6 is the heat map of estimated plant height.
3.3. Correlation between Feature Variables and Phenotypic Traits
In order to explore the correlation between different feature variables and LAI, FW, and DW, Pearson correlation analysis were conducted between UAV image features and measured phenotypic traits (Figure 7). PH and canopy coverage were highly correlated with phenotypic traits (Figure 7(a)). The correlation coefficients between PH and LAI, FW, and DW were 0.845, 0.866, and 0.928, respectively, indicating that structural parameters had great potential in estimating crop phenotype. The texture information was also strongly correlated with phenotypic traits (Figure 7(b)). The correlation between RGB spectral vegetation indices and phenotypic traits was the worst, especially LAI. Most RGB spectral vegetation indices were weakly correlated with LAI.
3.4. Validation of Phenotypic Traits
Tables 4–6 show the mean values of and RMSE of LAI, FW, and DW models using all modeling methods in this study. Single-type feature variable combined with a base model could effectively estimate LAI, FW, and DW. The estimation accuracy was relatively close constructed with each base model. The model performance was slightly different due to different kinds of feature variables and phenotypic traits, among which RR and RF performed relatively better than the other three. Among the three kinds of features variables extracted from RGB images, the order of estimation accuracy was structural traits > texture > spectrum. In terms of five base models, the mean values of of LAI, FW, and DW of the optimal estimation models constructed by RGB structural parameters were 0.819, 0.859, and 0.858, respectively, for the validation dataset. The estimation with multispectral vegetation indices was much higher than that with the vegetation indices from visible light bands. For the validation dataset, of LAI, FW, and DW estimation increased by 55.680%, 32.663%, and 27.209%, respectively.
Note: Spe: spectral features; Str: structure features; Tex: texture features.
Note: Spe: spectral features; Str: structure features; Tex: texture features.
Note: Spe: spectral features; Str: structure features; Tex: texture features.
In order to compare the model performance before and after feature fusion, we analyzed the estimation accuracy of LAI, FW, and DW constructed by each basic modeling method. After the fusion of different feature variables, the estimation accuracy of various phenotypic traits was improved on the whole. For the RGB data, the model constructed using all feature variables simultaneously had the highest accuracy. As to the validation dataset, the mean values of of LAI, FW, and DW model were 0.821, 0.871, and 0.864, respectively. It showed that feature fusion for different variables could improve the model estimation accuracy. On the basis of using three kinds of feature variables derived from RGB images, we added the multispectral features to construct estimation model of various phenotypic traits. According to the optimal model, the estimation accuracy of FW and DW based on the two sensors was improved to a certain extent compared with the RGB or multispectral sensor. For the validation dataset of five basic models with multisensor features, of LAI, FW, and DW of the optimal estimation models were 0.836, 0.876, and 0.919, respectively. It indicated that multisensor data fusion could enhance the estimation accuracy and universality of the model. The optimal uncertainty estimates of three traits using GPR were shown in Supplement table 1-table 3.
The stacking and BMA models were used to further estimate the phenotypic traits by integrating the results of five base models. Regardless of multifeature variables or multisensor data fusion, the ensemble learning models performed better than the five basic models. Based on the ranking criteria of , the validation results of the optimal models for LAI, FW, and DW were 0.852, 0.887, and 0.929, respectively. The accuracy of ensemble learning model was slightly lower than that of RR when only structural parameters were used to estimate LAI. Although the ensemble learning model does not always performed best, it can minimize the deviation and randomness of the base model and make the model more stable. Therefore, the ensemble learning model further improved the generalization by combining the advantages of each basic model. Figure 8 shows the scatter plot of the measured DW, LAI, and FW against the estimated values with BMA model using validation dataset. A good estimation result was achieved for each phenotypic trait. However, there were still slight underestimations of phenotypic traits at the later growth stage of maize.
3.5. Mapping Maize Phenotypic Traits
The LAI, FW, and DW of breeding maize at four growth stages were estimated and mapped using BMA estimation model constructed based on feature variables obtained from two kinds of images. Figures 9–11 show the LAI, FW, and DW among maize lines at each growth stage and their dynamic changes of each plot. The range of the classes for each variable (LAI, FW, and DW) was based on the quantile method in ArcGIS software. The LAI showed similar spatial distribution at each stage, indicating that different maize lines had consistent growth rate. It may be closely related to the genetic characteristics of the maize lines. In addition, the LAI distribution was consistent with PH, FW, and DW. On the whole, the plots with higher PH and LAI had higher FW and DW. The FW and DW of maize lines in the single stage were different, which may be caused by the adaptability of different maize lines to the local environment. For example, the life cycle of tropical maize lines would lengthen in the warm temperate continental monsoon climate.
The maize PH was estimated using the UAV-based RGB images and validated with the measured values in this study. Good accuracy was achieved, and the was 0.9 between the measured and estimated PH. Four kinds of feature variables (spectrum, texture, structure, and vegetation indices) were extracted from the digital images or multispectral images. Five basic models and two ensemble learning models were adopted in the modeling method. For LAI, FW, and DW, the fusion of multiple features could improve the estimation accuracy, and the ensemble learning models further improved the accuracy. High accuracy was realized to estimate the phenotypic traits of breeding maize by integrating multisource data fusion and ensemble learning.
The spectrum, texture, and structure information of UAV-based image have been widely used in crop phenotyping research [84–86]. The multispectral vegetation indices showed strong correlation with phenotypic traits. This is because multispectral images have richer spectral bands than RGB images, especially in the near infrared band, which is helpful to improve the correlation between maize phenotypic traits and vegetation indices. Similar to previous studies, spectrum data can well estimate LAI, FW, and DW here. The structure parameters such as plant height and canopy coverage also achieved high precision, indicating the great potential in crop phenotypic extraction and application. However, the single data source may have limitations, such as the spectrum saturation in the later stage of crop growth [12, 13, 87, 88]. To effectively solve the problem of spectrum saturation in the middle and later stage of maize, we tried to fuse different feature variables to improve the accuracy and universality of the model [4, 48, 89, 90]. Spectral vegetation indices were a kind of parameter commonly used in estimation of aboveground biomass and LAI of crops [26, 27, 91]. In previous studies, spectrum was used to estimate crop phenotypic traits alone, and the model combined with plant height, canopy coverage, and texture information achieved more accurate estimation [18, 92–96]. Similar results were also found in this study. Among the spectrum, structure, and texture information, the structural parameters had the best performance. The structural parameters + texture or structural parameters + spectrum can improve the model precision, among which the structural parameters + texture + spectrum performed the best. Similarly, multisensor data fusion can help to improve the accuracy of estimating phenotypic traits [97–99]. For example, compared with using single-type data source, combination of spectrum and thermal infrared data can increase the overall estimation precision of the model [100, 101]. Different from wheat aboveground biomass estimation by using expensive UAV hyperspectral data , good accuracy was also achieved, and the cost of data acquisition were greatly saved for different types of feature variables obtained from digital and multispectral images used in this study to estimate LAI, FW, and DW of breeding maize.
Crop growth is influenced by variety, field management, and environment. The phenotypic traits have complicated relationships with spectrum, structural parameter, and texture information. The conventional linear regression modeling may be difficult to express their relationships. With the rapid development of data mining, artificial intelligence, and crop phenotyping, phenotypic research based on machine learning has become a hot topic [102, 103]. Compared with the traditional linear regression, machine learning can achieve classification or regression with high precision through self-learning [104, 105]. The machine learning methods commonly used in crop phenotypic study include RF, SVM, and artificial neural network [92, 106]. RF method generally performed better than other methods in estimating phenotypic traits by statistical regression [25, 45, 107]. As to the five base models used in this study, satisfactory results were obtained in estimating LAI, FW, and DW of breeding maize, among which RF and RR had better performance than the others. Improving the accuracy and reliability of phenotypic acquisition is a prerequisite for selecting excellent genotypes. The model integration can combine the advantages of multiple base models and has higher estimation accuracy, robustness, and overall induction ability [108–111]. Feng et al. [32, 33] predicted alfalfa yield using UAV-based hyperspectral data and found that the accuracy of the integrated model was superior to all basic models. Due to the practical limitations, we obtained the phenotypic traits of 55 sample plots at each growth stage. Compared with the large sample set, the output of various model may have great differences. Ensemble learning can provide a unified and consistent model through decision-level fusion. Therefore, taken five machine learning methods as basic models, the ensemble learning methods, included stacking and BMA, were used to improve the accuracy and reliability of maize phenotypic traits estimation. The results showed that both stacking and BMA performed better than the basic modeling methods in estimating the LAI, FW, and DW of breeding maize.
Our results showed that the fusion of multisource data combined with model ensemble learning method can estimate the LAI, FW, and DW of breeding maize with high accuracy. The study could provide significant guidance for UAV imaging technology to study crop phenotypes. In this study, only three phenotypic parameters were studied. The data fusion and model integration could be applied to more breeding phenotypic traits in the future, such as crop biochemical parameters, nitrogen content, chlorophyll content, and protein content. In addition, thermal infrared imaging can be used to obtain crop canopy temperature, which is widely used to monitor water stress, freezing stress, and yield estimation [94, 112, 113]. We will add thermal infrared data to further explore its ability in the estimation of breeding phenotypic traits in the follow-up study. Compared with conventional machine learning methods, deep learning can better mine the potential of data and greatly improve the research accuracy in many aspects [114, 115]. In the following studies, we will try to introduce the combination of deep learning and ensemble learning to further explore the application ability of UAV-based imaging technology in breeding maize phenotypes.
This study evaluated the contribution of different feature variables from RGB sensor, feature variable of same type from different sensors, and fusion data to LAI, FW, and DW of breeding maize. The integrated model framework was built based on five machine learning methods, including stacking and BMA, to estimate LAI, FW, and DW of maize. The results showed that no matter which modeling methods, the performance of multisource data fusion was better than that of single kind of feature variables on estimating LAI, FW, and DW. Among the five single machine learning methods, RF and RR performed better than the other three. Both stacking and BMA model improved the estimation accuracy compared to each machine learning method. After all data of the two sensors were fused, for the LAI, FW, and DW, the of the ensemble learning model increased by 1.088%-5.448%, 1.37%-11.854%, and 1.914%-12.698%, respectively, compared with those of the basic models. The data fusion of UAV digital and multispectral sensors improved the estimation accuracy, while the ensemble learning model further improved the estimation accuracy of phenotypic traits. In this study, multisource data fusion and ensemble learning model were combined to realize high-accuracy estimation of LAI, FW, and DW of breeding maize, which could provide support for high-throughput extraction of phenotypic traits in crop breeding.
The data used in this study are freely available. Anyone who wants to use the data can contact the corresponding author Yuntao Ma. The author is with the College of Land Science and Technology, China Agricultural University, Beijing, 100193, China (e-mail: email@example.com).
Conflicts of Interest
The authors declare no conflicts of interest.
All authors have made significant contributions to this research. Meiyan Shu and Yuntao Ma conceived and designed the experiments. Meiyan Shu, Shuaipeng Fei, and Bingyu Zhang performed the data acquisition and processed and analyzed the data. Yuntao Ma acquired the funding. Xiaohong Yang, Yan Guo, Baoguo Li, and Yuntao Ma performed the supervision; Meiyan Shu and Yuntao Ma wrote and edited the paper.
This work was jointly supported by grants from the Inner Mongolia Science and Technology Project (2019ZD024, 2019CG093, and 2020GG0038).
The optimal uncertainty estimates of three traits using GPR were shown in Supplement table 1-table 3. (Supplementary Materials)
- J. Chen and T. Black, “Defining leaf area index for non-flat leaves,” Plant, Cell & Environment, vol. 15, no. 4, pp. 421–429, 1992.
- M. Shu, M. Shen, Q. Dong, X. Yang, B. Li, and Y. Ma, “Estimating the maize above-ground biomass by constructing the tridimensional concept model based on UAV-based digital and multi-spectral images,” Field Crops Research, vol. 282, article 108491, 2022.
- S. Singh, J. Houx, M. Maw, and F. Fritschi, “Assessment of growth, leaf N concentration and chlorophyll content of sweet sorghum using canopy reflectance,” Field Crops Research, vol. 209, pp. 47–57, 2017.
- J. Bendig, K. Yu, H. Aasen et al., “Combining UAV-based plant height from crop surface models, visible, and near infrared vegetation indices for biomass monitoring in barley,” International Journal of Applied Earth Observation and Geoinformation, vol. 39, pp. 79–87, 2015.
- X. Jin, S. Madec, D. Dutartre, B. Solan, A. Comar, and F. Baret, “High-throughput measurements of stem characteristics to estimate ear density and above-ground biomass,” Plant Phenomics, vol. 2019, article 4820305, 10 pages, 2019.
- Y. Fang, Y. Du, J. Wang et al., “Moderate drought stress affected root growth and grain yield in old, modern and newly released cultivars of winter wheat,” Frontiers in Plant Science, vol. 8, p. 672, 2017.
- G. Yan, L. Li, A. Coy et al., “Improving the estimation of fractional vegetation cover from UAV RGB imagery by colour unmixing,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 158, pp. 23–34, 2019.
- G. Yan, R. Hu, J. Luo et al., “Review of indirect optical measurements of leaf area index: recent advances, challenges, and perspectives,” Agricultural and Forest Meteorology, vol. 265, pp. 390–411, 2019.
- T. Duan, S. Chapman, Y. Guo, and B. Zheng, “Dynamic monitoring of NDVI in wheat agronomy and breeding trials using an unmanned aerial vehicle,” Field Crops Research, vol. 210, pp. 71–80, 2017.
- S. Fei, M. Hassan, Z. He et al., “Assessment of ensemble learning to predict wheat grain yield based on UAV-multispectral reflectance,” Remote Sensing, vol. 13, no. 12, p. 2338, 2021.
- X. Jin, S. Liu, F. Baret, M. Hemerle, and A. Comar, “Estimates of plant density of wheat crops at emergence from very low altitude UAV imagery,” Remote Sensing of Environment, vol. 198, pp. 105–114, 2017.
- F. Liu, P. Hu, B. Zheng, T. Duan, B. Zhu, and Y. Guo, “A field-based high-throughput method for acquiring canopy architecture using unmanned aerial vehicle images,” Agricultural and Forest Meteorology, vol. 296, article 108231, 2021.
- S. Liu, X. Jin, C. Nie et al., “Estimating leaf area index using unmanned aerial vehicle data: shallow vs. deep machine learning algorithms,” Plant Physiology, vol. 187, no. 3, pp. 1551–1576, 2021.
- P. Hu, S. Chapman, X. Wang et al., “Estimation of plant height using a high throughput phenotyping platform based on unmanned aerial vehicle and self-calibration: example for sorghum breeding,” European Journal of Agronomy, vol. 95, pp. 24–32, 2018.
- D. Ogawa, T. Sakamoto, H. Tsunematsu, N. Kanno, Y. Nonoue, and J. I. Yonemaru, “Haplotype analysis from unmanned aerial vehicle imagery of rice MAGIC population for the trait dissection of biomass and plant architecture,” Journal of Experimental Botany, vol. 72, no. 7, pp. 2371–2382, 2021.
- W. Su, M. Zhang, D. Bian et al., “Phenotyping of corn plants using unmanned aerial vehicle (UAV) images,” Remote Sensing, vol. 11, no. 17, p. 2021, 2019.
- P. Chen and F. Liang, “Cotton nitrogen nutrition diagnosis based on spectrum and texture feature of image from low altitude unmanned aerial vehicle,” Scientia Agricultura Sinica, vol. 52, pp. 2220–2229, 2019.
- J. Yue, G. Yang, Q. Tian, H. Feng, K. Xu, and C. Zhou, “Estimate of winter-wheat above-ground biomass based on UAV ultrahigh-ground- resolution image textures and vegetation indices,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 150, pp. 226–244, 2019.
- M. Maimaitijiang, A. Ghulam, P. Sidike et al., “Unmanned aerial system (UAS)-based phenotyping of soybean using multi-sensor data fusion and extreme learning machine,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 134, pp. 43–58, 2017.
- M. Maimaitijiang, V. Sagana, P. Sidike, S. Hartling, F. Esposito, and F. Fritschi, “Soybean yield prediction from UAV using multimodal data fusion and deep learning,” Remote Sensing of Environment, vol. 237, article 111599, 2020.
- M. Maimaitijiang, V. Sagan, P. Sidike et al., “Vegetation index weighted canopy volume model (CVMVI) for soybean biomass estimation from unmanned aerial system-based RGB imagery,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 151, pp. 27–41, 2019.
- B. Li, X. Xu, L. Zhang et al., “Above-ground biomass estimation and yield prediction in potato by using UAV- based RGB and hyperspectral imaging,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 162, pp. 161–172, 2020.
- Y. Zhang, C. Xia, X. Zhang et al., “Estimating the maize biomass by crop height and narrowband vegetation indices derived from UAV-based hyperspectral images,” Ecological Indicators, vol. 129, article 107985, 2021.
- H. Zheng, T. Cheng, M. Zhou et al., “Improved estimation of rice aboveground biomass combining textural and spectral analysis of UAV imagery,” Precision Agriculture, vol. 20, no. 3, pp. 611–629, 2019.
- H. Yuan, G. Yang, C. Li et al., “Retrieving soybean leaf area index from unmanned aerial vehicle hyperspectral remote sensing: analysis of RF, ANN, and SVM regression models,” Remote Sensing, vol. 9, no. 4, p. 309, 2017.
- J. Yue, H. Feng, X. Jin et al., “A comparison of crop parameters estimation using images from UAV-mounted snapshot hyperspectral sensor and high-definition digital camera,” Remote Sensing, vol. 10, no. 7, p. 1138, 2018.
- J. Yue, H. Feng, G. Yang, and Z. Li, “A comparison of regression techniques for estimation of above-ground winter wheat biomass using near-surface spectroscopy,” Remote Sensing, vol. 10, no. 2, p. 66, 2018.
- J. Behmann, A. Mahlein, T. Rumpf, C. Romer, and L. Plumer, “A review of advanced machine learning methods for the detection of biotic stress in precision crop protection,” Precision Agriculture, vol. 16, no. 3, pp. 239–260, 2015.
- M. Shu, M. Shen, J. Zuo et al., “The application of UAV-based hyperspectral imaging to estimate crop traits in maize inbred lines,” Plant Phenomics, vol. 2021, article 9890745, 14 pages, 2021.
- Z. Zhang, E. Pasolli, M. M. Crawford, and J. C. Tilton, “An active learning framework for hyperspectral image classification using hierarchical segmentation,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 9, no. 2, pp. 640–654, 2015.
- Z. Zhang, E. Pasolli, and M. M. Crawford, “An adaptive multiview active learning approach for spectral-spatial classification of hyperspectral images,” IEEE Transactions on Geoscience and Remote Sensing, vol. 58, no. 4, pp. 2557–2570, 2019.
- L. Feng, Y. Li, Y. Wang, and Q. Du, “Estimating hourly and continuous ground-level PM2.5 concentrations using an ensemble learning algorithm: the ST-stacking model,” Atmospheric Environment, vol. 223, article 117242, 2020.
- L. Feng, Z. Zhang, Y. Ma et al., “Alfalfa yield prediction using UAV-based hyperspectral imagery and ensemble learning,” Remote Sensing, vol. 12, no. 12, p. 2028, 2020.
- H. Aghighi, M. Azadbakht, D. Ashourloo, H. Shahrabi, and S. Radiom, “Machine learning regression techniques for the silage maize yield prediction using time-series images of Landsat 8 OLI,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 11, no. 12, pp. 4563–4577, 2018.
- D. H. Wolpert, “Stacked generalization,” Neural Networks, vol. 5, no. 2, pp. 241–259, 1992.
- L. Breiman, “Stacked regressions,” Machine Learning, vol. 24, no. 1, pp. 49–64, 1996.
- S. Healey, W. Cohen, Z. Yang et al., “Mapping forest change using stacked generalization: an ensemble approach,” Remote Sensing of Environment, vol. 204, pp. 717–728, 2018.
- C. Ju, A. Bibaut, and M. van der Laan, “The relative performance of ensemble methods with deep convolutional neural networks for image classification,” Journal of Applied Statistics, vol. 45, no. 15, pp. 2800–2818, 2018.
- S. Jiang, L. Ren, H. Yang et al., “Comprehensive evaluation of multi-satellite precipitation products with a dense rain gauge network and optimally merging their simulated hydrological flows using the Bayesian model averaging method,” Journal of Hydrology, vol. 452-453, pp. 213–225, 2012.
- A. Raftery, T. Gneiting, F. Balabdaoui, and M. Polakowski, “Using Bayesian model averaging to calibrate forecast ensembles,” Monthly Weather Review, vol. 133, no. 5, pp. 1155–1174, 2005.
- D. W. Bloodgood, J. A. Sugam, A. Holmes, and T. L. Kash, “Fear extinction requires infralimbic cortex projections to the basolateral amygdala,” Translational Psychiatry, vol. 8, no. 1, p. 60, 2018.
- D. Long, Y. Pan, J. Zhou et al., “Global analysis of spatiotemporal variability in merged total water storage changes using multiple GRACE products and global hydrological models,” Remote Sensing of Environment, vol. 192, pp. 198–216, 2017.
- V. Zuber, D. Gill, M. Ala-Korpela et al., “High-throughput multivariable Mendelian randomization analysis prioritizes apolipoprotein B as key lipid risk factor for coronary artery disease,” International Journal of Epidemiology, vol. 50, no. 3, pp. 893–901, 2021.
- E. Montgomery, “Correlation studies in corn. 24th annual report,” Agric. Exp. Sta. Neb., vol. 24, pp. 108–159, 1991.
- L. Han, G. Yang, H. Dai et al., “Modeling maize above-ground biomass based on machine learning approaches using UAV remote-sensing data,” Plant Methods, vol. 15, no. 1, p. 10, 2019.
- M. Schirrmann, A. Giebel, F. Gleiniger, M. Pflanz, J. Lentschke, and K. Dammer, “Monitoring agronomic parameters of winter wheat crops with low-cost UAV imagery,” Remote Sensing, vol. 8, no. 9, p. 706, 2016.
- C. Cortes and V. Vapnik, “Support-vector networks,” Machine Learning, vol. 20, no. 3, pp. 273–297, 1995.
- J. Bendig, A. Bolten, S. Bennertz, J. Broscheit, S. Eichfuss, and G. Bareth, “Estimating biomass of barley using crop surface models (CSMs) derived from UAV-based RGB imaging,” Remote Sensing, vol. 6, no. 11, pp. 10395–10412, 2014.
- P. Thenkabail, R. B. Smith, and E. de Pauw, “Hyperspectral vegetation indices and their relationships with agricultural crop characteristics,” Remote Sensing of Environment, vol. 71, no. 2, pp. 158–182, 2000.
- J. Bendig, A. Bolten, and G. Bareth, “UAV based imaging for multi-temporal, very high resolution crop surface models to monitor crop growth variability,” Photogrammetrie - Fernerkundung - Geoinformation, vol. 2013, no. 6, pp. 551–562, 2013.
- L. Galvao, F. Breunig, J. dos Santos, and Y. de Moura, “View-illumination effects on hyperspectral vegetation indices in the Amazonian tropical forest,” International Journal of Applied Earth Observation and Geoinformation, vol. 21, pp. 291–300, 2013.
- G. Meyer and J. Neto, “Verification of color vegetation indices for automated crop imaging applications,” Computers and Electronics in Agriculture, vol. 63, no. 2, pp. 282–293, 2008.
- D. M. Woebbecke, G. E. Meyer, K. Von Bargen, and D. A. Mortensen, “Color indices for weed identification under various soil, residue, and lighting conditions,” Transactions of the ASAE, vol. 38, no. 1, pp. 259–269, 1995.
- W. Mao, Y. Wang, and Y. Wang, “Real-time detection of between-row weeds using machine vision,” in 2003 ASAE Annual Meeting. American Society of Agricultural and Biological Engineers 1, Las Vegas, 2003.
- J. Rasmussen, G. Ntakos, J. Nielsen, J. Svensgaard, R. Poulsen, and S. Christensen, “Are vegetation indices derived from consumer-grade cameras mounted on UAVs sufficiently reliable for assessing experimental plots?” European Journal of Agronomy, vol. 74, pp. 75–92, 2016.
- J. Verrelst, M. E. Schaepman, B. Koetz, and M. Kneubühler, “Angular sensitivity analysis of vegetation indices derived from CHRIS/PROBA data,” Remote Sensing of Environment, vol. 112, no. 5, pp. 2341–2353, 2008.
- T. Kataoka, T. Kaneko, H. Okamoto, and S. Hata, “Crop growth estimation system using machine vision,” in IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM 2003), vol. 2, pp. 1079–1083, Kobe, Japan, 2003.
- A. Gitelson, Y. Kaufman, R. Stark, and D. Rundquist, “Novel algorithms for remote estimation of vegetation fraction,” Remote Sensing of Environment, vol. 80, no. 1, pp. 76–87, 2002.
- M. Guijarro, G. Pajares, I. Riomoros, P. Herrera, P. Burgos-Artizzue, and A. Ribeiroe, “Automatic segmentation of relevant textures in agricultural images,” Computers and Electronics in Agriculture, vol. 75, no. 1, pp. 75–83, 2011.
- J. Gamon and J. Surfus, “Assessing leaf pigment content and activity with a reflectometer,” The New Phytologist, vol. 143, no. 1, pp. 105–117, 1999.
- T. Hague, N. Tillett, and H. Wheeler, “Automated crop and weed monitoring in widely spaced cereals,” Precision Agriculture, vol. 7, no. 1, pp. 21–32, 2006.
- A. Gitelson, Y. Gritz, and M. Merzlyak, “Relationships between leaf chlorophyll content and spectral reflectance and algorithms for non-destructive chlorophyll assessment in higher plant leaves,” Journal of Plant Physiology, vol. 160, no. 3, pp. 271–282, 2003.
- C. J. Tucker, “Red and photographic infrared linear combinations for monitoring vegetation,” Remote Sensing of Environment, vol. 8, no. 2, pp. 127–150, 1979.
- A. Gitelson, Y. Kaufman, and M. Merzlyak, “Use of a green channel in remote sensing of global vegetation from EOS-MODIS,” Remote Sensing of Environment, vol. 58, no. 3, pp. 289–298, 1996.
- C. Daughtry, C. Walthall, M. Kim, E. de Colstoun, and J. McMurtrey, “Estimating corn leaf chlorophyll concentration from leaf and canopy reflectance,” Remote Sensing of Environment, vol. 74, no. 2, pp. 229–239, 2000.
- P. Gong, R. Pu, G. Biging, and M. Larrieu, “Estimation of forest leaf area index using vegetation indices derived from hyperion hyperspectral data,” IEEE Transactions on Geoscience and Remote Sensing, vol. 41, no. 6, pp. 1355–1362, 2003.
- J. Chen, “Evaluation of vegetation indices and a modified simple ratio for boreal applications,” Canadian Journal of Remote Sensing, vol. 22, no. 3, pp. 229–242, 1996.
- A. Gitelson, A. Viña, S. Verma et al., “Relationship between gross primary production and chlorophyll content in crops: implications for the synoptic monitoring of vegetation productivity,” Journal of Geophysical Research – Atmospheres, vol. 111, no. D8, p. D08S11, 2006.
- A. Gitelson and M. Merzlyak, “Remote estimation of chlorophyll content in higher plant leaves,” International Journal of Remote Sensing, vol. 18, no. 12, pp. 2691–2697, 1997.
- J. Rouse, R. Haas, and D. Deering, Monitoring the vernal advancement and retrogradation (green wave effect) of natural vegetation, 1973.
- N. Goel and W. Qin, “Influences of canopy architecture on relationships between various vegetation indices and LAI and FPAR: a computer simulation,” Remote Sensing Reviews, vol. 10, no. 4, pp. 309–347, 1994.
- G. Rondeaux, M. Steven, and F. Baret, “Optimization of soil-adjusted vegetation indices,” Remote Sensing of Environment, vol. 55, no. 2, pp. 95–107, 1996.
- J. Roujean and F. Breon, “Estimating PAR absorbed by vegetation from bidirectional reflectance measurements,” Remote Sensing of Environment, vol. 51, no. 3, pp. 375–384, 1995.
- R. L. Pearson and L. D. Miller, “Remote Mapping of Standing Crop Biomass for Estimation of the Productivity of the Shortgrass Prairie,” Remote sensing of environment, vol. 1355, 1972.
- L. Xue, W. Cao, W. Luo, T. Dai, and Y. Zhu, “Monitoring leaf nitrogen status in rice with canopy spectral reflectance,” Agronomy Journal, vol. 96, no. 1, pp. 135–142, 2004.
- A. Huete, “Soil influences in remotely sensed vegetation-canopy spectra,” Theory and Applications of Optical Remote Sensing, pp. 107–141, 1989.
- D. Haboudane, J. Miller, N. Tremblay, P. Zarco-Tejada, and L. Dextraze, “Integrated narrow-band vegetation indices for prediction of crop chlorophyll content for application to precision agriculture,” Remote Sensing of Environment, vol. 81, no. 2-3, pp. 416–426, 2002.
- N. Broge and E. Leblanc, “Comparing prediction power and stability of broadband and hyperspectral vegetation indices for estimation of green leaf area index and canopy chlorophyll density,” Remote Sensing of Environment, vol. 76, no. 2, pp. 156–172, 2001.
- J. Yin, J. Medellín-Azuara, A. Escriva-Bou, and Z. Liu, “Bayesian machine learning ensemble approach to quantify model uncertainty in predicting groundwater storage change,” Science of The Total Environment, vol. 769, article 144715, 2021.
- L. Xing, M. L. Lesperance, and X. Zhang, “Simultaneous prediction of multiple outcomes using revised stacking algorithms,” Bioinformatics, vol. 36, no. 1, pp. 65–72, 2020.
- Y. Chen, W. Yuan, J. Xia et al., “Using Bayesian model averaging to estimate terrestrial evapotranspiration in China,” Journal of Hydrology, vol. 528, pp. 537–549, 2015.
- M. Najafi, H. Moradkhani, and I. Jung, “Assessing the uncertainties of hydrologic model selection in climate change impact studies,” Hydrological Processes, vol. 25, no. 18, pp. 2814–2826, 2011.
- Q. Duan and T. Phillips, “Bayesian estimation of local signal and noise in multimodel simulations of climate change,” Journal of Geophysical Research, vol. 115, no. D18, p. D18123, 2010.
- C. Stanton, M. Starek, N. Elliott, M. Brewer, M. Maeda, and T. Chu, “Unmanned aircraft system-derived crop height and normalized difference vegetation index metrics for sorghum yield and aphid stress assessment,” Journal of Applied Remote Sensing, vol. 11, no. 2, article 026035, 2017.
- N. Tilly, H. Aasen, and G. Bareth, “Correction: Tilly, N. et al. Fusion of plant height and vegetation indices for the estimation of barley biomass. Remote Sens. 2015, 7, 11449–11480,” Remote Sensing, vol. 7, no. 12, pp. 17291–17296, 2015.
- M. Weiss, F. Jacob, and G. Duveiller, “Remote sensing for agricultural applications: a meta-review,” Remote Sensing of Environment, vol. 236, article 111402, 2019.
- J. Huang, H. Ma, W. Su et al., “Jointly assimilating MODIS LAI and ET products into the SWAP model for winter wheat yield estimation,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 8, no. 8, pp. 4060–4071, 2015.
- O. Mutanga and A. Skidmore, “Narrow band vegetation indices overcome the saturation problem in biomass estimation,” International Journal of Remote Sensing, vol. 25, no. 19, pp. 3999–4014, 2004.
- W. Li, Z. Niu, H. Chen, D. Li, M. Wu, and W. Zhao, “Remote estimation of canopy height and aboveground biomass of maize using high-resolution stereo images from a low-cost unmanned aerial vehicle system,” Ecological Indicators, vol. 67, pp. 637–648, 2016.
- L. Wallace, “Assessing the stability of canopy maps produced from UAV-LiDAR data,” in 2013 IEEE International Geoscience and Remote Sensing Symposium - IGARSS, pp. 3879–3882, Melbourne, VIC, Australia, July 2013.
- Y. Fu, G. Yang, R. Pu et al., “An overview of crop nitrogen status assessment using hyperspectral remote sensing: current status and perspectives,” European Journal of Agronomy, vol. 124, article 126241, 2021.
- S. Li, F. Yuan, S. Ata-UI-Karim et al., “Combining color indices and textures of UAV-based digital imagery for Rice LAI estimation,” Remote Sensing, vol. 11, no. 15, p. 1763, 2019.
- R. Raj, J. P. Walker, R. Pingale, R. Nandan, B. Naik, and A. Jagarlapudi, “Leaf area index estimation using top-of-canopy airborne RGB images,” International Journal of Applied Earth Observation and Geoinformation, vol. 96, article 102282, 2020.
- P. Rischbeck, S. Elsayed, B. Mistele, G. Barmeier, K. Heil, and U. Schmidhalter, “Data fusion of spectral, thermal and canopy height parameters for improved yield prediction of drought stressed spring barley,” European Journal of Agronomy, vol. 78, pp. 44–59, 2016.
- X. Xu, L. Fan, Z. Li et al., “Estimating leaf nitrogen content in corn based on information fusion of multiple-sensor imagery from UAV,” Remote Sensing, vol. 13, no. 3, p. 340, 2021.
- J. Yue, G. Yang, C. Li et al., “Estimation of winter wheat aboveground biomass using unmanned aerial vehicle-based snapshot hyperspectral sensor and crop height improved models,” Remote Sensing, vol. 9, no. 7, p. 708, 2017.
- Q. Jiang, S. Fang, Y. Peng et al., “UAV-based biomass estimation for rice-combining spectral, TIN-based structural and meteorological features,” Remote Sensing, vol. 11, no. 7, p. 890, 2019.
- Y. Liu, S. Liu, J. Li, X. Guo, S. Wang, and J. Lu, “Estimating biomass of winter oilseed rape using vegetation indices and texture metrics derived from UAV multispectral images,” Computers and Electronics in Agriculture, vol. 166, article 105026, 2019.
- W. Zhu, Z. Sun, Y. Huang et al., “Optimization of multi-source UAV RS agro-monitoring schemes designed for field-scale crop phenotyping,” Precision Agriculture, vol. 22, no. 6, pp. 1768–1802, 2021.
- C. Espinoza, L. Khot, S. Sankaran, and P. Jacoby, “High resolution multispectral and thermal remote sensing-based water stress assessment in subsurface irrigated grapevines,” Remote Sensing, vol. 9, no. 9, p. 961, 2017.
- Y. Shi, J. Thomasson, S. Murray et al., “Unmanned aerial vehicles for high-throughput phenotyping and agronomic research,” PLoS One, vol. 11, no. 7, article e0159781, 2016.
- K. Liakos, P. Busato, D. Moshou, S. Pearson, and D. Bochtis, “Machine learning in agriculture: a review,” Sensors, vol. 18, no. 8, p. 2674, 2018.
- T. Rehman, M. Mahmud, Y. Chang, J. Jin, and J. Shin, “Current and future applications of statistical machine learning algorithms for agricultural machine vision systems,” Computers and Electronics in Agriculture, vol. 156, pp. 585–605, 2019.
- A. Chlingaryan, S. Sukkarieh, and B. Whelan, “Machine learning approaches for crop yield prediction and nitrogen status estimation in precision agriculture: a review,” Computers and Electronics in Agriculture, vol. 151, pp. 61–69, 2018.
- H. Tong and Z. Nikoloski, “Machine learning approaches for crop improvement: leveraging phenotypic and genotypic big data,” Journal of Plant Physiology, vol. 257, article 153354, 2021.
- W. Zhu, Sun, Peng et al., “Estimating maize above-ground biomass using 3D point clouds of multi-source unmanned aerial vehicle data at multi-spatial scales,” Remote Sensing, vol. 11, no. 22, p. 2678, 2019.
- L. Wang, X. Zhou, X. Zhu, Z. Dong, and W. Guo, “Estimation of biomass in wheat using random forest regression algorithm and remote sensing data,” The Crop Journal, vol. 4, no. 3, pp. 212–219, 2016.
- P. Du, J. Xia, J. Chanussot, and X. He, “Hyperspectral remote sensing image classification based on the integration of support vector machine and random forest,” in 2012 IEEE International Geoscience and Remote Sensing Symposium, pp. 174–177, Munich, Germany, July 2012.
- H. Feilhauer, G. Asner, and R. Martin, “Multi-method ensemble selection of spectral bands related to leaf biochemistry,” Remote Sensing of Environment, vol. 164, pp. 57–65, 2015.
- R. Hagedorn, F. Doblas-Reyes, and T. Palmer, “The rationale behind the success of multi-model ensembles in seasonal forecasting - I. Basic concept,” ellus A., vol. 57, no. 3, pp. 219–233, 2005.
- K. Peterson, V. Sagan, P. Sidike, E. A. Hasenmueller, J. J. Sloan, and J. H. Knouft, “Machine learning-based ensemble prediction of water-quality variables using feature-level and decision-level fusion with proximal remote sensing,” Photogrammetric Engineering & Remote Sensing, vol. 85, no. 4, pp. 269–280, 2019.
- J. Baluja, M. Diago, P. Balda et al., “Assessment of vineyard water status variability by thermal and multispectral imagery using an unmanned aerial vehicle (UAV),” Irrigation Science, vol. 30, no. 6, pp. 511–522, 2012.
- W. Du, L. Zhang, Z. Hu et al., “Utilization of thermal infrared image for inversion of winter wheat yield and biomass,” Spectroscopy and Spectral Analysis, vol. 31, no. 6, pp. 1476–1480, 2011.
- C. Niu, K. Tan, X. Jia, and X. Wang, “Deep learning based regression for optically inactive inland water quality parameter estimation using airborne hyperspectral imagery,” Environmental Pollution, vol. 286, article 117534, 2021.
- X. Wang, K. Tan, Q. Du, Y. Chen, and P. Du, “Caps-TripleGAN: GAN-assisted CapsNet for hyperspectral image classification,” IEEE Transactions on Geoscience and Remote Sensing, vol. 57, no. 9, pp. 7232–7245, 2019.
Copyright © 2022 Meiyan Shu et al. Exclusive Licensee Nanjing Agricultural University. Distributed under a Creative Commons Attribution License (CC BY 4.0).