Research Article | Open Access
Qian Sun, Lin Sun, Meiyan Shu, Xiaohe Gu, Guijun Yang, Longfei Zhou, "Monitoring Maize Lodging Grades via Unmanned Aerial Vehicle Multispectral Image", Plant Phenomics, vol. 2019, Article ID 5704154, 16 pages, 2019. https://doi.org/10.34133/2019/5704154
Monitoring Maize Lodging Grades via Unmanned Aerial Vehicle Multispectral Image
Lodging is one of the main factors affecting the quality and yield of crops. Timely and accurate determination of crop lodging grade is of great significance for the quantitative and objective evaluation of yield losses. The purpose of this study was to analyze the monitoring ability of a multispectral image obtained by an unmanned aerial vehicle (UAV) for determination of the maize lodging grade. A multispectral Parrot Sequoia camera is specially designed for agricultural applications and provides new information that is useful in agricultural decision-making. Indeed, a near-infrared image which cannot be seen with the naked eye can be used to make a highly precise diagnosis of the vegetation condition. The images obtained constitute a highly effective tool for analyzing plant health. Maize samples with different lodging grades were obtained by visual interpretation, and the spectral reflectance, texture feature parameters, and vegetation indices of the training samples were extracted. Different feature transformations were performed, texture features and vegetation indices were combined, and various feature images were classified by maximum likelihood classification (MLC) to extract four lodging grades. Classification accuracy was evaluated using a confusion matrix based on the verification samples, and the features suitable for monitoring the maize lodging grade were screened. The results showed that compared with a multispectral image, the principal components, texture features, and combination of texture features and vegetation indices were improved by varying degrees. The overall accuracy of the combination of texture features and vegetation indices is 86.61%, and the Kappa coefficient is 0.8327, which is higher than that of other features. Therefore, the classification result based on the feature combinations of the UAV multispectral image is useful for monitoring of maize lodging grades.
Maize (Zea mays L.) is an important food and feed crop, which is mainly distributed at latitudes 30°-50°, and is also the highest yielding crop in the world. The north, northeast, and southwest mountain areas of China are the main maize-producing regions. Maize is a thermophilic crop, which requires high temperature during the whole growth period. During the late growth stage of maize, strong winds and heavy rainfall, as well as the structural characteristics of maize plants such as tall and weaker stems, increase the likelihood of large-scale lodging [1–4]. Lodging hinders maize growth, leading to a decrease in yield and a reduction in grain quality [4, 5]. Timely and accurate acquisition of information with different lodging grades of maize will help agricultural management departments and insurance companies to calculate area and yield losses, to perform postdisaster production management and relief work.
Accurate acquisition of information on maize lodging relies on conventional means, such as artificial field investigations and sample measurements, which are time-consuming, labor-intensive, and inefficient. The rapid development of remote sensing technology provides new methods for obtaining information on crop lodging. A method based on remote sensing has advantages of low cost and high convenience and is widely used to extract phenotypic information about crops [6, 7]. A maize lodging model based on the difference of the ratio vegetation index (RVI) before and after lodging can be constructed using HJ-1B CCD multispectral images . Hyperspectral remote sensing with principal component analysis (PCA) and artificial neural networks may be applied to discriminate lodged from normal crops on regional and large scales . With improved remote sensing monitoring capability, the ultralow altitude UAV system has become a focus for crop lodging investigation because of advantages such as its low cost, high resolution, and ability to acquire images under clouds. Red-green-blue (RGB) images were acquired by a small UAV equipped with a digital camera to analyze the image features of nonlodging and lodging maize, and a method for extracting the maize lodging area based on color and texture features was established . Liu et al.  analyzed the spectral characteristics and texture features of wheat lodging based on UAV data and adopted an object-oriented method to extract the lodging area of wheat. Based on the digital surface model (DSM) and texture information obtained from the UAV image, Yang et al.  reported that the optimal model was a decision tree classification combined with the single feature probability (SFP) value. A method was proposed by Chu et al.  to evaluate the lodging severity of maize fields using UAV digital cameras and information on plant height. The genetic factors affecting maize lodging and predicting the lodging rate were quantitatively identified based on UAV digital and multispectral images by analyzing the nomograms . Wilke et al.  quantified the lodging rate and severity based on the UAV canopy height model combined with the target threshold method and evaluated the potential application of UAV images in quantitative research on the lodging rate and severity using structure from motion (SfM). The differential digital elevation model of unmanned aerial systems (UAS) was used for the quantitative evaluation and verification of wheat lodging. Alternative visual evaluation of UAS-based crop high-throughput phenotypes was found to be important role for complex lodging phenological characteristics .
To date, many studies have focused on extracting lodging information and area by using RGB image, but relatively few studies have further subdivided lodging grades. RGB image contains only three bands of data representing the intensities of red, green, and blue wavelengths of each pixel [17, 18]. It covers less crop information and can only obtain the image information of ground objects. A multispectral imager with a near-infrared band is an important sensor widely used in agricultural remote sensing from a satellite platform to a near ground platform, which can obtain both image information and spectral information of ground objects at the same time. There are few studies on the spectral characteristics of crops in the existing research on crop lodging monitoring based on UAV. The spectral characteristics, especially the red edge and infrared band, can reflect the growth status of crops from the essential aspects such as physical and chemical properties and canopy structure [19, 20]. There is a clear physical significance to monitor crop lodging on the basis of spectral characteristics. Numerous studies [21–23] have shown that the lodging crop has stronger reflectance from leaves and stalks in the NIR band which results in the large contrast between the lodging and nonlodging areas. Parrot Sequoia is tailor-made for agriculture and can be used in a variety of agricultural applications with application width and depth. UAV with a Sequoia multispectral camera is used to obtain farmland images and capture information from visible and invisible light in order to measure the health and vitality of crops. Based on a multispectral image with a spatial resolution of 0.05 m obtained by UAV on September 10, 2018, the spectral characteristics of the canopy of different lodging grades were analyzed at the maize filling stage. Principal component transformation was performed, the texture features were extracted, the vegetation indices were constructed, and the maximum likelihood classification (MLC) was used to classify the lodging grade of maize. The results provide a basis for the investigation of the crop lodging grade by UAV high-resolution images.
2. Materials and Methods
2.1. Overview of the Research Area
The research area is located in Gaocheng, Shijiazhuang City, Hebei Province, China, with the geographical coordinates of 37°51N–38°18N, 114°39E-114°59E (Figure 1). Gaocheng is located in the North China Plain and has a warm temperate semihumid continental monsoon climate, characterized by cold winters and hot summers. The territory has four distinct seasons, with an average annual temperature of 12.5°C, an average annual rainfall of 494 mm, and an annual sunshine duration of 2711.4 hours. The cultivated land area of Gaocheng is about 549.02 km2. The crop planting is an annual double-cropping system. It is a wheat-maize rotation area. The maize variety in the research area is Zhengdan 958 which is widely planted in the Huang-Huai-Hai area. The growth period of maize is about 96 days, the plant type is compact, the plant height is about 246 cm, the ear position is about 110 cm, and it is resistant to disease, lodging, and drought. Summer maize planting is generally completed around June 20th and harvested in October of the same year.
2.2. Data Acquisition
On September 5, 2018, there were severe winds in Gaocheng, and local wind speeds reached grade 6, which led to a large area of maize lodging during the maize filling period. The data in this study were derived from maize plots with different lodging grades acquired by the UAV platform at 2:00 pm on September 10, 2018.
A Parrot Sequoia camera served as a multispectral sensor for acquiring images mounted on a DJI Spreading Wings S1000. The single arm length of the UAV is 386 mm, the net weight of the UAV is about 4 kg, the weight of the carrier is 6 kg, and the duration of imaging is 15-20 min. The Parrot Sequoia camera consists of four spectral channels of green, red, red edge, and near-infrared (Table 1) with a global positioning system (GPS) and irradiance sensors. On the day of data acquisition, the weather was clear and calm. Radiometric calibration images obtained with the Parrot Sequoia camera were captured using a calibrated reflectance panel on the ground before and after each flight. The image resolution was pixels. The flight altitude was set at 60 m above the ground. The forward and lateral overlap was 80%. Flight speed was set to 6 m per second. There were eight routes, and a total of 271 multispectral images were collected per band.
2.3. Image Preprocessing
UAV multispectral images are preprocessed as follows: (1) Image screening: poor quality images during the UAV take-off and landing are deleted to decrease the number of images and ensure image quality. (2) Image stitching: 240 groups of screened images were stitched using the agricultural multispectral template in the Pix4D mapper software (version 4.0, Lausanne, Switzerland) [24, 25]. (3) Image clipping: due to the large flying area of the UAV, the size of the region of interest (ROI) was approximately (Figure 1) and contained different lodging types.
The Sequoia camera combined with Pix4D software allows for better evaluation of collected data. The specific steps of mosaicking multispectral images using Pix4D software  are as follows: (1) Creating a new project. (2) Importing all discrete band imagery (green, red, red edge, and near-infrared imagery) from the flight. This includes the images of the calibration target. (3) Choosing the agricultural multispectral processing template. (4) Starting processing, including initial processing, point cloud and mesh, DSM (digital surface model), orthomosaic, and index. (5) Generating the orthomosaic imagery. Pix4D agricultural multispectral processing template automatically performs radiometric calibration [27, 28], which is to convert the digital number (DN) of ground object into absolute reflectance data.
The multispectral image geographic coordinate system was GCS_WGS_1984 and the projected coordinate system was UTM_Zone_50N and consisted of green, red, red edge, and near-infrared with a spatial resolution of 0.05 m.
2.4. Analysis Method
The spectral reflectance of maize with different lodging grades is various in four bands. We analyzed the spectral characteristics of maize with different lodging grades and constructed vegetation indices. At the same time, we extracted principal components of the UAV multispectral image and analyzed texture features. Five features are extracted; they are spectral characteristics, principal component, texture features, vegetation indices, and the combination of vegetation indices and texture features. The MLC [29, 30] supervised classification method was used to classify lodging grades combined with training samples based on the above five features. The classification accuracy was evaluated using a confusion matrix with verification samples. A method for extracting information regarding maize with different lodging grades based on UAV multispectral images is preferred. The workflow of maize lodging grade classification is shown in Figure 2.
2.5. Evaluation of Accuracy
Accuracy evaluation is an important and essential step in the classification process , which is to quantitatively determine how effectively pixels were grouped into the correct feature classes in the area. In order to verify the effectiveness of the classification results of different features, we need to use the verification samples to evaluate the classification results after the implementation of the supervised classification. The most common method used to evaluate the classification accuracy of remote sensing images is to establish a confusion matrix  for statistical analyses, which provides the classification accuracy for the population and each category. Furthermore, the accuracy of the classification results is displayed in a confusion matrix, which is a basic, intuitive, and simple method for measuring a classification model. The classification results were evaluated using the confusion matrix combined with the maize verification samples. Six indicators (Table 2) were used to evaluate the classification accuracy: producer’s accuracy, user’s accuracy, commission error, omission error, overall accuracy, and Kappa coefficient.
3. Monitoring Maize Lodging Grade
3.1. Definition of Maize Lodging Grades
Because the spatial resolution of the UAV multispectral image reached centimeters in our study, it is possible to distinguish maize with different lodging grades visually. Based on previous knowledge and field observation, nonlodging and three types of lodging were observed in the research area; lodging could be divided into light, moderate, and severe grades (Figure 3). Nonlodging indicates that the maize plants maintain an upright growth state; that is, the inclination angle (between the maize plant and the vertical line) of maize is 0°-10°. This is due to the strong self-resilience of maize, and the maize with slight lodging can recover quickly in a short time. Light lodging indicates that the inclination angle is 10°-30°; the plant is bent and has some ability for self-recovery. Moderate lodging refers to the plant with an inclination angle of 30°-60° and partially exposed maize stem. Severe lodging indicates that the inclination angle is 60°-90°; the plant falls so close to the ground, the stem is completely exposed, some stems are broken, and some of the lower leaves have dried up.
3.2. Training and Verification Samples
The smallest unit of a remote sensing image is a pixel. Image classification is defined as the process of categorizing all pixels in an image or raw satellite data to obtain a given set of labels . Maximum likelihood supervised classification is a method in which the analyst defines representative small areas called training sites for each category on the image. The software then uses these training sites and applies them to the entire image. The delineation of training areas representative of a category is most effective when an image analyst has experience with the spectral properties of the category [35, 36].
The spatial resolution of the UAV multispectral image reaches a centimeter level which is 5 cm. Different lodging types can be identified from the image by visual interpretation. Visual interpretation refers to the process of extracting and analyzing the ground information contained in remote sensing images through human eye observation [37, 38]. Its advantage is that it can make full use of prior knowledge, and its interpretation accuracy is generally high. Visual interpretation was used to randomly select the maize sites with different lodging grades as the training and verification samples in the ROI based on prior knowledge, field investigation, and spectral reflectance. Because the samples are different in size and the basic classification unit is the pixel, we counted the pixel numbers of training and verification samples in ENVI 5.3 software (Table 3).
3.3. Spectral Reflectance Variation
The agricultural multispectral Parrot Sequoia camera has four spectral channels, including green, red, red edge, and near-infrared. The means and standard deviations of maize reflectance with different lodging grades of training samples were extracted and calculated (Figure 4). Because the multispectral images have been corrected by radiometric calibration in Pix4D software, the actual reflectance data of the surface object have been obtained. The four spectral reflectances are calculated by the average of all pixels of training samples with different lodging types; we extracted it directly from the statistical function of ENVI 5.3 software.
The spectral reflectance of the same lodging type is consistent with the vegetation spectral curve. The spectral reflectance with different lodging grades varied consistently in four bands, which were lower in red and higher in near-infrared. In different bands, the spectral reflectance of lodging was higher than that of nonlodging, and the more serious the lodging, the higher the spectral reflectance  (Figure 4). The main reason is that lodging changes the structure and shape of the crop population and causes the change of canopy spectral reflectance. The more serious the lodging, the more stem exposure, and the reflectance of the stem is higher than that of leaf . Severe lodging caused the maize stems to break and the lower leaves to dry; thus, the reflectance is slightly lower than moderate lodging in near-infrared. After lodging, the original canopy structure collapsed, the proportion of stems increased significantly, and the proportion of leaves decreased, which caused the reflectance of different lodging grades to increase [40, 41]. In four bands, spectral reflectance of lodging maize varies most in the near-infrared band compared to nonlodging maize  (Figure 4, Table 4).
Compared with nonlodging maize, the spectral reflectance of light lodging increased by 24.54–32.28%, that of moderate lodging increased by 47.84–66.03%, and that of severe lodging increased by 37.83–205.79%. This showed that the more serious the lodging, the higher the increase of spectral reflectance. Under the same lodging grade, the increase rate in the visible band was larger than that in the near-infrared band  (Figure 5).
3.4. Construction of Vegetation Indices
The vegetation index is a linear or nonlinear combination of two or more characteristic bands, which reflects the relative abundance and activity of green vegetation. The main purpose of establishing vegetation indices is to effectively synthesize relevant spectral signals, enhance vegetation information, and reduce non-vegetation-related information. The vegetation index mainly reflects the difference between the visible and near-infrared bands and the soil background. Each vegetation index can be used to quantitatively describe the growth status of vegetation under certain conditions.
The normalized differential vegetation index (NDVI)  is currently the most widely used index. Due to the easy saturation of the red band and neglect of the green band, Gitelson et al.  proposed the green normalized vegetation index (GNDVI). Studies have shown that the green band is closely related to vegetation parameters [45, 46]. The soil-adjusted vegetation index (SAVI) modified the sensitivity of NDVI to soil background and reduced its impact. The renormalized difference vegetation index (RDVI) provides the advantages of both NDVI and difference vegetation index (DVI), which can be used for vegetation with different coverage. The calculation formulas of the four vegetation indices are displayed in Table 5.
The variance of vegetation indices with different lodging grades is shown in Figure 6. The change trend of different vegetation indices is various under lodging stress. The more serious the lodging, the smaller the NDVI, which is consistent with the results of previous studies . GNDVI decreases with the increase of lodging grades, because the relative increase rate of spectral reflectance in the visible band was larger than that of the near-infrared band after lodging. Compared with nonlodging, the NDVI and GNDVI reductions of light lodging are smaller, because we collected UAV data on the 5th day after lodging, and the light lodging maize returned to normal growth.
SAVI and RDVI decreased in severe lodging which were lower than those of nonlodging after increasing slightly with the increase of lodging grades. SAVI values range from -1 to 1. The lower the green vegetation coverage, the lower the SAVI value . The nonlodging maize plants are erect, and the canopy spectra are mainly from the upper leaves. And the leaves shaded each other, which have an influence on the canopy spectra. Compared with nonlodging plants, the vegetation coverage of light and moderate lodging increased, and the vegetation coverage of moderate lodging was higher than that of light lodging. Therefore, the order of SAVI value is moderate lodging > light lodging > nonlodging. For severe lodging, due to the lower leaves of the plants turn yellow and dry, the soil background was exposed and the vegetation coverage decreased. The vegetation coverage of severe lodging is lower than that of the nonlodging, so the SAVI value is lower than the nonlodging maize.
NDVI decreased with the increase of lodging severity, and RDVI decreased after increasing, indicating that RDVI is mainly affected by DVI, and DVI is extremely sensitive to changes in soil background . The spectral reflectance of vegetation in near-infrared is higher than that in the red band. In nonlodging, light, and moderate lodging, the difference between near-infrared and red band increases with the increase of lodging grades. In the case of severe lodging, the reflectance in near-infrared decreases due to the influence of soil, so RDVI decreases and is smaller than that of nonlodging.
3.5. Principal Components and Texture Features
PCA can remove redundant information between bands while compressing multiband information into several, more efficient bands [51, 52]. There are four bands in the multispectral image; in order to avoid data redundancy, PCA was performed to obtain the first few principal components which contained more information. The first two principal components contain 96.86% information of all bands and could be used to extract texture features in this study.
The texture feature involves the extraction and analysis of spatial distribution patterns of gray grade in an image, which is widely used in image classification and target recognition [53–55]. Texture feature parameters are extracted to obtain qualitative or quantitative descriptions of texture by certain image processing technology. The gray level cooccurrence matrix (GLCM) is a comprehensive analysis of its local features and arrangement based on pixels. Haralick et al.  extracted and analyzed image texture features using GLCM and derived 14 parameters for quantifying texture features. The GLCM reflects the distribution characteristics of the gray level and presents changes in the repetition, alternation, or specific rules in the spatial range, which is a second-order statistical feature of the grayscale change of the image. The extraction of 8 texture features (Table 6) based on GLCM uses the first two principal components. The 8 texture features were mean, variance, homogeneity, dissimilarity, contrast, entropy, second moment, and correlation. After comparative analysis, the filtering window was set to , the spatial correlation matrix offset and were 1, and the grayscale quality was 64.
The texture feature parameters of the first principal component were used as an example to analyze the variation characteristics of different lodging grades (Figure 7). Since the parameters differ in magnitude, the mean, variance, contrast, and entropy were represented by a bar chart, and the homogeneity, dissimilarity, second moment, and correlation were represented by a line chart. It was clear that the various parameters differed when the lodging grades were different. The mean, homogeneity, and second moment decreased with increasing lodging grades, while variance, dissimilarity, contrast, entropy, and correlation increased with increasing lodging grades. Texture features reflect the spatial variability of spectral changes in every band. The texture features of different bands are usually various, so texture features have different abilities to distinguish different lodging grades.
4.1. Classification Results
Based on the spectral features, principal component features, texture features, vegetation indices, and the feature combination, the MLC method was used to classify lodging grades (Figure 8). Figure 8(a) presents the original UAV multispectral image, which is displayed as a false color combination of red, near-infrared, and green bands. The spatial resolution of the image was up to 0.05 m. Based on prior knowledge and agronomic experience, the different lodging grades, the shadow of maize plants, and the soil exposed by lodging can be clearly distinguished from the image, and soil and shadow were combined into one category. It was clear that the area of maize lodging was larger due to the influence of strong wind, and the area of severe lodging was the largest, being mainly distributed in the left half of the ROI (Figure 8(a)). It was also clear that the severe lodging area is the largest, and all areas are located in the left-central area of the ROI (Figures 8(b)–8(f)). The ROI area was about 31718.39 m2; we counted the area of each lodging type (Table 7). The results were slightly different but showed that the area of severe lodging was the largest and moderate lodging was the smallest.
The ground truth was used to verify the classification accuracy; we extract the partial enlargement of classification results which contain ground truth with different lodging types (Figure 9). For nonlodging, the result of texture features and combination of texture features and vegetation indices is right; in other classification results, there is error phenomenon of classifying nonlodging into light lodging. For light lodging, all the classification results showed that some of the pixels were classified into nonlodging and moderate lodging. For moderate lodging, all the classification results showed that some of the pixels were classified into nonlodging, light lodging, and severe lodging. For severe lodging, there is also a phenomenon of misclassification. Some pixels were classified into light lodging, moderate lodging, and shadow and soil.
The classification of the maize lodging grade was verified using the confusion matrix combined with verification samples. The classification accuracy of 6 evaluation indicators for each category is shown in Table 8. From the perspective of producer’s and user’s accuracy, the accuracy of the shadow and soil class was the highest, followed by severe lodging, and light lodging was lowest. Because the image characteristics of shadow and soil are far from those of normal and lodging maize in ROI, they are easy to identify. Severe lodging caused most or all stems of maize to be exposed as a result of falling to the ground. In addition, the reflectance of maize leaves and stems as well as the image characteristics is differed, making them easy to recognize. From the perspective of commission error, light lodging and moderate lodging are most serious, which may be due to the small difference among the light, moderate lodging, and nonlodging types. The omission error is large in the case of light lodging, which is divided into other lodging types. This is because of some overlap of characteristic information among the different lodging types.
The overall accuracy of spectrum features, principal component features, vegetation indices, texture features, and the feature combination was 83.58, 84.54, 83.40, 85.05, and 86.61%, respectively, and the Kappa coefficients were 0.7947, 0.8068, 0.7925, 0.8131, and 0. 8327, respectively. The overall accuracy of the spectrum features reached 83.58%, indicating that visual interpretation is reliable to identify the different lodging grades with high-resolution images. The overall accuracy of the first two principal components is about 1% higher than that of the spectral image. PCA focuses on the various information features of different lodging grades in fewer bands, thus avoiding data redundancy. Vegetation indices were 0.18% lower than the spectral feature, which may be due to the vegetation indices being less, along with the small differentiation between various lodging grades of maize (especially between light and moderate lodging). The overall accuracy of texture features was higher than those of spectral and principal component features, mainly because the spatial resolution of UAV image is high and the texture features reflect the homogeneous phenomenon in the image. Additionally, the phenomena of “same object different spectra” and “different objects same spectra” in spectral feature recognition can be avoided, and classification accuracy is improved. The overall accuracy and Kappa coefficient of the feature combination were the highest, which are higher than those of single feature. The results show that the method based on feature combination can significantly improve the classification accuracy of maize lodging grades during the filling stage.
Monitoring crop lodging needs to simultaneously determine the grades and area in order to better evaluate the yield and economic loss caused by lodging stress [60, 61]. After lodging, the canopy structure of maize changed greatly, mainly regarding the ratio of stem to leaf in the detection field of view and the light exposure conditions of each part of the plant; thus, there is significant difference in spectral reflectance of different lodging types. The more serious the lodging stress, the more exposed the stem, and the higher the spectral reflectance. We proposed a method based on the UAV multispectral image to classify the lodging grades of maize during the filling stage.
Timely acquisition of crop lodging grades and area is of great significance for the assessment of yield loss. The development of remote sensing provides an important method to monitor crop lodging [6, 62]. However, satellite data can be affected by clouds, the revisiting time is long, and the spatial resolution is low. There is a mixed pixel phenomenon, and the cost of remote sensing data with high spatial resolution is also high, which leads to large uncertainty in crop lodging monitoring. Presently, there is a focus on research on crop lodging monitoring based on the UAV platform with digital and multispectral cameras. The UAV imaging system is fast, nondestructive, low-cost, and unaffected by the atmosphere [10–16, 63]. The data in the present study were derived from UAV multispectral images, which contain four bands: green, red, red edge, and near-infrared. Compared with an RGB image [12–15], the spectral characteristics of maize in different bands can be used to qualitatively distinguish different lodging grades. At the same time, the vegetation indices can be constructed using multiple bands. The vegetation index reflects the activity and physiological characteristics of green vegetation (for example, chlorophyll content and photosynthesis intensity), which can be used to quantitatively explain the growth status of crops [64, 65]. The variation characteristics of vegetation indices differ with different lodging grades. The texture features can also be extracted based on the GLCM, which reflects the spatial variability of spectral changes of ground objects . The various texture parameters of maize with different lodging grades differ. In addition, many studies have been performed to identify crop lodging and extract crop lodging areas by UAV; however, they only classified crop to lodging and nonlodging or predicted the occurrence probability of lodging [12, 14, 15]. In fact, the influence of different lodging grades on crops is usually various. After crops are subjected to lodging stress, photosynthesis in leaves is suppressed to varying extents, and physiological and biochemical parameters are also changed [67–69]. Thus, crop yield is affected; when the lodging is light, it will lead to the reduction of crop yield, and when the lodging is serious, it will lead to the failure of crop harvest; therefore, a more detailed division of crop lodging grades is needed.
In this study, the MLC method was used to classify the lodging grades of maize during the filling stage. Due to the lack of field survey data and the high spatial resolution of 0.05 m, combined with prior agronomic knowledge, it was possible to visually distinguish different lodging grades. The overall accuracy of the multispectral image was 83.58%, and the Kappa coefficient was 0.7947, indicating that the training samples for visual interpretation are reliable for identifying the lodging grades of maize. The overall accuracy of the combination of texture features and vegetation indices was 3.03% higher than that of the spectral feature, indicating that the feature combination is better for classification of lodging grades.
RGB images have been used for a long time to observe crops in order to compile a history of the fields and to analyze reparceling. The RGB camera only obtains the information of red, green, and blue bands, and all of them are in the visible band. Compared with RGB data, multispectral data contains not only the visible band but also the near-infrared band. When the vegetation is stressed, the chlorophyll content and water content will change, although this change appears synchronously in visible and near-infrared band, but the change is more obvious in the near-infrared . Our previous studies [40–42] have shown that crop lodging causes the collapse of the original canopy structure and disrupts the distribution of leaves; some or a considerable number of leaves are pressed or covered. The more serious the lodging degree, the stem-leaf ratio of canopy also increases. The higher the exposure ratio of the canopy stem is, the higher the spectral reflectance is, and the change in near-infrared band is more significant than that in the visible band. Therefore, the near-infrared band provides important information in monitoring crop lodging.
Regarding the flight altitude, we refer to References [14, 28, 70, 71]. When the flying height is too high, the spatial resolution of the image will be low and the spectral information will be lost. When the flying height is too low and the spatial resolution is high, a maize plant will be divided into more categories; at the same time, the amount of image data will increase, resulting in data redundancy. In addition, the flight area will also become smaller. The high spatial resolution of 0.05 m ensures that there are all pure pixels, which avoids the interference caused by mixed pixels and omits the mixed pixel decomposition in image classification [72, 73]. Multispectral image classification is strongly affected by spatial resolution while the accuracy is not necessarily improved by the increase of the spatial resolution . There exists an optimal resolution for each geographical entity, corresponding to its intrinsic spatial and spectral characteristics. Because the resolution of the UAV multispectral image was high and a pixel was used as the basic classification unit, the reflectance and characteristics of maize leaves and stems differed. Thus, the same maize is inevitably divided into two or more categories. Although the degree of stem exposure in maize was different, the spectra and other characteristics of different lodging grades were similar, which can easily lead to misclassification.
In the maize planting plot, we conducted a field survey of maize varieties and lodging types. The UAV flight plots we selected included different types of lodging, and the maize varieties were Zhengdan 958, which avoids the difference caused by maize varieties and the defect of the single lodging type in the same plot. The maize plant has strong growth ability and a certain recovery ability after lodging, which is various with different lodging grades [40, 41]. In different times of the same lodging type, coupled with the self-recovery of maize, the canopy structure will change greatly and the spectral reflectance will also change. In addition, the mechanism of plant recovery after lodging is a complex process, which is affected by many factors. The method proposed in this paper is effective to classify the lodging types of the data collected on the same day and avoids the influence of the reflectance of the same lodging type in different periods. In the next work, we will study the recovery of maize after lodging from multitime series data. Also, we will add field survey data, make comprehensive use of multisource remote sensing data, introduce more image features, combine different features, and use an object-oriented method and other classification methods to improve accuracy and identify the optimal method to classify maize lodging grades. Providing the relevant agricultural production departments and agricultural insurance companies with data on accurate losses caused by different grades of crop lodging will permit reasonable postdisaster remedial work and claim-settlement programs.
First, the spectral reflectance of maize with different lodging grades was extracted from UAV images using training samples, and the spectral characteristics of maize with different lodging grades were analyzed. Compared with nonlodging, the more serious of lodging grades, the higher the spectral reflectance, the greater the increase in spectral reflectance. Then, the principal components were extracted, the texture features based on GLCM were transformed, the four vegetation indices were constructed, and the texture features and vegetation indices were combined. The maize lodging grades of different features were classified by the MLC method. The results showed that the severe lodging area was the largest and was distributed in the left half of the field plot. Finally, based on the verification samples with different lodging grades, classification accuracy was evaluated using a confusion matrix. The overall accuracy of the spectral features was 83.58%, and the Kappa coefficient was 0.7947. The overall accuracy of the combination of texture features and vegetation indices was 86.61%, and the Kappa coefficient was 0.8327, and these values were 3.03% and 0.038 higher than those of the spectrum features, respectively. There is an advantage of quickly and accurately extracting the maize lodging grades based on feature combination of high-resolution UAV multispectral image.
Conflicts of Interest
The authors declare that there is no conflict of interest regarding the publication of this article.
Qian Sun and Xiaohe Gu contributed to conception and design of the study; Qian Sun wrote the first draft of the manuscript; Xiaohe Gu, Lin Sun, and Meiyan Shu wrote sections of the manuscript; Qian Sun, Meiyan Shu, Guijun Yang, and Longfei Zhou were involved in the experiments, ground data collection, and the field investigation. All authors contributed to manuscript revision, read, and approved the submitted version.
This work was supported by the National Natural Science Foundation of China (41571323), the Beijing Natural Science Foundation (6172011), and the Special Funds for Technology innovation capacity building sponsored by the Beijing Academy of Agriculture and Forestry Sciences (KJCX20170705).
- B. G. Abedon, L. L. Darrah, and W. F. Tracy, “Developmental changes associated with divergent selection for rind penetrometer resistance in the MoSCSSS maize synthetic,” Crop Science, vol. 39, no. 1, pp. 108–114, 1999.
- E. Hondroyianni, D. K. Papakosta, A. A. Gagianas, and K. A. Tsatsarelis, “Corn stalk traits related to lodging resistance in two soils of differing salinity,” Maydica, vol. 45, no. 2, pp. 125–133, 2000.
- H. A. Esechie, “Relationship of stalk morphology and chemical composition to lodging resistance in maize (Zea maysL.) in a rainforest zone,” The Journal of Agricultural Science, vol. 104, no. 2, pp. 429–433, 1985.
- S. U. Remison and D. Akinleye, “Relationship between lodging, morphological characters and yield of varieties of maize (Zea mays L.),” The Journal of Agricultural Science, vol. 91, no. 3, pp. 633–638, 1978.
- T. L. Setter, E. V. Laureles, and A. M. Mazaredo, “Lodging reduces yield of rice by self-shading and reductions in canopy photosynthesis,” Field Crops Research, vol. 49, no. 2-3, pp. 95–106, 1997.
- S. Jay, F. Maupas, R. Bendoula, and N. Gorretta, “Retrieving LAI, chlorophyll and nitrogen contents in sugar beet crops from multi-angular optical remote sensing: comparison of vegetation indices and PROSAIL inversion for field phenotyping,” Field Crops Research, vol. 210, pp. 33–46, 2017.
- C. Yang, J. H. Everitt, and J. M. Bradford, “Comparison of QuickBird satellite imagery and airborne imagery for mapping grain sorghum yield patterns,” Precision Agriculture, vol. 7, no. 1, pp. 33–44, 2006.
- L. Wang, X. Gu, S. Hu et al., “Remote sensing monitoring of maize lodging based on multi-temporal HJ-1B CCD image,” Scientia Agricultura Sinica, vol. 49, no. 21, pp. 4120–4129, 2016.
- B. J. Soto-Cerda, S. Duguid, H. Booker, G. Rowland, A. Diederichsen, and S. Cloutier, “Genomic regions underlying agronomic traits in linseed (Linum usitatissimum L.) as revealed by association mapping,” Journal of Integrative Plant Biology, vol. 56, no. 1, pp. 75–87, 2014.
- Z. Li, Z. Chen, L. Wang, J. Liu, and Q. Zhou, “Area extraction of maize lodging based on remote sensing by small unmanned aerial vehicle,” Transactions of the Chinese Society of Agricultural Engineering, vol. 30, no. 19, pp. 207–213, 2014.
- H. Y. Liu, G. J. Yang, and H. C. Zhu, “The extraction of wheat lodging area in UAV’s image used spectral and texture features,” Applied Mechanics and Materials, vol. 651-653, pp. 2390–2393, 2014.
- M.-D. Yang, K.-S. Huang, Y.-H. Kuo, H. Tsai, and L.-M. Lin, “Spatial and spectral hybrid image classification for rice lodging assessment through UAV imagery,” Remote Sensing, vol. 9, no. 6, pp. 583–601, 2017.
- T. Chu, M. Starek, M. Brewer, S. Murray, and L. Pruter, “Assessing lodging severity over an experimental maize (Zea mays L.) field using UAS images,” Remote Sensing, vol. 9, no. 9, pp. 923–946, 2017.
- L. Han, G. Yang, H. Feng et al., “Quantitative identification of maize lodging-causing feature factors using unmanned aerial vehicle images and a nomogram computation,” Remote Sensing, vol. 10, no. 10, pp. 1528–1546, 2018.
- N. Wilke, B. Siegmann, L. Klingbeil et al., “Quantifying lodging percentage and lodging severity using a UAV-based canopy height model combined with an objective threshold approach,” Remote Sensing, vol. 11, no. 5, pp. 515–532, 2019.
- D. Singh, X. Wang, U. Kumar et al., “High-throughput phenotyping enabled genetic dissection of crop lodging in wheat,” Frontiers in Plant Science, vol. 10, p. 394, 2019.
- S. L. Murfitt, B. M. Allan, A. Bellgrove, A. Rattray, M. A. Young, and D. Ierodiaconou, “Applications of unmanned aerial vehicles in intertidal reef monitoring,” Scientific Reports, vol. 7, no. 1, article 10259, 2017.
- D. Ventura, M. Bruno, G. Jona Lasinio, A. Belluscio, and G. Ardizzone, “A low-cost drone based application for identifying and mapping of coastal fish nursery grounds,” Estuarine, Coastal and Shelf Science, vol. 171, pp. 85–98, 2016.
- M. E. Brown, J. E. Pinzón, K. Didan, J. T. Morisette, and C. J. Tucker, “Evaluation of the consistency of long-term NDVI time series derived from AVHRR,SPOT-vegetation, SeaWiFS, MODIS, and Landsat ETM+ sensors,” IEEE Transactions on Geoscience and Remote Sensing, vol. 44, no. 7, pp. 1787–1793, 2006.
- T. Liu, R. Li, X. Zhong et al., “Estimates of rice lodging using indices derived from UAV visible and thermal infrared images,” Agricultural and Forest Meteorology, vol. 252, pp. 144–154, 2018.
- C. Zhang, D. Walters, and J. M. Kovacs, “Applications of low altitude remote sensing in agriculture upon farmers' requests– a case study in northeastern Ontario, Canada,” PLoS One, vol. 9, no. 11, article e112894, 2014.
- Z. Liu, C. Li, Y. Wang et al., “Comparison of spectral indices and principal component analysis for differentiating lodged rice crop from normal ones,” in Computer and Computing Technologies in Agriculture V. CCTA 2011. IFIP Advances in Information and Communication Technology, vol 369, D. Li and Y. Chen, Eds., pp. 84–92, Springer, Berlin, Heidelberg, 2012.
- X. Xie, X. Gu, L. Lin, G. Yang, and L. Zhang, “Analysis of effect and spectral response of lodging stress on the ratio of visible stem, leaf and panicle in rice,” Spectroscopy and Spectral Analysis, vol. 39, no. 7, pp. 2264–2270, 2019.
- H. Song, C. Yang, J. Zhang, W. C. Hoffmann, D. He, and J. A. Thomasson, “Comparison of mosaicking techniques for airborne images from consumer-grade cameras,” Journal of Applied Remote Sensing, vol. 10, no. 1, article 016030, 2016.
- L. Han, G. Yang, H. Yang, B. Xu, Z. Li, and X. Yang, “Clustering field-based maize phenotyping of plant-height growth and canopy spectral dynamics using a UAV remote-sensing approach,” Frontiers in Plant Science, vol. 9, article 1638, 2018.
- J. R. Otukei and T. Blaschke, “Land cover change assessment using decision trees, support vector machines and maximum likelihood classification algorithms,” International Journal of Applied Earth Observation and Geoinformation, vol. 12, no. 1, pp. S27–S31, 2010.
- K. Kanniah, A. Sheikhi, A. Cracknell et al., “Satellite images for monitoring mangrove cover changes in a fast growing economic region in southern Peninsular Malaysia,” Remote Sensing, vol. 7, no. 11, pp. 14360–14385, 2015.
- G. Banko, “A review of assessing the accuracy of classifications of remotely sensed data and of methods including remote sensing data in forest inventory,” Tech. Rep., International Institute for Applied Systems Analysis, Laxenburg, Austria, 1998.
- A. Ahmad, “Classification simulation of RazakSAT satellite,” Procedia Engineering, vol. 53, pp. 472–482, 2013.
- A. Ahmad and S. Quegan, “Analysis of maximum likelihood classification technique on Landsat 5 TM satellite data of tropical land covers,” in 2012 IEEE International Conference on Control System, Computing and Engineering, pp. 6425–6436, Penang, Malaysia, 2012.
- P. S. Bharatkar and R. Patel, “Approach to accuracy assessment tor RS image classification techniques,” International Journal of Scientific & Engineering Research, vol. 4, no. 12, pp. 79–86, 2013.
- J. Aldoski, S. B. Mansor, and H. Z. M. Shafri, “Image classification in remote sensing,” Journal of Environment & Earth Science, vol. 3, no. 10, pp. 141–147, 2013.
- K. Kalra, A. K. Goswami, and R. Gupta, “A comparative study of supervised image classification algorithms for satellite images,” International Journal of Electrical Electronics & Data Communication, vol. 2, no. 1, pp. 10–16, 2014.
- M. Antrop and V. van Eetvelde, “Holistic aspects of suburban landscapes: visual image interpretation and landscape metrics,” Landscape and Urban Planning, vol. 50, no. 1-3, pp. 43–58, 2000.
- W. Zhou, M. L. Cadenasso, K. Schwarz, and S. T. A. Pickett, “Quantifying spatial heterogeneity in urban landscapes: integrating visual interpretation and, object-based classification,” Remote Sensing, vol. 6, no. 4, pp. 3369–3386, 2014.
- L. Liu, J. Wang, X. Song, C. Li, W. Huang, and C. Zhao, “The canopy spectral features and remote sensing of wheat lodging,” Journal of Remote Sensing, vol. 9, no. 3, pp. 323–327, 2005.
- M. Shu, X. Gu, L. Sun et al., “Structural characteristics change and spectral response analysis of maize canopy under lodging stress,” Spectroscopy and Spectral Analysis, vol. 39, no. 11, pp. 1–7, 2019.
- L. Zhou, X. Gu, S. Cheng, G. Yang, Q. Sun, and M. Shu, “Spectral diagnosis of leaf area density of maize at heading stage under lodging stress,” Scientia Agricultura Sinica, vol. 52, no. 9, pp. 1518–1528, 2019.
- M. Shu, X. Gu, L. Sun, J. Zhu, G. Yang, and Y. Wang, “Selection of sensitive canopy structure parameters and spectral diagnostic model for lodging intensity of winter wheat,” Transactions of the Chinese Society of Agricultural Engineering, vol. 35, no. 4, pp. 168–174, 2019.
- J. A. Schell, “Monitoring vegetation systems in the Great Plains with ERTS,” in NASA. Goddard Space Flight Center 3d ERTS-1 Symp, pp. 309–317, College Station, TX, USA, 1973.
- A. A. Gitelson, Y. J. Kaufman, and M. N. Merzlyak, “Use of a green channel in remote sensing of global vegetation from EOS-MODIS,” Remote Sensing of Environment, vol. 58, no. 3, pp. 289–298, 1996.
- B. J. Yoder and R. H. Waring, “The normalized difference vegetation index of small Douglas-fir canopies with varying chlorophyll concentrations,” Remote Sensing of Environment, vol. 49, no. 1, pp. 81–91, 1994.
- A. A. Gitelson, R. Stark, U. Grits, D. Rundquist, Y. Kaufman, and D. Derry, “Vegetation and soil lines in visible spectral space: a concept and technique for remote estimation of vegetation fraction,” International Journal of Remote Sensing, vol. 23, no. 13, pp. 2537–2562, 2002.
- A. R. Huete, “A soil-adjusted vegetation index (SAVI),” Remote Sensing of Environment, vol. 25, no. 3, pp. 295–309, 1988.
- J. L. Roujean and F. M. Breon, “Estimating PAR absorbed by vegetation from bidirectional reflectance measurements,” Remote Sensing of Environment, vol. 51, no. 3, pp. 375–384, 1995.
- T. S. Purevdorj, R. Tateishi, T. Ishiyama, and Y. Honda, “Relationships between percent vegetation cover and vegetation indices,” International Journal of Remote Sensing, vol. 19, no. 18, pp. 3519–3535, 2010.
- J. Xue and B. Su, “Significant remote sensing vegetation indices: a review of developments and applications,” Journal of Sensors, vol. 2017, Article ID 1353691, 17 pages, 2017.
- M. Mustafa, M. N. Taib, Z. H. Murat, and S. Lisa, “GLCM texture feature reduction for EEG spectrogram image using PCA,” in 2010 IEEE Student Conference on Research and Development (SCOReD), Putrajaya, Malaysia, December 2010.
- R. Gharbia, A. H. E. Baz, A. E. Hassanien, G. Schaefer, T. Nakashima, and A. T. Azar, “Fusion of multi-spectral and panchromatic satellite images using principal component analysis and fuzzy logic,” in 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), Beijing, China, July 2014.
- A. Giannakos and H. Feidas, “Classification of convective and stratiform rain based on the spectral and textural features of Meteosat Second Generation infrared data,” Theoretical and Applied Climatology, vol. 113, no. 3-4, pp. 495–510, 2013.
- R. Mehta, J. Yuan, and K. Egiazarian, “Face recognition using scale-adaptive directional and textural features,” Pattern Recognition, vol. 47, no. 5, pp. 1846–1858, 2014.
- E. V. Carrera, S. Izurieta, and R. Carrera, “A finger-vein biometric system based on textural features,” in Proceedings of the International Conference on Information Technology & Systems (ICITS 2018). ICITS 2018. Advances in Intelligent Systems and Computing, Á. Rocha and T. Guarda, Eds., vol. vol 721, pp. 367–375, Springer, Cham.
- R. M. Haralick, K. Shanmugam, and I. Dinstein, “Textural features for image classification,” IEEE Transactions on Systems, Man, and Cybernetics, vol. SMC-3, no. 6, pp. 610–621, 1973.
- L. K. Soh and C. Tsatsoulis, “Texture analysis of SAR sea ice imagery using gray level co-occurrence matrices,” IEEE Transactions on Geoscience and Remote Sensing, vol. 37, no. 2, pp. 780–795, 1999.
- P. Mohanaiah, P. Sathyanarayana, and L. Guru Kumar, “Image texture feature extraction using GLCM approach,” International Journal of Scientific and Research Publications, vol. 3, no. 5, pp. 1–5, 2013.
- K. P. S. Shijin and V. S. Dharun, “Extraction of texture features using GLCM and shape features using connected regions,” International Journal of Engineering and Technology, vol. 8, no. 6, pp. 2926–2930, 2016.
- S. L. Kendall, H. Holmes, C. A. White, S. M. Clarke, and P. M. Berry, “Quantifying lodging-induced yield losses in oilseed rape,” Field Crops Research, vol. 211, pp. 106–113, 2017.
- P. M. Berry and J. Spink, “Predicting yield losses caused by lodging in wheat,” Field Crops Research, vol. 137, pp. 19–26, 2012.
- S. Chauhan, R. Darvishzadeh, M. Boschetti, M. Pepe, and A. Nelson, “Remote sensing-based crop lodging assessment: current status and perspectives,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 151, pp. 124–140, 2019.
- M. Gutierrez-Rodriguez, J. A. Escalante-Estrada, and M. T. Rodriguez-Gonzalez, “Canopy reflectance, stomatal conductance, and yield of Phaseolus vulgaris L. and Phaseolus coccinues L. under saline field conditions,” International Journal of Agriculture &Biology, vol. 7, pp. 491–494, 2005.
- S. Candiago, F. Remondino, M. de Giglio, M. Dubbini, and M. Gattelli, “Evaluating multispectral images and vegetation indices for precision farming applications from UAV images,” Remote Sensing, vol. 7, no. 4, pp. 4026–4047, 2015.
- P. Li, T. Cheng, and J. Guo, “Multivariate image texture by multivariate variogram for multispectral image classification,” Photogrammetric Engineering & Remote Sensing, vol. 75, no. 2, pp. 147–157, 2009.
- A. N. Shah, M. Tanveer, A. U. Rehman, S. A. Anjum, J. Iqbal, and R. Ahmad, “Lodging stress in cereal—effects and management: an overview,” Environmental Science and Pollution Research, vol. 24, no. 6, pp. 5222–5237, 2017.
- D. J. Robertson, M. Julias, S. Y. Lee, and D. D. Cook, “Maize stalk lodging: morphological determinants of stalk strength,” Crop Science, vol. 57, no. 2, pp. 926–934, 2017.
- S. Khan, S. Anwar, J. Kuai et al., “Alteration in yield and oil quality traits of winter rapeseed by lodging at different planting density and nitrogen rates,” Scientific Reports, vol. 8, no. 1, p. 634, 2018.
- P. Ceccato, N. Gobron, S. Flasse, B. Pinty, and S. Tarantola, “Designing a spectral index to estimate vegetation water content from remote sensing data: part 1: theoretical approach,” Remote Sensing of Environment, vol. 82, no. 2-3, pp. 188–197, 2002.
- A. R. Yusoff, N. Darwin, Z. Majid, M. F. M. Ariff, and K. M. Idris, “Comprehensive analysis of flying altitude for high resolution slope mapping using UAV technology,” ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XLII-3/W4, pp. 583–589, 2018.
- J. He, Y. Li, and K. Zhang, “Research of UAV flight planning parameters,” Positioning, vol. 03, no. 04, pp. 43–45, 2012.
- P.-F. Hsieh, L. C. Lee, and N.-Y. Chen, “Effect of spatial resolution on classification errors of pure and mixed pixels in remote sensing,” IEEE Transactions on Geoscience and Remote Sensing, vol. 39, no. 12, pp. 2657–2663, 2002.
- M. Tomosada and H. Tsubaki, “Novel mixture model for mixed pixel classification of multispectral image data,” International Journal of Mathematical Models and Methods in Applied Sciences, vol. 1, no. 5, pp. 175–183, 2011.
- H. Huang, B. Wu, and J. Fan, “Analysis to the relationship of classification accuracy, segmentation scale, image resolution,” in IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477), Toulouse, France, July 2003.
Copyright © 2019 Qian Sun et al. Exclusive Licensee Nanjing Agricultural University. Distributed under a Creative Commons Attribution License (CC BY 4.0).