Review Article | Open Access
Ruiliang Pu, "Mapping Tree Species Using Advanced Remote Sensing Technologies: A State-of-the-Art Review and Perspective", Journal of Remote Sensing, vol. 2021, Article ID 9812624, 26 pages, 2021. https://doi.org/10.34133/2021/9812624
Mapping Tree Species Using Advanced Remote Sensing Technologies: A State-of-the-Art Review and Perspective
Abstract
Timely and accurate information on tree species (TS) is crucial for developing strategies for sustainable management and conservation of artificial and natural forests. Over the last four decades, advances in remote sensing technologies have made TS classification possible. Since many studies on the topic have been conducted and their comprehensive results and novel findings have been published in the literature, it is necessary to conduct an updated review on the status, trends, potentials, and challenges and to recommend future directions. The review will provide an overview on various optical and light detection and ranging (LiDAR) sensors; present and assess current various techniques/methods for, and a general trend of method development in, TS classification; and identify limitations and recommend future directions. In this review, several concluding remarks were made. They include the following: (1) A large group of studies on the topic were using high-resolution satellite, airborne multi-/hyperspectral imagery, and airborne LiDAR data. (2) A trend of “multiple” method development for the topic was observed. (3) Machine learning methods including deep learning models were demonstrated to be significant in improving TS classification accuracy. (4) Recently, unmanned aerial vehicle- (UAV-) based sensors have caught the interest of researchers and practitioners for the topic-related research and applications. In addition, three future directions were recommended, including refining the three categories of “multiple” methods, developing novel data fusion algorithms or processing chains, and exploring new spectral unmixing algorithms to automatically extract and map TS spectral information from satellite hyperspectral data.
1. Introduction
1.1. Significance of Tree Species Information
Over the last four decades, advances in remote sensing technologies have made tree species (TS) classification possible from various remote sensing sensors’ data. Timely and accurate information on the status and structure of TS and forest species composition is crucial for developing strategies for sustainable management and conservation of artificial and natural resources. Such TS information is needed for many application purposes. They may include, but are not limited to, aiding forest resource inventories [1], assessing urban living environments (health, wellbeing, and aesthetics) [2], assessing and monitoring biodiversity [3], estimating urban vegetation biomass and carbon storage [4], and monitoring invasive plant species [5]. In this review, in general, TS is at the species level in a general plant classification system (i.e., variant, species, genus, and family); however, due to the different purposes of the reviewed studies using the same or similar remote sensing data and TS classification techniques/methods, studies on classifying tree variants, species groups, and even a few of forest (stand) species and types or urban TS were also reviewed. In practice, to collect the tree canopy structure and species information, there are two traditional ways, including field measurement and aerial photograph interpretation. However, obtaining the information through the traditional methods is usually time consuming and costly/expensive, especially over large areas. Remote sensing technologies, especially satellite remote sensing techniques, have the advantages of overcoming the shortcomings of the traditional methods to rapidly obtain the TS information at a local, regional, or even global scale. However, previous research has proved that accurately classifying individual TS and mapping tree canopy and structure using moderate-resolution satellite data are difficult or even impossible [6–11].
During the last couple of decades, remote sensing technologies have advanced in improving spatial and spectral resolutions (e.g., IKONOS with four multispectral (MS) bands at 4 m resolution and one panchromatic (pan) band at 1 m resolution and Hyperion hyperspectral sensor with more than 200 bands at a 10 nm spectral resolution). Very high spatial resolution (VHR) satellite images have demonstrated to be a cost-effective alternative to aerial photography for creating digital maps [12] and mapping TS [13]. Meanwhile, various hyperspectral (HS) data (e.g., Airborne Visible Infrared Imaging Spectrometer (AVIRIS) and Hyperion) have been used to classify and map TS, presenting a certain degree of success (e.g., [10, 14–17]). More recently, various light detection and ranging (LiDAR) techniques and unmanned aerial vehicle- (UAV-) based sensor techniques have been developed. Such advanced remote sensing techniques, especially VHR satellite remote sensing, have provided opportunities to identify TS and map individual trees (e.g., [18–20]).
1.2. Review Objectives
There were six review papers in the existing literature closely related to this review. Table 1 outlines focuses and objectives of the six review papers. Table 1 shows that, except work by Fassnacht et al. [21], all other review papers cover less components than those covered by this paper, either just assessing the accuracy of the individual tree-based forest inventory techniques and LiDAR data alone or reviewing studies focusing on an urban environment only. In this review, this paper provides an overview on applications of remote sensing sensors’ data to TS mapping, especially the use of VHR satellite MS images, airborne and UAV-based MS and HS images, and airborne LiDAR data. The main objectives of this paper are as follows: (i)Review high spatial/spectral resolution optical remote sensing sensors/systems and LiDAR sensors used for TS classification(ii)Review and evaluate suitable data fusion methods and feature characteristics and selection methods in mapping TS(iii)Provide an overview on, and assess, various techniques/methods for classifying TS(iv)Present a general trend in method development in TS classification(v)Brief limitations, and offer future directions, for classifying and mapping TS using advanced remote sensing technologies
|
1.3. Review Approach
Although a total of 231 peer-review journal papers in English language related to TS classification and mapping with various remote sensing sensors’ data were reviewed in this study, there were only 153 papers directly cited in the paper (the remaining 78 papers reported their studies with the same sensors’ data and the same or similar methods and techniques for TS classification as those directly cited in the paper). Given the fact that there were less qualified papers published in the time span of 1980–2000, this review is more focused on papers published after 2000, especially after 2015. The ISI Web of Science and Google Scholar databases were accessed to search for relevant papers published during the last four decades on the topic based on the following terms in the title (of one paper): (remote sensing OR LiDAR OR UAV) AND (vegetation OR tree OR plant OR forest) AND (classifi OR map OR identi OR discriminat). There were about 600 studies meeting the conditions to be found. The studies were then further filtered based on the following criteria all met to form a final list (231) of papers for review in this study: (i)A study must discriminate at least two TS (or species groups)(ii)A study must create and/or present TS classification and mapping results(iii)A study must investigate effect(s) of spatial and/or (AND) spectral AND temporal AND data preprocessing AND feature extraction methods, and TS classification techniques/methods on TS classification(iv)A study must report detailed accuracy assessment results for TS classification
This review begins with introducing the significance and importance of TS classification and review objectives and approach. Then, advanced remote sensing sensors/systems suitable for TS classification and mapping are reviewed. Next, techniques and methods of TS classification are reviewed and assessed. As a trend of method development in TS mapping and classification, three categories of “multiple” methods are presented and evaluated. Finally, after limitations and constraints of current techniques and methods are identified and discussed, three future directions for improving TS classification are recommended and discussed.
2. Advanced Remote Sensing Sensors Suitable for Tree Species Classification
2.1. Tree Species Characteristics Measured by Remote Sensing Technologies
2.1.1. Passive Optical Remote Sensing (Multi-/Hyperspectral) Data
Both multispectral (MS) and hyperspectral (HS) remote sensing sensors can provide useful information to differentiate tree species (TS) by measuring spectral responses from their canopy in certain spectral (wavelengths) regions. In practice, these measurements are then typically transformed to spectral radiance and/or surface reflectance for many application purposes including mapping TS [21]. Usually, green plants are sensitive to most solar radiation from the ultraviolet through shortwave infrared (SWIR) with most plants covering visible (VIS, ~0.4–0.7 μm), near infrared (NIR, ~0.7–1.3 μm), and SWIR (~1.3–2.5 μm) regions, and absorb solar radiation in the visible region for the photosynthesis process necessary for plant growth. Green leaves from different species may have variable strengths of absorption and reflectance. For green plants, VIS light is absorbed by multiple plant pigments; NIR radiation is reflected by multiscattering of internal cellular structure; and SWIR energy is absorbed by water and other biochemical constituents [26]. Plant foliar and canopy spectral variabilities among different species, or even within single tree crowns, are due not only to differences in internal leaf structure/morphology and biochemicals (e.g., thickness of cell walls, water, and photosynthetic pigments) [27–30] but also to variation in canopy structure/morphology (e.g., leaf and branch density and clumping) [31, 32]. In addition, the spectral variabilities are also attributed to differences in phenology/physiology of plant species and in background signals associated with bare soil, litter, herbaceous vegetation, epiphyll cover, and herbivory [30, 33, 34].
The varying biochemical contents and structural properties among different TS are also dependent upon measured wavelength, pixel size, and ecosystem type [28]. Since modern remote sensing technologies, such as HS sensors, allow identifying plant absorption features that may be associated with different plant species or varieties [35, 36], it is critical to find the best wavelengths suitable for species identification in HS remote sensing. For example, to identify invasive species in Hawaiian forests from native and other introduced species by remote sensing, Asner et al. [37] demonstrated that the observed differences in canopy spectral features among the different plant species are related to relative differences in measured biochemicals, structural properties, and canopy leaf area index (LAI). Crown texture information at a pixel level or a single tree crown level has also been explored to improve TS classification. It is mainly related to crown-internal shadows and structure, foliage properties, and branching. Such texture information, at relatively coarser scales, is also associated with crown size, crown closure, crown shape, forest type, and canopy structure and morphology that are main drivers for producing texture information from passive optical sensors’ data. Studies on combining spectral with texture features often improve the accuracy of TS classification (e.g., [34, 38]). The phenology trait for plant species identification is useful. Phenology includes very obvious processes with seasonal changes, such as deciduous tree leaf color changes in autumn due to leaf senescence (mainly related to changes of various leaf pigments) and in evergreen coniferous forests and leaf-on and -off change in deciduous forests. Since phenology varies with plant species, it is ideal to use a multitemporal optical remote sensing technique to align the image acquisition time with the phenological period of the tree species under investigation [39, 40]. For example, in discriminating TS at different taxonomic levels using multitemporal WorldView-3 (WV3) imagery in Washington D.C., USA, Fang et al. [1] observed that the most valuable phenological cycle is fall senescence for TS classification. Therefore, selecting an ideal time-point for acquiring an image to capture phenology-related information is helpful to increase the accuracy of TS mapping.
2.1.2. Active LiDAR Data
LiDAR sensors may be used to measure structural properties and biophysical parameters of forests at single crown and canopy levels from either ranges or intensities recorded by LiDAR sensors [41, 42]. Such attributes and parameters measured by LiDAR sensors may include plant height, forest density and basal area, above ground biomass, and LAI at both single tree and stand levels [43–46]. These attributes and parameters can vary within and between tree species, but are at least partly complementary to passive optical sensors’ data for TS classification (e.g., [41]). LiDAR-derived tree height information alone may be of limited value for TS discrimination [21]. Combining optical VHR image data with LiDAR data has been demonstrated to be a very effective strategy for monitoring forest stands, identifying individual tree crowns, and mapping TS (e.g., [41, 42, 47–49]). LiDAR intensity differences among different TS are mainly caused by the differences of leaf structures of trees featuring larger individual leaves for broadleaf forests and continuous surface and needle leaf coniferous forests [50].
2.2. Optical Remote Sensing (Multi-/Hyperspectral) Sensors/Systems
Currently, a set of optical sensors/systems suitable for remote sensing of TS includes moderate and high spatial resolutions and high spectral resolution airborne and satellite sensors/systems. Table 2 briefs frequently used optical moderate to high spatial/high spectral resolution sensors/systems from sensors’ name and characteristics including band setting and platforms.
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Note: CA—coastal aerosol; RE—red edge; NIR—near infrared; SWIR—shortwave infrared; TIR—thermal infrared; Pan—pancromatic; MS—multispectral. |
2.2.1. Moderate Spatial Resolution Sensors
Typical moderate-resolution satellite MS sensors may include Landsat series, Satellite Pour l’Observation de la Terre High-Resolution Visible (SPOT) series, Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER), and more recently, Sentinel-2 (Table 2), which can be potentially used for forest inventories. Initial attempts with such sensors’ images for forest inventories might be limited to map coarse stand condition and stand density, such as SPOT HRV and Landsat TM/ETM+ data [6–9, 51]. Such satellite imagery could also be used to map forest habitat or ecosystems, such as ASTER, Landsat TM/ETM+, or Sentinel-2 [52–54]. However, such resolution imagery is difficult or absolutely not possible to accurately map individual TS. A few of studies reported the TS mapping results with the moderate-resolution data to indicate this point due to low spatial resolution (e.g., [11, 55]). For example, to map forest stand species (11 species) using Sentinel-2 imagery and environmental data in the Polish Carpathians, Grabska et al. [56] demonstrated the potential of Sentinel-2 image data with terrain information in mapping stand species over large mountainous areas with a high accuracy of 85%. Gillespie et al. [11] proved that using Landsat OLI imagery could map species richness per ha with an accuracy of 42% (based on extracted NDVI images). However, the contribution of the moderate-resolution imagery to mapping TS is made by coupling with other sensors’ data and/or other nonsensors’ data, which means that the moderate-resolution imagery can aid other sensors’ data to improve TS mapping accuracy, such as Landsat TM combined with HS imagery [10], Landsat OLI combined with aerial images [55], and Sentinel-2 MSI combined with VHR satellite images (GeoEye-1 and WV3) [57].
2.2.2. High Spatial Resolution Sensors
Since 2000, VHR commercial satellite sensors’ data have shown a potential for creating digital base maps [12] and single TS can be successfully identified and mapped from the VHR images (e.g., [34, 58–64]). Such VHR satellite sensors, listed in Table 2, may include GeoEye-1, Gaofen-2, IKONOS, Quickbird, Pléiades, RapidEye, and WorldView-2/3 (WV2/3).
Compared with using moderate-resolution satellite data to classify forest type and map tree species composition, the VHR satellite data have proven their potential to improve TS classification. For instance, using IKONOS imagery acquired over the Iwamizawa region in the center of Hokkaido, northern Japan, Katoh [58] mapped 14 tree species/groups and obtained an average accuracy (AA) of 52%. By using Quickbird data to map four leading tree species, Mora et al. [60] have obtained an overall accuracy (OA) of 73% of the TS classification. WV2/3 images have shown a greater potential for mapping TS than other VHR satellite sensors. Fang et al. [1] used multitemporal WV3 imagery to classify TS and obtained an OA of 61.3% for classifying 19 of the most abundant tree species and 73.7% for mapping ten of the most abundant genera. There are many studies to be done on using other VHR satellite sensors’ imagery to map TS with a high accuracy, such as using Pléiades [34, 65], GeoEye-1 [57, 66], RapidEye [5, 62], and Gaofen-2 [64, 67].
2.2.3. High (Hyper-) Spectral Resolution Sensors
During the last three decades, various hyperspectral remote sensing (HRS) sensors/systems, onboard aircraft and satellite have provided new remote sensing data for classifying TS with a focus on utilizing subtle spectral information. The most popularly used HRS sensors for TS classification are summarized in Table 2, which mainly include airborne sensors (AVIRIS, CASI, HYDICE, and HyMAP) and satellite sensors (Hyperion and CHRIS). Researchers have demonstrated the capability of the HRS sensors’ data used for identifying and mapping forest TS and species composition and have achieved a great success.
Compared to satellite HRS sensors’ data used for mapping TS, it is more useful and important to use various airborne HRS data for TS classification [10, 33]. Buddenbaum et al. [14] mapped coniferous TS with HyMap data using geostatistical methods and achieved a classification accuracy of . In mapping urban forest species, Xiao et al. [68] utilized AVIRIS image data to successfully discriminate between three forest types with an OA of 94% and an OA of 70% for identifying 16 TS with the data. Alonzo et al. [41] used the AVIRIS image data coupled with LiDAR data to map 29 common tree species in Santa Barbara, California, USA. They produced both species-level and leaf-type level maps with OAs of 83.4% and 93.5%, respectively. Liu et al. [42] also used combined CASI HS data and LiDAR data to map 15 common urban tree species in the City of Surrey, British Columbia, Canada. Their mapped results indicate OAs of 51.1%, 61.0%, and 70.0% using CASI, LiDAR, and the combined data, respectively. There are only a few studies that directly use satellite HS sensors’ data for mapping TS due to fewer satellite HS sensors in operation (e.g., [16, 69, 70]). By using Hyperion imagery for classifying tropical emergent trees in the Amazon Basin, Papeş et al. [71] concluded that when using 25 selected narrow bands and considering pixels that represented >40% of tree crowns only, the classification was 100% successful for the five taxa. Dyk et al. [72] tested multitemporal CHRIS image data for mapping forest species (three dominant species) and stand densities (five density classes). The mapping accuracy (OA) reached about 90%. Similar works using airborne HS sensors’ and satellite HS sensors’ data (Table 2) for TS classification have been done in [15, 17, 36, 73–82].
2.3. LiDAR Sensors
The most basic data measured by LiDAR sensors are the distance between sensors and targets. There are two kinds of LiDAR systems. If the system records the reflected energy at every distance, it is called full-waveform LiDAR. If the system only records the coordinates of the first and last energy peak, then it is a discrete-return LiDAR. Most commercial LiDAR systems are discrete-return systems. There are also recently developed two or three wavelength LiDAR systems [25]. In forest inventory and research, the LiDAR data are commonly used to generate forest structure parameters and analyze vertical structure properties. In addition, LiDAR sensors can also measure reflected energy from targeted surfaces and record features of the reflectance spectra such as amplitude, frequency, and phase [83].
Although LiDAR-derived height information alone may also be used to discriminate TS, most successful applications of LiDAR data for TS classification combine optical VHR image data, which have been demonstrated in many studies (e.g., [42, 47, 48]). Researchers have reported TS mapping studies through integrating the VHR satellite images with airborne LiDAR data to demonstrate the additional ability of LiDAR data in improving TS mapping accuracy. For example, to map 15 common urban tree species in the City of Surrey, British Columbia, Canada, in evaluating the potential of LiDAR and CASI data, Liu et al. [42] obtained OAs of 51.1%, 61.0%, and 70.0% using CASI, LiDAR, and the combined data, respectively, suggesting that if LiDAR is used alone, the TS mapping accuracy is limited, but if LiDAR is combined with other optical sensors’ data, the mapping accuracy might be significantly improved. By combining high spectral and spatial resolution optical data with LiDAR-derived data (tree height and standard deviation of tree height within tree crowns), Voss and Sugumaran [84] and Alonzo et al. [41] concluded that the accuracy of mapping urban TS was increased significantly (increasing 19% and 4.2%, respectively). The reason why the combination of VHR optical sensors’ data with LiDAR data improves TS identification is because of a synergy of VHR data offering sufficient spectral and spatial/textural information and LiDAR data providing vertical profile/structural information, which together should be helpful for TS classification.
2.4. Unmanned Aerial Vehicle- (UAV-) Based Sensors
Recently, unmanned aerial vehicle- (UAV-) based remote sensing systems represent a low-cost, flexible, and autonomous opportunity, and thus they may be an alternative platform to satellites and aircrafts for forest inventory and research [85–89]. Specifically, over satellite and airborne remote sensing data acquisition techniques, there are many advantages with the UAV-based techniques, including (1) the possibility to collect remote sensing data under undesirable imaging conditions, e.g., under cloud cover; (2) the cost-efficient data collection with the desired spatial, spectral, and temporal resolutions; and (3) the unrestricted operational area from which the UAV systems can take-off [90]. Usually, given a lower flight altitude than conventional aerial platforms, the UAV-based systems offer a finer spatial resolution platform [86]. UAV-based sensors/systems can not only provide two-dimensional (2D) image data at high spatial/spectral resolutions but also offer 3D data that are created from the overlapped UAV-based photogrammetric point clouds and digital surface model (DSM). For mapping TS from UAV-based data, different image features might be used to quantify characteristics of different TS [91].
The capability of VHR images (including 2D and 3D) that the UAV-based systems can offer provides an opportunity and potential for improving mapping individual TS. For example, in mapping ten urban tree species using UAV-based RGB optical images and deep learning methods, Zhang et al. [92] achieved an OA of 92.6%. Schiefer et al. [20] also used the UAV-based RGB imagers (<2 m resolution) to assess the potential of VHR RGB imagery and convolutional neural networks (CNNs) for mapping TS in temperate forests. Given that air-/space-borne remote sensing sensors currently cannot provide comparable spatial resolutions, these research results highlight the key role that UAV systems can play in accurately mapping forest TS. It has been demonstrated that UAV-LiDAR data and 3D UAV-based VHR images can be used to extract accurate tree height information at both single trees and forest stand levels (e.g., [93, 94]) and thus improve TS classification. Cao et al. [95] separated different mangrove species using a combination of UAV-based HS image and height data from UAV-derived DSM. They indicated that the tree height information extracted from DSM is effective for identifying mangrove species. In mapping 12 major tree species in a subtropical forest area in Southern Brazil, Sothe et al. [90] tested the potential of using a combination of UAV-based photogrammetric point cloud data with HS data and achieved an OA of 72.4% with an optimal feature combination as input. Similar studies with UAV-based VHR 2D and 3D images to identify or map TS were conducted by many other researchers, such as in [91, 96–100]. However, when considering the advantages of UAV-based systems over other based sensors/systems, there are some limitations for the UAV-based systems, such as limited payload, short flight endurance, and instability under windy conditions, which may restrict their application in some areas [101, 102].
3. Techniques and Methods of Mapping Tree Species
3.1. Reference Data Collection
Reference data, commonly called training and test/validation data, are necessary for reliable and accurate tree species (TS) classification and mapping projects. To select and collect effective reference data, certain criteria have to be followed to ensure that they can achieve objectives or solve questions or test hypotheses under investigation. Based on statistical requirements and on Fassnacht et al.’s review [21], there may be five criteria we need to follow: (1) Based on the TS classification unit (pixel based or object based) and variation within individual TS, the sample size of reference data has to meet requirements of minimum number per species and balanced number of samples across individual TS. (2) The selected samples have to be fully representative of their populations and spatial extent under investigation. (3) The distributions of the selected reference data should match the underlying assumptions of the applied methodology. (4) The observation errors of the reference data should be known and potential influence on the final results of TS classification should be discussed. (5) All samples in the reference data should not be spatially overlaid. According to the five basic criteria, there may be two approaches we can adopt to collect the reference data: filed approach and interpretation/delineation approach with high-resolution images.
3.1.1. Field Approach
By referring to the TS classification unit and a selected sampling method (random or systematic or typical method), samples (plots) are first deployed in the study area, then a set of tree parameters are measured and recorded by means of necessary instruments (e.g., GPS) and tools (e.g., altimeter) from each plot. If the samples are collected by basically following the five criteria above, the reference data selected and collected using the approach are “real ground truth” data and should provide a concrete accuracy assessment for the estimated parameters (e.g., TS classification). However, due to the time limitation, human energy, and study area accessibility, it is not impossible that only a small sample size can be guaranteed [22]. In most published studies on TS mapping with remote sensing image data, the referenced data, collected in the field, may include tree (species) position, tree height, crown size, and DBH [34, 48, 103–107]. Usually, with the field approach, the tree position is usually measured using a GPS with a relatively high spatial accuracy, at the center of the tree stem (e.g., [108, 109]) or directly marked on a high-resolution hard copy image (e.g., [19]). In addition, the recent terrestrial laser scanning and UAV-based remote sensing techniques may be used for collecting reference data, such as tree species and their 3D properties.
3.1.2. High-Resolution Digital/Imaging Interpretation Approach
If a high-resolution image (either digital or hard copy) is available and a person who is a visual interpreter is able to identify TS on the image and familiar to the study area, the reference data can be directly selected and delineated from the image by the imaging interpretation approach. The reference data collected with the approach may be called “pseudo-ground truth” data but can function as the real ground truth data. The reference data for tree position can be directly delineated based on either a VHR optical image [110–113] or a LiDAR-derived CHM image [114, 115].
Compared to the field approach, the image interpretation approach is relatively convenient to perform, and, usually, a large sample size for training and validation is guaranteed. However, the quality of reference data collected by using the approach is dependent on the quality of the high-resolution image (spatial resolution better than 1 m) and a personal experience to interpret individual TS in the study area. Thus, it is necessary and better to collect some field data for assessing the reliability and accuracy of the reference data delineated/interpreted from an image (optical or CHM). Therefore, in many studies, researchers adopted a so-called hybrid approach to collect a qualified reference data set, which first adopts the image interpretation approach to collect a set of reference data, then brings the delineated reference data to the field to check/verify using the field approach (e.g., [77, 109]). With the hybrid approach, some errors from the intrinsic georeferenced high-resolution images and personal ability of image interpretation can be avoided or alleviated to a certain level after field checking and verification.
3.2. Data Fusion
Data fusion in the remote sensing community is defined as a process dealing with a combination of single sensor’s data at different levels or multisensor’s images to form a new image to achieve refined/improved information for decision-making [18, 116]. For decision-making for TS classification, the data fusion is commonly performed at two processing levels: pixel and feature (image object (IO)) [117]. The literature review shows that a large number of examples of image fusion are at a pixel level. The image fusion at a feature level requires the generation of IOs first by using an image segmentation process, which can be realized in the different sensors’ images. Then, features corresponding to characteristics reflected from the different sensors’ images are extracted for each IO. According to the literature review for this paper, most popular data/image fusion methods for improving TS mapping may include the following three categories: (1) spatially sharpening single sensor at different levels or multisensor’s images, (2) fusion with different sensors’ images or multisource data, and (3) spatiotemporal data fusion methods. Table 3 summarizes the characteristics, advantages/limitations, and major factors of each category of methods. The first two categories of data fusion methods have been demonstrated to be effective in improving mapping TS by researchers, such as in [19, 112, 118, 119].
|
3.2.1. Spatial Sharpening with Single-Sensor or Multisensor Data
Commonly, there are two types of methods that are used for sharpening images with single-sensor imagery at different levels and multisensor’s images, respectively. With a pansharpening algorithm, single-sensor imagery at different levels can be spatially sharpened to create a high-resolution (such as panband resolution) sharpened image. This process is mostly done at a pixel level. Such a sharpened image has a nominal pan high resolution but its MS property may be slightly different from the original MS property. In segmenting images for creating optimal tree crown IOs, the use of the sharpened image can improve the quality of IOs that match individual tree crowns compared to directly using an MS low-resolution image to create the corresponding IOs [118]. With multisensor images (Landsat TM, ALOS AVNIR-2, WV2, and LiDAR), to map five levels of mangrove features including species communities, Kamal et al. [49] compared and contrasted the ability of these sensors’ images and concluded that the pansharpened WV2 and LiDAR images could be used to map detailed individual mangrove tree crowns and mangrove species communities. By using pansharpening dry and wet two seasonal WV3 images, Ferreira et al. [112] conducted a comprehensive assessment of the two seasonal images for eight tree species identification in tropical semideciduous forests. They concluded that the use of texture analysis, pansharpening, and individual tree crown (ITC) delineation is a potential approach to perform TS mapping in tropical forests with WV3 data. Korznikov et al. [66] utilized a pansharpened RGB image by GeoEye-1 at a spatial resolution of 0.46 m to accurately discriminate TS.
With two different optical sensors’ data (usually one with high spatial resolution and the other with MS low spatial resolution) and spatial-sharpening algorithm (e.g., PCS and GSS), a spatial-sharpening image may be created. To perform the process, low-resolution MS band imagery need to be resampled to a higher resolution to make the two sensors’ images have the same size first, then the same pansharpening method above is performed to create a spatial-sharpened image. For example, when assessing the MS spectral property of a spatial-sharpening image created with different sharpening algorithms (Hue-Intensity-Saturation, PCS, and High-Pass Filter), Chavez et al. [120] fused Landsat TM MS bands with SPOT Pan band to create a 10 m resolution sharpened image. Although no studies directly using the spatial-sharpening method to improve TS mapping are found from existing literature, given the potential of improved spatial resolution and retained MS spectral property, the sharpening technique should be useful to improving TS mapping in practice.
3.2.2. Fusion with Different Sensors or Multisource Data
In general, there are three types of methods that may be used for data fusion with different optical sensors’ images, optical and LiDAR sensors’ images, and optical and/or LiDAR sensors’ and ancillary data, respectively. In improving TS mapping practices, different resolutions (mostly spatial but also spectral) of optical sensors’ images are often combined to improve TS classification results that are often much better than those created with their individual sensor’s data. For example, Hauglin and Ørka [55] tested the ability to identify two tree species in the same genera by using Landsat-8 OLI images, aerial images, and LiDAR data. Their tested results indicate that the OA accuracy varied from 0.53 to 0.79, with the highest accuracy created using a logistic regression model with a combined data derived from Landsat OLI imagery and aerial photos. In mapping forest species composition and tree plantations in Northeastern Costa Rica, Fagan et al. [10] demonstrated the potential of the combination of hyperspectral (HS) HyMap with multitemporal Landsat TM imagery to accurately classify (1) forest types and (2) tree plantations by species composition. Their results indicate that the combination of occasionally acquired HS data with widely available multitemporal Landsat imagery enhanced mapping and monitoring of reforestations in tropical landscapes.
In this literature review on TS classification with remote sensing images, a lot of studies on optical sensors’ images combined with LiDAR data to improve the accuracy of TS classification are observed. Usually, in this case, the optical sensor’s data can offer sufficient spectral and spatial/textural information while LiDAR data can provide vertical profile/structural information, a combination of which should be beneficial to improving TS classification. With the point cloud data, it is widely used to produce digital surface models (DSM) and digital terrain models (DTM) with high accuracy, and then, to create absolute height data (e.g., a canopy height model (CHM)) for segmentations (e.g., individual ITCs) and classifications (e.g., for TS) by subtracting DTM from DSM. In practice, such CHM data, coupled with other optical sensors’ data derived spectral/spectral features, are very helpful to improve TS mapping. For instance, to map 29 common urban tree species in Santa Barbara, California, USA, Alonzo et al. [41] fused high spatial resolution (3.7 m) HS AVIRIS imagery with LiDAR data at the ITC object level. The additional information of LiDAR data led to an increase in TS classification accuracy of 4.2% over spectral data alone. When Zhang et al. investigated the effectiveness of TS classification of urban forests by integrating airborne-based HyMap HS imagery and LiDAR data, their results proved that individual TS discrimination in urban forests can be achieved with the combination of object-based LiDAR segmentation of tree crowns and HS spectral signatures. There are more studies found in the literature, including [61, 82, 119, 126].
With the aid of ancillary data, such as DEM-derived topographic information, the accuracy of TS classification using an optical sensor’s and/or a LiDAR sensor’s data can be improved. This may be due to a synergy of sensors’ data, which provides with spectral and spatial/textural information and/or vertical profile/structural information, and ancillary data offering information (maybe related to TS geographic distribution), which together should be beneficial to TS mapping. For example, Lim et al. [57] developed a model by using multiple optical sensors (Sentinel-2, GeoEye-1, and WV2/3) and GIS data (topographic information) to map the five dominant tree species in North Korea. The results show high TS classification accuracies of 91% (in the model calibration area) and 90% (in test area), respectively, suggesting the model’s potential applicability throughout the Korean Peninsula and a broader region. To map 11 forest stand species with machine learning algorithms and integrating multitemporal Sentinel-2 products and DEM data at a regional scale, Grabska et al. [56] extracted spectral features from the Sentinel-2 products and four topographic variables (elevation, slope, aspect, and distance to water bodies) from the DEM data. Their results demonstrate the potential of Sentinel-2 imagery and topographic data applied in mapping forest tree species in a large mountainous area with high accuracy (). Ke and Quackenbush [59] also proved that ancillary topographic data were much helpful in improving forest TS mapping and tree crown delineation using Quickbird imagery.
3.2.3. Spatiotemporal Data Fusion Methods
It is ideal for mapping and monitoring surface biophysical parameters (e.g., evapotranspiration, NDVI, vegetation, and crops) if we have both high spatial and temporal resolution remote sensing data. However, a single satellite sensor cannot provide the ideal data due to the trade-off between spatial and temporal resolutions. During the last two decades, several spatiotemporal data fusion (STDF) methods have been developed and used to create high spatiotemporal resolution remote sensing data, which potentially address the challenge. Usually, the STDF methods can be efficiently used to fuse relatively high temporal but low spatial resolution data (e.g., MODIS and AVHRR) with relatively low temporal but high spatial resolution data (e.g., Landsat and Sentinel) to obtain a new data set at both high spatial and temporal (continuous) resolutions. There are two general categories of STDF methods: (1) methods based on the spatial and temporal adaptive reflectance fusion models (STARFM) and (2) methods based on unmixing theory [127]. The first category assumes that the ratio of coarse pixel value (radiance or reflectance) to neighboring similar pixels does not change over time, while the second one assumes that the value of each coarse spatial-resolution pixel is a linear combination of the responses of all endmembers within the coarse pixel. The STARFM [121] is one of the most widely used STDF models, which fuses the MODIS daily surface reflectance data and the 16-day Landsat surface reflectance data to generate a synthetic daily surface reflectance Landsat-like data. Since the STARFM might not be very sensitive to heterogeneous landscapes, many improved modes were developed, such as ESTARFM [122] and FSDAF [123]. The ESTARFM can improve the data fusion accuracy in heterogeneous landscapes, while FSDAF is suitable for heterogeneous landscapes and can maintain spatial details within a scene of image [128]. The unmixing-based STDF methods may include ISTBDF (improved spatiotemporal Bayesian data fusion) [125] and STDAF (spatial temporal data fusion approach) [124]. The second category of methods can obtain an accurate prediction of surface reflectance by grouping similar pixels and calculating the average reflectance.
Based on the literature review on applications of the STDF methods, it was found that most studies were not directly for improving TS classification but rather for mapping and monitoring of other surface biophysical parameters with the synthetic data by mostly fusing MODIS-Landsat data to create a high temporal resolution Landsat-like data (30 m) series. However, given the potential of the STDF methods to create both high-resolution series data able to characterize a tree ITC size (spatial scale) and phenology (temporal dynamic), the STDF methods should be used to further improve TS identification and mapping if the synthetic data series is available at a spatial resolution better than 5 m.
3.3. Feature Types and Selection
3.3.1. Characteristics and Types of Features
In classifying and mapping TS with various remote sensing sensors’ data, a set of input features or variables (also called explanatory, independent, predictor variables) for calibrating/fitting a variety of models need first to be determined and extracted from sensors’ data. Generally, there are five types of features that can be determined and extracted from different optical and LiDAR sensors’ data for developing various models to classify and map TS (Table 4). They include (1) spectral bands, (2) spectral/vegetation indices, (3) transformed components or vectors, (4) spatial/textural features, and (5) LiDAR-based vertical/geometric and intensity features. The characteristics, sources, and typical references of the five feature types are summarized in Table 4. Spectral bands in digital number or reflectance can be directly selected from different optical sensors’ images and used in different TS classification models. There are a lot of studies on TS classification and mapping that directly use original spectral band features, such as selecting original band spectra from multispectral (MS) sensors’ data by [13, 129, 130] and from hyperspectral (HS) sensors’ images by [42, 95].
|
The second type of feature is spectral vegetation indices, which can be constructed using two or more spectral bands through an arithmetic operation of a ratio or a normalized difference ratio, or other forms. Based on application purposes, advantages of these VIs may include easy to use and normalizing background effects on target (e.g., tree canopy) spectra, e.g., reducing atmosphere and soil background effect on tree canopy spectra [26], and hence the VIs usually function much better than their individual spectral bands in remote sensing applications. VIs may be divided into two groups: one constructed with MS sensors’ data and the other group with HS sensors’ images, and both groups of VIs have been selected and used in most of the studies on mapping TS. For example, Liu et al. [42] demonstrated that the anthocyanin content index and photochemical reflectance index were the most important HS features for the identification of TS in the spring season when they mapped urban tree species by integrated airborne HS image and LiDAR data. Xu et al. [131] reported that the integration of time-series GF-1 NDVI images, vegetation growth status, and feature of canopy information simultaneously will be beneficial to mapping TS at a landscape scale.
When the high dimensional source (e.g., HS sensors) data are used for TS classification, the transformed components or vector features are usually adopted. Such transformed features often have characteristics of low dimensionality and less or no redundancy or collinearity among selected features. In mapping TS with different remote sensing sensors’ images, the commonly used transformation algorithms consist of PCA, MNF, CDA, and Wavelet transforms. For example, in discriminating between ten major urban tree types with HS sensor AISA imagery, Jensen et al. [133] used features (PCs, VIs, and band means) that were extracted or transformed from the AISA imagery, and achieved an OA of 82% when only PCs were used. Leutner et al. [134] also calculated PC images from Hyperion HS imagery and used the type of features for mapping forest diversity and floristic composition with LiDAR-derived features. Zhang et al. [77] studied the potential of TS classification of urban forests using the HyMap HS image and LiDAR data. They conducted an MNF transformation to HyMap data to allow reducing the data to 20 significant MNF components out of 118 original bands to increase the effectiveness of the TS classification. Alonzo et al. [15, 41] produced canonical variables transformed from AVIRIS spectral bands and LiDAR-derived structural metrics with the CDA transform method for identifying and mapping Santa Barbara’s urban tree species and proved the effectiveness of the canonical variables in mapping TS. Zhang et al. [76] calculated Wavelet energy vectors from HYDICE HS imagery to examine crown-level spectral variation within and between tropical tree species at La Selva, Costa Rica.
Texture features are based on first- and second-order gray-level statistics. The definitions of textural features are slightly different between pixel-based and IO-based classifications. A spatial feature extracted from optical sensors’ images may be described as a shape or geometric form of an IO, so a spatial/geometric feature is extracted for the IO-based analysis only. Since most optical sensors’ (MS or HS) images used for mapping TS or species composition have a high spatial resolution, the first- and second-order gray-level textures are available for extraction and used for both pixel-based and IO-based classification of TS. High-resolution optical sensors’ images can record textural/contextual information related to the characteristics of a leaf (e.g., shape, size, and arrangement), branch (e.g., orientation), crown (e.g., shape, size, coverage), and canopy (e.g., pattern) of individual TS, so most of studies on identifying and mapping TS with high-resolution sensors’ data select and use various textural/spatial features in either pixel-based or IO-based TS mapping projects (e.g., [13, 38, 95, 139]).
LiDAR-based features consist of vertical/geometric and intensity’s metrics. Given different characteristics of vertical/geometric structures and reflected spectral properties of individual TS, the features related to tree height and tree crown shape and to intensity from target surfaces (ground and tree crown/canopy), extracted from LiDAR data, should be helpful to mapping TS. The detailed list of LiDAR-based features (vertical/geometric and intensity) and their characteristics were presented and well described in [25], and the LiDAR-based features have been extensively used in mapping TS studies. Identifying and mapping TS with LiDAR-derived features and other types of features extracted from optical sensors’ data in urban environments have been well reviewed in [24, 83]. In other environments, there are a lot of studies on TS classification with the LiDAR- and other optical sensor-derived features in the literature, such as in an island [95], in a subtropical forest area [90], and in a forest farm [139].
3.3.2. Selection of Features
Reasons or purposes of the feature selection may include lowering feature dimensionality, removing or reducing data redundancy and collinearity, and increasing efficiency of TS classification and mapping. The result of the feature selection is a subset of features selected from all features. Currently, the most popular feature selection methods may be divided into three types: (1) decision tree (i.e., classification and regression tree (CART)) or random forest (RF), (2) correlation-based feature selection (CFS), and (3) stepwise variable selection. With the ranked features with their importance values calculated by CART/RF algorithms, a subset of features is selected from all input features with a threshold. For example, Xie et al. [38] used the RF classifier calculated importance values of input features/variables to select a subset of importance features to efficiently map TS. As a traditional filter feature selection approach, CFS first calculates the feature-class (TS) and feature-feature correlation matrices using training samples, and then search for a feature subset using the best first search algorithm based on the redundancy between features [140]. To reduce the redundant bands of HS images to improve classifying mangrove species, Cao et al. [95] utilized the CFS method coupled with CART to select features. The CART could be used to identify spectral bands based on their importance values discriminating between species, while the CFS method was used to further select the most effective features for their study. Based on the principle of automated forward and backward stepwise feature selection, a stepwise discriminant analysis (SDA) method can be applied for selecting features for TS classification. The SDA algorithm, in general, minimizes the within-class (TS) variance while maximizing the between-class variance for a given significance level. Many researchers adopted the SDA method to select a subset of features from all input features to improve the efficiency of TS mapping, such as in [34, 118, 129, 141]. Besides the selection methods discussed above, there are a certain number of traditional statistical test techniques used to test distance/separability between two classes (TS) that are also often used to select a subset of features, such as the Mann–Whitney -test, the Jefferies–Matusita distance, and the Bhattacharya distance [142].
3.4. Tree Species Classification Methods and Algorithms
3.4.1. Pixel-/Object-Based Classifications
The pixel is a basic unit of various remote sensing imagery, and thus traditional classification methods use individual pixels as a classification unit, called pixel-based classification. The pixel-based classification analyzes the spectral signature over the pixel area. However, with the increase of spatial resolution of modern remote sensing sensors, the size of a pixel has gradually become smaller than that of an object [18]. However, mapping TS by using the VHR imagery may pose a new challenge because the spectral response from a single tree crown (ITC) is affected by variation within the ITC illumination and background effects, and thus the accuracy is reduced by using traditional per pixel classifications [143]. To overcome this problem, a region-based or object-based classification was developed. The object-based image analysis (OBIA) technique first uses image segmentation to generate discrete regions or image objects (IOs) that are relatively homogeneous within themselves than with nearby regions (e.g., an ITC), and then these IOs rather than pixels are used as a classification unit [144, 145]. An IO-based classification method can potentially improve classification accuracy compared to a pixel-based method, which may be explained by the following four reasons [118, 138, 146]: (1) Partitioning an image into IOs is similar to a procedure where humans conceptually organize a landscape to comprehend it. (2) Besides spectral features available in a pixel-based method, texture and contextual features and shape/geometric features associated with IOs can be utilized. (3) Objects of interest to be extracted can be related to different extraction levels (i.e., different scales), and these levels may be represented in an analysis system, such as a multilevel system method that will be evaluated in Section 4. (4) Environmental variables, such as the terrain features of elevation, slope, and aspect, may also be used. It is worth noting that the OBIA method is mostly suitable for VHR data, such as IKONOS and WV2 but not for moderate or coarse resolution sensors’ data.
Existing studies on mapping TS composition have demonstrated the advantages of OBIA methods (e.g., [59, 74, 84, 118, 147–152]). For example, both studies of Kim et al. [150] and Immitzer et al. [149] obtained a 13% higher OA with OBIA by using an optimal segmentation of VHR image data (IKONOS and WV2) to identify (7 and 10) TS/stands compared to the pixel-based method. Shojanoori et al. [152] also utilized WV2 imagery and the OBIA classification method to map three urban TS. They concluded that the IO-based classification results were much better than those created with the pixel-based classification and improved OA accuracy could be up to 16.54%.
3.4.2. Spectral Mixture Analyses
Compared with an ITC size, many optical remote sensing sensors’ images have a relatively low spatial resolution, such as Landsat series and SPOT series MS images. Based on this case, several ITCs may be mixed in a single pixel. Therefore, to effectively map TS and estimate species abundance from those moderate-resolution sensors’ images, it is necessary to conduct a spectral mixture analysis to estimate individual TS abundance within the mixed pixels. To map TS abundance with the relatively low-resolution images, a linear spectral mixture model (LSM) is adopted. In LSM, the spectral signature of a mixed pixel is assumed to be a linear combination of spectral signatures of surface materials with their corresponding areal proportions as weighting factors [153]. Currently, since the LSM method is easy to use, it has been widely and successfully applied for mapping abundance of individual TS with optical sensors’ images. For instance, Liu and Wu [154] calculated pixel-weighted representative tree crown spectra using the LSM model with HS imagery and proved that the pixel-weighting approach is effective to automatically classify four TS at crown level. However, the LSM model has three limitations: (1) The number of endmembers is the same for each pixel in an image. (2) LSM cannot efficiently account for subtle spectral differences among endmembers. (3) The maximum number of endmembers is limited by the number of bands. Therefore, Roberts et al. [155] developed a multiple endmember spectral mixture analysis (MESMA), which overcomes the limitations of the simple LSM. Using the MESMA, the number of endmembers is not limited by the number of bands and is allowed to vary for each pixel in the image. The characteristics and advantages/limitations of the LSM and MESMA algorithms are summarized in Table 5. The MESMA model has been used in a variety of environments for vegetation mapping including TS mapping. For example, Roberts et al. [155, 156] used the MESMA with AVIRIS HS imagery to classify vegetation species and land cover types in southern California chaparral, USA.
|
3.4.3. Traditional Classifiers/Methods
In early studies on remote sensing-based TS discrimination, the most commonly used traditional classification methods/techniques included parametric classifiers (maximum likelihood classifier (MLC), linear discriminant analysis (LDA), and logistic regression (LR)) and nonparametric classifiers (spectral angle mapper (SAM) and -nearest neighbor (-NN)) (e.g., [30, 73, 74, 79, 157]). These methods were relatively easy to use and corresponding tools/software were available and accessible in commonly used image processing software packages. During the last decade, although these traditional methods/techniques could also be directly used to classify TS with selected features (e.g., [41, 118]), they were mostly used as standard or reference methods in TS classification to indicate the advance and innovation of newly developed methods and algorithms. For example, the performance of the traditional classifiers of MLC, LR, and -NN was compared to those of advanced classifiers random forest (RF) and support vector machine (SVM) [38, 55, 95, 96, 149, 151]. Table 5 summarizes the most frequently applied classification methods and algorithms including the traditional and advanced ones and some of their characteristics, advantages/limitations, and major factors discussed in reviewed studies.
3.4.4. Advanced Classifiers/Models
After 2010, while traditional MS classifiers (e.g., MLC, LDA, and -NN) were still used in mapping tree species with features extracted from optical sensors and LiDAR data, more advanced algorithms/methods have been developed and received more attention due to their improving TS classification and mapping. The representative advanced methods/techniques may consist of two categories: machine learning (ML) methods and convolutional neural network-based methods (i.e., deep learning methods) (Table 5). The ML models may include RF, SVM, and artificial neural network (ANN), which are all nonparametric classifiers and can take multiple input variables/features (e.g., spectral, textural, spatial/geometric, VI, and other ancillary variables) [17, 34, 38, 160]. The convolutional neural network- (CNN-) based methods include different architectures/models of CNNs, such as AlexNet, VGG-16, ResNet-50 [3, 92], and 3D-CNN [107, 139]. More recently, the CNN models have been widely used in image classification tasks including TS classification (e.g., [3, 119, 161]). Usually, the advanced methods can result in higher accuracy of image classification compared to other classification methods. This trend is associated with modern computational capacities in hardware and free tools/software available in open-source environments, such as R and Python.
4. “Multiple” Method Development in Tree Species Mapping
During the last decade, a trend of “multiple” method development in tree species (TS) mapping and identification with different remote sensing sensors’ images was observed. The “multiple” in “multiple” methods here means multisensor, multitemporal (season), and multilevel classification system methods. Such “multiple” methods for mapping TS, compared to “single” methods, frequently produce a higher accuracy of classifying and mapping TS. Table 6 summarizes the characteristics, advantages and limitations, major control factor(s), and sample studies of the three categories of “multiple” methods.
|
4.1. Multisensor Methods
The multisensor method can be described as the use of multiple sensors’ image data by efficiently integrating different spatial, spectral, band setting, textural, and geometric information, offered by different optical sensors and LiDAR. Based on the literature review, the method can offer a new potential in improving TS classification and mapping compared to using a single sensor’s data. However, the method often requires a complex image processing chain (e.g., data fusion algorithms) and a high cost for using some sensor(s) data (e.g., VHR satellite images and LiDAR data). This trend is attributed to many sensor data sources that are for free or a low cost to acce and a significant improvement of computing power in data fusing, processing, and modeling from various sources [24]. The multisensor method may be further divided into two types: (1) multiple optical sensor method and (2) optical sensor(s) and LiDAR data combination method. The multiple optical sensor method is related to the integrated use of different sensors’ images (satellite-, aircraft-, and UAV-based MS and HS sensors) at different spatial, spectral, and temporal resolutions, while the optical sensor(s) and LiDAR combined method is associated with different optical sensor(s) combined with the LiDAR sensor. For example, Fagan et al. [10] examined the potential of a combination of HS HyMap and multitemporal Landsat TM imagery to accurately identify (1) general forest types and (2) tree plantations by species composition. Their experimental results indicate that HS and multitemporal data could be effectively integrated to discriminate tree plantations from secondary forests and mature forests with an OA of 88.5%. By integrating different spatial resolution sensors’ data (Sentinel-2, GeoEye-1, and WV3), Lim et al. [57] developed a model to map the five dominant TS in North Korea using machine-learning classifiers. The integrated model used for classifying forest types in Goseong-gun (South Korea) was relatively accurate (80%), and thus, the model might be utilized to produce a map of dominant TS in Goseong-gun (North Korea).
The majority of studies with the multisensor methods belong to the 2nd type: optical sensor(s) coupled with LiDAR data. Due to strengths in providing spectral/textural details and 3D geometric features, moderate to high-resolution satellite/airborne (including UAV-based) multi/hyperspectral imagery and airborne LiDAR data are suited for the estimation and mapping of forest structure, species, and species composition. The integration of optical sensors’ images and LiDAR data allows us to classify TS more accurately in a complex environment. For instance, by fusing HS sensor AVIRIS imagery with high point density LiDAR data, Alonzo et al. [41] could clearly identify the 29 common urban tree species at crown level. With the AVIRIS imagery, the additional LiDAR data could help increase the OA of 4.2%, especially for small crowned species up to 10%. In a study on testing how VHR Geoeye-1 MS imagery and LiDAR point clouds allow for improving classification of five common urban TS, Roffey and Wang [162] obtained an OA of 85.08% when features extracted from both data sources were combined, compared to 77.73% and 71.85% when using LiDAR features and GeoEye-1 features, respectively. Dian et al. [164] also demonstrated that a combination of HS AISA imagery with LiDAR data to identify TS led to a higher accuracy when compared to using features extracted from AISA imager only.
4.2. Multitemporal Methods
The review on phonologic and seasonal characteristics of tree plants in Section 2.1.1 indicates that it is possible to measure the phonologic characteristics of TS with multitemporal remote sensing techniques. Given the fact that the phonologic characteristics might be different among different TS, it is a good idea to use the multitemporal method with multitemporal remote sensing data to increase the accuracy of mapping TS. This is because tree species reflect phenology phenomena, and their phenology changes, which vary across different species [165], and the multitemporal remote sensing image data needed by the multitemporal method are just to align the time of image acquisition with the phenological period of the TS under investigation. Many reviewed studies have demonstrated that using the multitemporal method with multiseasonal remote sensing image data in improving mapping TS and species composition is significant (e.g., [13, 34, 40, 118, 151, 160]). Previous studies using the multitemporal method to explore the potential of multiseason VHR satellite sensors were mostly limited to using only two-season data. For example, Li et al. [13] investigated the potential of two-season WV2 (Sept. 14, 2012) and WV3 (Oct. 18, 2014) for mapping five dominant urban TS in Beijing, China. They concluded that the combination of the two-season VHR images could create a better mapping result than that with images from either dates. When Karlson et al. [160] investigated the capability of two-season WV2 imagery in classifying five dominant TS in West Africa, their results demonstrate that the integration of two-season images produced a better result than a single date image, with an OA of 83.4%. They also found that dry season imagery resulted in a better result () than the wet season imagery (). Madonsela et al. [40] also proved that using the combined two-season images could improve TS classification, compared to using individual date images.
There are a few studies using the multitemporal method with more than two seasons (dates) image data in mapping TS. The kind of studies mostly focused on either selecting an optimal seasonal image or exploring the synergic power of combinations of two or three or all seasonal images under investigation in TS classification. For instance, Yang et al. [163] investigated the capabilities of using four seasonal WV3 images individually and in combinations in classifying individual TS, and their result indicates that using the mid summer image led to the highest OA of the individual TS classification. The synergistic use of the above three seasonal images substantially improved the classification accuracy. To understand the seasonal effect on TS classification accuracy, Pu et al. [34] also compared and analyzed the capabilities of multiseason Pléiades image data. They concluded that (1) a late spring season (April) image significantly increased TS classification accuracies compared to all other individual season Pléiades images (), and (2) combined dry-wet season images performed even better. It is worth noting that, under some certain circumstances, using two-season image combination for mapping TS may not always be better than using single data images, or using a combination with more seasonal images is not always more helpful than using a combination with less seasonal images. For example, when Ferreira et al. [112] assessed if the combination of images acquired from wet and dry seasons increases the classification accuracy of the TS; they found that the average producer’s accuracy obtained by combined images was not higher than that using both seasonal images individually. When Pu et al. [34] tested the discriminant powers of combinations with two, three, four, and five seasonal images for mapping TS, they found that the combinations with more than two seasonal images did not produce a better TS mapping result than that created with a combination with two seasonal images (dry-wet season images). This may be because the useful phenology information extracted from the more than two seasonal images for mapping TS might be offset by the extra data, and contradictory characteristics of phenology induced biophysical and biochemical parameter’ changes among multiple seasons [34].
4.3. Multilevel Classification System Methods
Multilevel classification system [34, 166] is a hierarchical spatial organization to organize objects (surface cover types) in a landscape or image scene from a larger landscape/surface cover type unit into smaller objects or component units (e.g., ITCs) at a higher classification level. The system method is also called stepwise masking system [68, 167] or hierarchy classification system [49, 168]. There are several advantages for the method: a logical sequential mapping process, a clear multiscale context of the targeted objects and their relationships, and a control over the process within a certain level and object container [49]. The use of the system method has demonstrated their potential of increasing the effectiveness of mapping TS (e.g., [49, 68]). For example, in mapping 22 urban TS with HS AVIRIS imagery, Xiao et al. [68] designed a set of five masking levels to classify the urban TS. The five masking levels consisted of masking 1 (separating the study area into vegetated and nonvegetated areas), masking 2 (separating shrub, tree, and grass from the vegetated area), masking 3 (separating broadleaf and conifer from the tree area), masking 4 (separating evergreen and deciduous from the broadleaf area), and masking 5 (identifying TS from conifer, evergreen, and deciduous areas, separately). At the TS level, an average accuracy of 70% for classifying the 22 TS was obtained. Kamal et al. [49] utilized the object-based multilevel (scale) mangrove mapping approach successfully to map mangrove attributes including species communities. This effectiveness of the system method in mapping TS may be explained as follows: (1) The system matches the hierarchical structure of most surface cover classification strategies. (2) It enhances the relative spectral differentiation among those surface cover classes (e.g., TS) with similar spectral and textural characteristics. To efficiently use the system method, how to determine appropriate thresholds for corresponding levels is a challenge because a trial-and-error or a quantitative approach is needed [118].
5. Limitations and Future Directions
5.1. Current Limitations and Constraints
There are many factors that control and affect the success and accuracy of TS classification. The factors may include spatial/spectral resolutions, temporal resolution or seasonal effect, forest environmental setting/background, shadow and shaded effect, an appropriate image segmentation, spectral variation in IOs (tree crowns), and different TS overlapping effects [159]. The literature review indicates that current methods/techniques used for accurately classifying and mapping TS under different environmental settings and backgrounds have some limitations and/or constraints as one or more of the factors cannot meet its/their ideal requirement(s) (e.g., an image at a better than 1 m resolution and acquired in an appropriate season).
As discussed in Section 3.4.1, usually object-based approaches can improve TS classification with VHR image data compared to pixel-based approaches [74, 150, 152]. However, there are many issues related to object-based approaches that need to be addressed for decision-making for TS mapping: (a) How do we ensure an appreciate image segmentation? (b) How do you deal with a multicrown (overlap) species image object (IO)? (c) How do you map subcanopy TS (i.e., young or small trees below the main canopy)? Per (a), to create an appropriate image segmentation for mapping TS, how to accurately select the scale parameter and the subset of input image bands (optical sensor images and/or LiDAR data) is important. A stepwise approximation method may be adopted to determine the optimal scale value and subset of image bands based on reference ITCs (IOs) [118]). Per (b), a super resolution mapping approach may be considered to determine the spatial distribution of multicrown/species within an IO [18]. For (c), full-waveform LIDAR data may be used to aid in identifying and mapping subcanopy TS [25].
When many studies on TS classification with a single-sensor image (either optical or LiDAR sensor’ data) discussed their limitations or constraints, they often mentioned the factors: spatial, spectral, and/or temporal resolutions, which is/are not high enough. For example, when Alonzo et al. [15] discriminated among 15 urban TS using a single HS AVIRIS imagery acquired over Santa Barbara, CA, USA, they excluded palm tree species because their crown size is smaller than an image pixel size (3.7 m). In assessing individual species classification accuracies, they found that the highest accuracies were for those species with large and densely foliaged crowns, while the lowest accuracies had the smallest crown areas, suggesting the 3.7 m spatial resolution (even though this is a high spectral resolution) is not enough for those species with small crown size. Pu and Landry [118] found that it is difficult or not possible to accurately classify three oak TS with the current WV2 spectral resolution. To overcome the limitations (relatively low spatial and spectral resolutions from a single-sensor image) for accurately identifying some TS with a small crown size and similar spectral property among them, future work may consider using more sensors’ data, such as adding VHR MS imagery and/or LiDAR data for Alonzo et al.’s [15] project and HS sensor’s data for the work in [118].
One of the most common research objectives for many studies on TS classification was exploring and assessing the potential of a new sensor’s data or newly developed method/algorithm in a single and relatively small test site (area). Any assessment results and findings derived from such a single and small test site may be unreliable and biased. With regard to this, the following reasons are probably easily understood: (1) The single and small test area cannot fully reflect and account for the large variation of ecological conditions and environmental settings that assessed new sensor data or a tested method/algorithm need(s) to account for. (2) The collected reference data from such a single small test site might have been biased (e.g., leading to a narrow spectral variation within individual TS) towards some favorable conditions. Consequently, the assessed results or tested method calibrated and validated with the biased reference data probably have been biased. To optimize the newly developed method/algorithm or accurately assess a new sensor data, future studies should consider more than one test site or choose a large test area, in both of which a full variation of ecological conditions and environmental settings can be ensured. In addition, if limited by certain conditions, e.g., having to make do with a small test site which is the only one available, the use of comparable datasets already existing in the literature is suggested to cross check the reliability and accuracy of the assessed results and tested method/algorithm with the data collected from the small test site.
When discussing the advantages of using the multitemporal method for mapping TS with multiseasonal images, most studies on using multiseasonal images just chose one optimal seasonal image or a combination of a subset of seasonal images under investigation, not fully utilizing all individual season/date images. For example, Yang et al. [163] chose an optimal seasonal image and a combination of three seasonal images selected from all four seasonal images to classify individual TS. Ferreira et al. [112] found that a combined use of wet and dry seasonal images did not improve the classification accuracy of the species compared to using both seasonal images separately. With regard to this, to fully and efficiently use phonologic change information provided by all individual season/date images under investigation, a seasonal trajectory difference index (STDI), recommended by [19]), may be adopted. The index integrates all seasonal images’ contribution and potentially, as an additional input feature, is helpful for further improving TS identification and mapping. More potential indices or measures by integrating full phenological change information available from all seasonal images may be considered and developed in a future work.
5.2. Discussion on Future Directions
Although in recent years the advance of remote sensing in improving both spatial and spectral resolution has been achieved, given relatively small crown sizes of some TS (e.g., palm tree) and similar spectral properties among some TS (e.g., evergreen oak species), the spatial and spectral resolutions of current sensors’ images may not be high enough to discriminate among those species. Therefore, further advancing remote sensing sensors in improving spatial/spectral resolutions for accurately mapping TS is necessary. In addition, to improve TS classification and mapping with existing optical and LiDAR sensors’ data, we can make efforts on improving and enhancing the three “multiple” methods (i.e., multisensor, multitemporal, and multilevel classification system) discussed in Section 4 and data fusion techniques/methods for integrating multisensor data in Section 3.
Given the explicit advantages of the three “multiple” methods summarized in Table 6, these methods are truly beneficial to improving TS classification with various sensors’ data. Future work may focus on overcoming the limitations and on processing the control factors summarized in the table by improving process chains and relevant algorithms. For example, per the multisensor methods, logically and efficiently improving process chains for automatically processing multisensor (optical sensors and optical sensor and LiDAR) data to increase the effectiveness of mapping TS is an interesting direction. It may emphasize on developing relevant automatic processing algorithms or tools to process resampling and registration between the multisensor data, more important on radiometric pixel value normalization between different sensors’ data due to the difference of image acquisition times. Per the multitemporal methods, to efficiently utilize the phonologic information difference among different TS from multiseasonal images for improving TS classification, accurately normalizing background contributions (e.g., soil and atmosphere) to tree canopy spectra for multiseasonal images is a key step of a processing chain for the method. With regard to this, how to fully utilize phenological information from all of the seasonal data under investigation is a future direction, especially in mapping urban TS with the method (e.g., developing some indices by integrating all seasonal data). For speeding processing chains for the multilevel classification system, how to define and determine thresholds at different process levels is a key for successful application of the method. A qualified reference data set for defining and quantitatively determining the thresholds and some statistical tools are required for this issue.
To efficiently use the “multiple” methods for mapping TS with various sensors’ data, the key step of processing chains is of data fusion with different sensors or different seasonal data. There are several mature techniques/algorithms that can be used to fuse the same sensor’s data (e.g., a pansharpening technique for fusing the eight MS bands and one Pan band of WV2 imagery), different sensors’ data (e.g., six MS TM bands with one SPOT Pan band), and spatiotemporal data fusion (STDF) methods (e.g., the STARFM model fusing of Landsat data with MODIS data). However, the current data fusion methods with different sensors’ image data are just a simple addition (by combination or integration) of the different sensors’ data, rather than really fused together as a resultant image by a pansharpening process. Per the STDF methods, currently, the data fusion methods can create moderate spatial resolution (e.g., Landsat-like) data series, which cannot be directly used for improving TS classification. Therefore, how to develop new techniques or algorithms including STDF to fuse different sensors’ images (e.g., MS TM bands fused with WV2 MS bands and WV2 MS bands with LiDAR CHM data) should be considered as a future direction.
More research on using various HS sensors’ data to increase mapping TS accuracy, especially discriminating among those species with similar crown spectral property, will be an important direction. Besides commonly used airborne HS sensors (e.g., AVIRIS and CASI), some satellite HS sensors/systems (e.g., the HyspIRI system operation scheduled in 2023) at high spectral resolution and high temporal resolution but low spatial resolution and flexible UAV-based HRS systems at very high spectral/spatial resolutions have a potential of mapping TS or estimating TS abundance more correctly and accurately. To efficiently use the richer and delicate spectral information of the satellite HS data for mapping TS, spectral mixture analysis (SMA) or multiendmember SMA to automatically estimate individual TS abundance within pixels remains to be an important information extraction task. Therefore, developing effective spectral unmixing algorithms, especially HS image processing chains to automatically extract and map TS spectral information from the satellite HS data continues to be a research topic. Given the unique characteristics (low-cost, agile, and autonomous opportunity) of UAV-based remote sensing systems, future works by using the UAV-based sensors’ data (MS and HS sensors and LiDAR sensors) may focus on (1) research on calibrating and verifying methods/algorithms for TS classification and (2) applications of directly utilizing the UAV-based sensors’ data to identify and map TS.
6. Conclusions and Remarks
In this study, a total of 231 publications associated with investigating tree species (TS) classification and mapping using various remote sensing sensors’ images were reviewed. With regard to this, an overview on applications of various sensors’ data to TS classification was conducted, especially on studies on applications and research with VHR satellite multispectral data, airborne hyperspectral data, and UAV-based multi-/hyperspectral and airborne LiDAR sensors’ data. After performing the review, several conclusions with remarks and recommendations are summarized as follows. (1)During last two decades, most application studies on TS classification were using VHR satellite MS data and airborne HS data and LiDAR data. This was just a perfect match during the advent of advanced remote sensing technologies (VHR satellite MS and airborne HS sensors/systems during the late 1990s; although the LiDAR technique started in 1960s, its application in remote sensing in TS mapping was most popular after 2000). This is because the properties of high spatial/spectral resolutions and vertical/geometric features are very suitable for TS classification and mapping(2)Given the explicit advantages of the three “multiple” methods summarized in Table 6, the three categories of “multiple” methods by efficiently integrating information of multiple spatial/spectral and temporal/seasonal data, vertical/geometric features, and a reasonable and logic structure classification system matching different scales of landscape unit and surface cover unit/patch, provide a potential of improving TS classification by using the multisensor and multisource data(3)To improve TS classification with extracted and selected various features from different sensors’ data, after 2010, the most popularly used classification methods/techniques are machine learning including deep learning techniques/models (e.g., 3D-CNN). Usually, such advanced methods/algorithms/models can produce higher classification and mapping accuracies compared to those created with other traditional methods/techniques(4)Recently, application and development of UAV-based remote sensing seasons/systems (MS, HS, and point cloud sensors) for identifying and mapping TS have attracted the attention of researchers and practitioners. Considering the nature of the low cost, agility, and autonomy of UAV-based systems, the UAV-based remote sensing data have been used as either reference data for research or directly applied for mapping and classifying TS(5)There are three limitations that were identified and suggested to overcome in future works. They include (1) using a single sensor’s data, limited by spatial/spectral and sometime temporal resolution; (2) using a single small test site (area), limited by unrepresentative ecological conditions and environmental settings, and image and reference data under investigation, and coming out as unreliable and biased results and findings; and (3) not fully using all seasonal phenological change information from all seasonal images under study. Future works may need additional higher spatial and spectral and multiseasonal image data, and use more test sites or a large enough study area; otherwise, the assessed results and derived findings need to be verified and checked with comparable studies in the literature and some indices or metrics must be developed to integrate all seasonal images under investigation(6)Three future directions are recommended: (1) refine the three types of “multiple” methods for TS classification and mapping by overcoming the limitations and processing the control factors summarized in Table 6; (2) develop novel data fusion algorithms or processing chains with different sensors or different seasonal data; and (3) develop new spectral unmixing algorithms, especially HS image processing chains, to automatically extract and map TS spectral information from satellite HS data. For the three directions, future works may focus on developing efficient and automatic image processing chains or algorithms (resampling, registration and radiometric normalization) and speeding processing chains for the multilevel classification system by defining and determining thresholds for different process levels for (1); developing novel techniques or algorithms to fuse different sensors’ images, similar to a pansharpening algorithm for (2); and for (3), developing new spectral unmixing algorithms including nonlinear algorithms to efficiently unmix satellite HS data
Abbreviations
AISA: | Airborne imaging spectrometer for different applications, sensor |
ANN: | Artificial neural network (model) |
ASTER: | Advanced spaceborne thermal emission and reflection radiometer, sensor |
AVIRIS: | Airborne visible infrared imaging spectrometer, sensor |
CART: | Classification and regression tree |
CASI: | Compact airborne spectrographic imager, sensor |
CDA: | Canonical discriminant analysis |
CFS: | Correlation-based feature selection |
CHM: | Canopy height model |
CHRIS: | Compact high-resolution imaging spectrometer, sensor |
DSM: | Digital surface model |
ESTARFM: | Enhanced spatial and temporal adaptive reflectance fusion model |
GBM: | Gradient boosting machine |
GSS: | Gram-Schmidt spectral sharpening |
FSDAF: | Flexible spatial and temporal adaptive reflectance fusion model |
HRV: | High-resolution visible |
HRS: | Hyperspectral remote sensing |
HS: | Hyperspectral |
HYDICE: | Hyperspectral digital imagery collection experiment, sensor |
HyMAP: | Airborne hyperspectral scanners |
ITC: | Individual tree crown |
-NN: | -nearest neighbor |
LAI: | Leaf area index |
LDA: | Linear discriminant analysis |
LiDAR: | Light detection and ranging |
LR: | Logistic regression |
LULC: | Land use/land cover |
ML: | Machine learning |
MLC: | Maximum likelihood classifier |
MNF: | Minimum noise fraction |
MS: | Multispectral |
MSI: | Multispectral instrument |
NDVI: | Normalized difference vegetation index |
NIR: | Near infrared |
OA: | Overall accuracy |
Pan: | Panchromatic |
PCA: | Principal component analysis |
PCS: | PC spectral sharpening |
RF: | Random forest |
SDA: | Stepwise discriminant analysis |
SAM: | Spectral angle mapper |
STDF: | Spatiotemporal data fusion |
STARFM: | Spatial and temporal adaptive reflectance fusion model |
SWIR: | Shortwave infrared |
SVM: | Support vector machine |
TS: | Tree species |
TIR: | Thermal infrared (8–14 mm) |
UAV: | Unmanned aerial vehicle |
VHR: | Very high (high) spatial resolution |
VNIR: | Visible-near infrared (0.4–1.0 mm) |
WV2/3: | WorldView-2/WorldView-3. |
Data Availability
No data availability for the paper. It is a review paper.
Conflicts of Interest
The author declares that there is no conflict of interest regarding the publication of this article.
Authors’ Contributions
It is a single-authored paper. I have done everything for the paper.
Acknowledgments
This work was supported by the University of South Florida, USA.
References
- F. Fang, B. E. McNeil, T. A. Warner et al., “Discriminating tree species at different taxonomic levels using multi-temporal WorldView-3 imagery in Washington D.C., USA,” Remote Sensing of Environment, vol. 246, article 111811, 2020. View at: Publisher Site | Google Scholar
- A. Ossola and M. E. Hopton, “Measuring urban tree loss dynamics across residential landscapes,” Science of the Total Environment, vol. 612, pp. 940–949, 2018. View at: Publisher Site | Google Scholar
- Y. Sun, J. Huang, Z. Ao, D. Lao, and Q. Xin, “Deep learning approaches for the mapping of tree species diversity in a tropical wetland using airborne LiDAR and high-spatial-resolution remote sensing images,” Forests, vol. 10, no. 11, article 1047, 2019. View at: Publisher Site | Google Scholar
- K. R. Kirby and C. Potvin, “Variation in carbon storage among tree species: implications for the management of a small-scale carbon sink project,” Forest Ecology and Management, vol. 246, no. 2-3, pp. 208–221, 2007. View at: Publisher Site | Google Scholar
- M. Arasumani, M. Bunyan, and V. V. Robin, “Opportunities and challenges in using remote sensing for invasive tree species management, and in the identification of restoration sites in tropical montane grasslands,” Journal of Environmental Management, vol. 280, article 111759, 2021. View at: Publisher Site | Google Scholar
- M. Katoh, “Estimation of rates of the crown area in yezo spruce plantations with Landsat Thematic Mapper data,” 16th ISPRS/IUFRO Kyoto, pp. 23–29, 1988. View at: Google Scholar
- R. Congalton, J. Miguel-Ayanz, and B. Gallup, Remote Sensing Techniques for Hardwood Mapping, Contract Report to California Dept. of Forestry and Fire Protection, Sacremento, California, 1991.
- S. E. Franklin, “Discrimination of subalpine forest species and canopy density using digital CASI, SPOT, and Landsat TM data,” Photogrammetric Engineering and Remote Sensing, vol. 60, pp. 1233–1241, 1994. View at: Google Scholar
- J. M. B. Carreiras, J. M. Pereira, and J. S. Pereira, “Estimation of tree canopy cover in evergreen oak woodlands using remote sensing,” Forest Ecology and Management, vol. 223, no. 1-3, pp. 45–53, 2006. View at: Publisher Site | Google Scholar
- M. E. Fagan, R. S. DeFries, S. E. Sesnie et al., “Mapping species composition of forests and tree plantations in northeastern Costa Rica with an integration of hyperspectral and multitemporal Landsat imagery,” Remote Sensing, vol. 7, no. 5, pp. 5660–5696, 2015. View at: Publisher Site | Google Scholar
- T. W. Gillespie, J. de Goede, L. Aguilar et al., “Predicting tree species richness in urban forests,” Urban Ecosystem, vol. 20, no. 4, pp. 839–849, 2017. View at: Publisher Site | Google Scholar
- C. H. Davis and X. Wang, “Planimetric accuracy of Ikonos 1 m panchromatic orthoimage products and their utility for local government GIS basemap applications,” International Journal of Remote Sensing, vol. 24, no. 22, pp. 4267–4288, 2003. View at: Publisher Site | Google Scholar
- D. Li, Y. Ke, H. Gong, and X. Li, “Object-based urban tree species classification using bi-temporal Worldview-2 and Worldview-3 images,” Remote Sensing, vol. 7, no. 12, pp. 16917–16937, 2015. View at: Publisher Site | Google Scholar
- H. Buddenbaum, M. Schlerf, and J. Hill, “Classification of coniferous tree species and age classes using hyperspectral data and geostatistical methods,” International Journal of Remote Sensing, vol. 26, no. 24, pp. 5453–5465, 2005. View at: Publisher Site | Google Scholar
- M. Alonzo, K. Roth, and D. A. Roberts, “Identifying Santa Barbara’s urban tree species from AVIRIS imagery using canonical discriminant analysis,” Remote Sensing Letters, vol. 4, no. 5, pp. 513–521, 2013. View at: Publisher Site | Google Scholar
- M. Papeş, R. Tupayachi, P. Martínez, A. T. Peterson, G. P. Asner, and G. V. N. Powell, “Seasonal variation in spectral signatures of five genera of rainforest trees,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 6, no. 2, pp. 339–350, 2013. View at: Publisher Site | Google Scholar
- A. Ghosh, F. E. Fassnacht, P. K. Joshi, and B. Koch, “A framework for mapping tree species combining hyperspectral and LiDAR data: role of selected classifiers and sensor across three spatial scales,” International Journal of Applied Earth Observation and Geoinformation, vol. 26, pp. 49–63, 2014. View at: Publisher Site | Google Scholar
- K. Wang, T. Wang, and X. Liu, “A Review. Individual tree species classification using integrated airborne LiDAR and optical imagery with a focus on the urban environment,” Forests, vol. 10, no. 1, p. 1, 2019. View at: Publisher Site | Google Scholar
- R. Pu and S. Landry, “Mapping urban tree species by integrating multi-seasonal high resolution pleiades satellite imagery with airborne LiDAR data,” Urban Forestry & Urban Greening, vol. 53, article 126675, 2020. View at: Publisher Site | Google Scholar
- F. Schiefer, T. Kattenborn, A. Frick et al., “Mapping forest tree species in high resolution UAV-based RGB-imagery by means of convolutional neural networks,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 170, pp. 205–215, 2020. View at: Publisher Site | Google Scholar
- F. E. Fassnacht, H. Latifi, K. Stereńczak et al., “Review of studies on tree species classification from remotely sensed data,” Remote Sensing of Environment, vol. 186, pp. 64–87, 2016. View at: Google Scholar
- D. Yin and L. Wang, “How to assess the accuracy of the individual tree-based forest inventory derived from remotely sensed data: a review,” International Journal of Remote Sensing, vol. 37, no. 19, pp. 4521–4553, 2016. View at: Publisher Site | Google Scholar
- K. Koenig and B. Höfle, “Full-waveform airborne laser scanning in vegetation studies—a review of point cloud and waveform features for tree species classification,” Forests, vol. 7, no. 12, article 198, 2016. View at: Publisher Site | Google Scholar
- X. Li, W. Y. Chen, G. Sanesi, and R. Lafortezza, “Remote sensing in urban forestry: recent applications and future directions,” Remote Sensing, vol. 11, no. 10, article 1144, 2019. View at: Publisher Site | Google Scholar
- M. Michałowska and J. Rapinski, “A review of tree species classification based on airborne LiDAR data and applied classifiers,” Remote Sensing, vol. 13, article 353, 2021. View at: Google Scholar
- R. Pu, Hyperspectral Remote Sensing: Fundamentals and Practices, CRC Press, Taylor & Francis Group, 2017.
- L. Grant, “Diffuse and specular characteristics of leaf reflectance,” Remote Sensing of Environment, vol. 22, no. 2, pp. 309–322, 1987. View at: Publisher Site | Google Scholar
- G. P. Asner, “Biophysical and biochemical sources of variability in canopy reflectance,” Remote Sensing of Environment, vol. 64, no. 3, pp. 234–253, 1998. View at: Publisher Site | Google Scholar
- M. E. Martin, S. D. Newman, J. D. Aber, and R. G. Congalton, “Determining forest species composition using high spectral resolution remote sensing data,” Remote Sensing of Environment, vol. 65, no. 3, pp. 249–254, 1998. View at: Publisher Site | Google Scholar
- M. L. Clark, D. A. Roberts, and D. B. Clark, “Hyperspectral discrimination of tropical rain forest tree species at leaf to crown scales,” Remote Sensing of Environment, vol. 96, no. 3–4, pp. 375–398, 2005. View at: Publisher Site | Google Scholar
- D. G. Leckie, S. Tinis, T. Nelson et al., “Issues in species classification of trees in old growth conifer stands,” Canadian Journal of Remote Sensing, vol. 31, no. 2, pp. 175–190, 2005. View at: Publisher Site | Google Scholar
- G. A. Fricker, J. A. Wolf, S. S. Saatchi, and T. W. Gillespie, “Predicting spatial variations of tree species richness in tropical forests from high-resolution remote sensing,” Ecological Applications, vol. 25, no. 7, pp. 1776–1789, 2015. View at: Publisher Site | Google Scholar
- M. L. Clark and D. A. Roberts, “Species-level differences in hyperspectral metrics among tropical rainforest trees as determined by a tree-based classifier,” Remote Sensing, vol. 4, article 1820, 2012. View at: Google Scholar
- R. Pu, S. Landry, and Q. Yu, “Assessing the potential of multi-seasonal high resolution Pleiades satellite imagery for mapping urban tree species,” International Journal of Applied Earth Observation and Geoinformation, vol. 71, pp. 144–158, 2018. View at: Publisher Site | Google Scholar
- L. S. Galvão, A. R. Formaggio, and D. A. Tisot, “Discrimination of sugarcane varieties in Southeastern Brazil with EO-1 Hyperion data,” Remote Sensing of Environment, vol. 94, no. 4, pp. 523–534, 2005. View at: Publisher Site | Google Scholar
- H. Gu, A. Singh, and P. A. Townsend, “Detection of gradients of forest composition in an urban area using imaging spectroscopy,” Remote Sensing of Environment, vol. 167, pp. 168–180, 2015. View at: Publisher Site | Google Scholar
- G. P. Asner, M. O. Jones, R. E. Martin, D. E. Knapp, and R. F. Hughes, “Remote sensing of native and invasive species in Hawaiian forests,” Remote Sensing of Environment, vol. 112, no. 5, pp. 1912–1926, 2008. View at: Publisher Site | Google Scholar
- Z. Xie, Y. Chen, D. Lu, G. Li, and E. Chen, “Classification of land cover, forest, and tree species classes with Ziyuan-3 multispectral and stereo data,” Remote Sensing, vol. 11, no. 2, article 164, 2019. View at: Publisher Site | Google Scholar
- P. Gärtner, M. Förster, and B. Kleinschmit, “The benefit of synthetically generated RapidEye and Landsat 8 data fusion time series for riparian forest disturbance monitoring,” Remote Sensing of Environment, vol. 177, pp. 237–247, 2016. View at: Publisher Site | Google Scholar
- S. Madonsela, M. A. Cho, R. Mathieu et al., “Multi-phenology WorldView-2 imagery improves remote sensing of savannah tree species,” International Journal of Applied Earth Observation and Geoinformation, vol. 58, pp. 65–73, 2017. View at: Publisher Site | Google Scholar
- M. Alonzo, B. Bookhagen, and D. A. Roberts, “Urban tree species mapping using hyperspectral and LiDAR data fusion,” Remote Sensing of Environment, vol. 148, pp. 70–83, 2014. View at: Publisher Site | Google Scholar
- L. X. Liu, N. C. Coops, N. W. Aven, and Y. Pang, “Mapping urban tree species using integrated airborne hyperspectral and LiDAR remote sensing data,” Remote Sensing of Environment, vol. 200, pp. 170–182, 2017. View at: Publisher Site | Google Scholar
- D. Riaño, F. Valladares, S. Condés, and E. Chuvieco, “Estimation of leaf area index and covered ground from airborne laser scanner (LiDAR) in two contrasting forests,” Agricultural and Forest Meteorology, vol. 124, no. 3–4, pp. 269–275, 2004. View at: Publisher Site | Google Scholar
- A. Hudak, N. Crookston, and J. Evans, “Regression modeling and mapping of coniferous forest basal area and tree density from discrete-return LiDAR and multispectral satellite data,” Canadian Journal of Forest Research, vol. 32, no. 2, pp. 126–138, 2006. View at: Publisher Site | Google Scholar
- S. Solberg, A. Brunner, K. H. Hanssen et al., “Mapping LAI in a Norway spruce forest using airborne laser scanning,” Remote Sensing of Environment, vol. 113, no. 11, pp. 2317–2327, 2009. View at: Publisher Site | Google Scholar
- G. P. Asner, J. Mascaro, H. C. Muller-Landau et al., “A universal airborne LiDAR approach for tropical forest carbon mapping,” Oecologia, vol. 168, no. 4, pp. 1147–1160, 2012. View at: Google Scholar
- D. Leckie, F. Gougeon, D. Hill, R. Quinn, L. Armstrong, and R. Shreenan, “Combined high-density LiDAR and multispectral imagery for individual tree crown analysis,” Canadian Journal of Remote Sensing, vol. 29, no. 5, pp. 633–649, 2003. View at: Publisher Site | Google Scholar
- M. K. Jakubowski, W. Li, Q. Guo, and M. Kelly, “Delineating individual trees from LiDAR data: a comparison of vector- and raster-based segmentation approaches,” Remote Sensing, vol. 5, no. 9, pp. 4163–4186, 2013. View at: Publisher Site | Google Scholar
- M. Kamal, S. Phinn, and K. Johansen, “Object-based approach for multi-scale mangrove composition mapping using multi-resolution image datasets,” Remote Sensing, vol. 7, no. 4, pp. 4753–4783, 2015. View at: Publisher Site | Google Scholar
- S. Kim, R. J. McGaughey, H.-E. Andersen, and G. Schreuder, “Tree species differentiation using intensity data derived from leaf-on and leaf-off airborne laser scanner data,” Remote Sensing of Environment, vol. 113, no. 8, pp. 1575–1586, 2009. View at: Publisher Site | Google Scholar
- J. A. Brockhaus and S. Khorram, “A comparison of SPOT and Landsat TM data for use in conducting inventories of forest resources,” International Journal of Remote Sensing, vol. 13, no. 16, pp. 3035–3043, 1992. View at: Publisher Site | Google Scholar
- H. Nagendra, R. Lucas, J. P. Honrado et al., “Remote sensing for conservation monitoring: assessing protected areas, habitat extent, habitat condition, species diversity, and threats,” Ecological Indicators, vol. 33, pp. 45–59, 2013. View at: Publisher Site | Google Scholar
- C. Kuenzer, M. Ottinger, M. Wegmann et al., “Earth observation satellite sensors for biodiversity monitoring: potentials and bottlenecks,” International Journal of Remote Sensing, vol. 35, no. 18, pp. 6599–6647, 2014. View at: Publisher Site | Google Scholar
- C. Corbane, S. Lang, K. Pipkins et al., “Remote sensing for mapping natural habitats and their conservation status - New opportunities and challenges,” International Journal of Applied Earth Observation and Geoinformation, vol. 37, pp. 7–16, 2015. View at: Publisher Site | Google Scholar
- M. Hauglin and H. O. Ørka, “Discriminating between native Norway spruce and invasive Sitka spruce—a comparison of multitemporal Landsat 8 imagery, aerial images and airborne laser scanner data,” Remote Sensing, vol. 8, no. 5, article 363, 2016. View at: Publisher Site | Google Scholar
- E. Grabska, D. Frantzc, and K. Ostapowicz, “Evaluation of machine learning algorithms for forest stand species mapping using Sentinel-2 imagery and environmental data in the Polish Carpathians,” Remote Sensing of Environment, vol. 251, article 112103, 2020. View at: Publisher Site | Google Scholar
- J. Lim, K.-M. Kim, E.-H. Kim, and R. Jin, “Machine learning for tree species classification using sentinel-2 spectral information, crown texture, and environmental variables,” Remote Sensing, vol. 12, no. 12, article 2049, 2020. View at: Publisher Site | Google Scholar
- M. Katoh, “Classifying tree species in a northern mixed forest using high-resolution IKONOS data,” Journal of Forest Research, vol. 9, pp. 7–14, 2004. View at: Google Scholar
- Y. Ke and L. J. Quackenbush, “Forest species classification and tree crown delineation using QuickBird imagery,” in ASPRS 2007, Annual conference, Tampa, Florida, 2007. View at: Google Scholar
- B. Mora, M. A. Wulder, and J. C. White, “Identifying leading species using tree crown metrics derived from very high spatial resolution imagery in a boreal forest environment,” Canadian Journal of Remote Sensing, vol. 36, no. 4, pp. 332–344, 2010. View at: Publisher Site | Google Scholar
- M. Dalponte, L. Bruzzone, and D. Gianelle, “Tree species classification in the Southern Alps based on the fusion of very high geometrical resolution multispectral/hyperspectral images and LiDAR data,” Remote Sensing of Environment, vol. 123, pp. 258–270, 2012. View at: Publisher Site | Google Scholar
- H. Van Deventer, M. A. Cho, and O. Mutanga, “Improving the classification of six evergreen subtropical tree species with multi-season data from leaf spectra simulated to WorldView-2 and RapidEye,” International Journal of Remote Sensing, vol. 38, no. 17, pp. 4804–4830, 2017. View at: Publisher Site | Google Scholar
- M. A. M. Choudhury, E. Marcheggiani, F. Despini et al., “Urban tree species identification and carbon stock mapping for urban green planning and management,” Forests, vol. 11, no. 11, article 1226, 2020. View at: Publisher Site | Google Scholar
- Y. Guo, Z. Li, E. Chen et al., “An end-to-end deep fusion model for mapping forests at tree species levels with high spatial resolution satellite imagery,” Remote Sensing, vol. 12, no. 20, article 3324, 2020. View at: Publisher Site | Google Scholar
- W.-T. Ng, P. Rima, K. Einzmann, M. Immitzer, C. Atzberger, and S. Eckert, “Assessing the Potential of Sentinel-2 and Pléiades Data for the Detection of Prosopis and Vachellia spp. in Kenya,” Remote Sensing, vol. 9, no. 1, article 74, 2017. View at: Publisher Site | Google Scholar
- K. A. Korznikov, D. E. Kislov, J. Altman, J. Doležal, A. S. Vozmishcheva, and P. V. Krestov, “Using U-Net-like deep convolutional neural networks for precise tree recognition in very high resolution RGB (red, green, blue) satellite images,” Forests, vol. 12, no. 1, article 66, 2021. View at: Publisher Site | Google Scholar
- M. Wang, R. Liu, X. Lu, H. Ren, M. Chen, and J. Yu, “The use of mobile LiDAR data and Gaofen-2 image to classify roadside trees,” Measurement Science and Technology, vol. 31, no. 12, article 125005, 2020. View at: Publisher Site | Google Scholar
- Q. Xiao, S. L. Ustin, and E. G. McPherson, “Using AVIRIS data and multiple-masking techniques to map urban forest tree species,” International Journal of Remote Sensing, vol. 25, no. 24, pp. 5637–5654, 2004. View at: Publisher Site | Google Scholar
- M. Menenti, F. Maselli, M. Chiesi et al., “Multi-angular hyperspectral observations of Mediterranean forest with PROBA-CHRIS,” in Imaging Spectrometry X, International Society for Optics and Photonics, 2004. View at: Google Scholar
- A. Ceballos, J. Hernández, P. Corvalán, and M. Galleguillos, “Comparison of airborne LiDAR and satellite hyperspectral remote sensing to estimate vascular plant richness in deciduous Mediterranean forests of central Chile,” Remote Sensing, vol. 7, no. 3, pp. 2692–2714, 2015. View at: Publisher Site | Google Scholar
- M. Papeș, R. Tupayachi, P. Martínez, A. T. Peterson, and G. V. N. Powell, “Using hyperspectral satellite imagery for regional inventories: a test with tropical emergent trees in the Amazon Basin,” Journal of Vegetation Science, vol. 21, no. 2, pp. 342–354, 2010. View at: Publisher Site | Google Scholar
- A. Dyk, D. G. Goodenough, J. Y. Li et al., “Multi-temporal, multi-angle evaluation with CHRIS of coastal forests,” in 2006 IEEE International Symposium on Geoscience and Remote Sensing, pp. 108–111, Denver, CO, USA, 2006. View at: Google Scholar
- N. Goodwin, R. Turner, and R. Merton, “Classifying eucalyptus forests with high spatial and spectral resolution imagery: an investigation of individual species and vegetation communities,” Australian Journal of Botany, vol. 53, no. 4, pp. 337–345, 2005. View at: Publisher Site | Google Scholar
- D. G. Leckie, F. A. Gougeon, S. Tinis, T. Nelson, C. N. Burnett, and D. Paradine, “Automated tree recognition in old growth conifer stands with high resolution digital imagery,” Remote Sensing of Environment, vol. 94, no. 3, pp. 311–326, 2005. View at: Publisher Site | Google Scholar
- A. Banskota, R. H. Wynne, and N. Kayastha, “Improving within-genus tree species discrimination using the discrete wavelet transform applied to airborne hyperspectral data,” International Journal of Remote Sensing, vol. 32, no. 13, pp. 3551–3563, 2011. View at: Publisher Site | Google Scholar
- J. Zhang, B. Rivard, A. Sánchez-Azofeifa, and K. Castro-Esau, “Intra- and inter-class spectral variability of tropical tree species at La Selva, Costa Rica: implications for species identification using HYDICE imagery,” Remote Sensing of Environment, vol. 105, no. 2, pp. 129–141, 2006. View at: Publisher Site | Google Scholar
- Z. Zhang, A. Kazakova, L. M. Moskal, and D. M. Styers, “Object-based tree species classification in urban ecosystems using LiDAR and hyperspectral data,” Forests, vol. 7, no. 12, article 122, 2016. View at: Publisher Site | Google Scholar
- S. J. Walsh, A. L. McCleary, C. F. Mena et al., “QuickBird and Hyperion data analysis of an invasive plant species in the Galapagos Islands of Ecuador: Implications for control and land use management,” Remote Sensing of Environment, vol. 112, no. 5, pp. 1927–1941, 2008. View at: Publisher Site | Google Scholar
- F. Tsai, E. E. Lin, and K. Yoshino, “Spectrally segmented principal component analysis of hyperspectral imagery for mapping invasive plant species,” International Journal of Remote Sensing, vol. 28, no. 5, pp. 1023–1039, 2007. View at: Publisher Site | Google Scholar
- R. Pu, P. Gong, Y. Tian, X. Miao, R. Carruthers, and G. L. Anderson, “Invasive species change detection using artificial neural networks and CASI hyperspectral imagery,” Environmental Monitoring and Assessment, vol. 140, no. 1-3, pp. 15–32, 2008. View at: Publisher Site | Google Scholar
- T. G. Jones, N. C. Coops, and T. Sharma, “Assessing the utility of airborne hyperspectral and LiDAR data for species distribution mapping in the coastal Pacific Northwest, Canada,” Remote Sensing of Environment, vol. 114, no. 12, pp. 2841–2852, 2010. View at: Publisher Site | Google Scholar
- C. M. Chance, N. C. Coops, A. A. Plowright, T. R. Tooke, A. Christen, and N. Aven, “Invasive shrub mapping in an urban environment from hyperspectral and LiDAR-derived attributes,” Frontiers in plant science, vol. 7, article 1528, 2016. View at: Publisher Site | Google Scholar
- P. Wang, M. D. Mura, J. Chanussot, and G. Zhang, “Soft-then-hard super-resolution mapping based on pansharpening technique for remote sensing image,” Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 12, no. 1, pp. 334–344, 2019. View at: Publisher Site | Google Scholar
- M. Voss and R. Sugumaran, “Seasonal effect on tree species classification in an urban environment using hyperspectral data, LiDAR, and an object-oriented approach,” Sensors, vol. 8, no. 5, pp. 3020–3036, 2008. View at: Publisher Site | Google Scholar
- A. Jaakkola, J. Hyyppä, A. Kukko et al., “A low-cost multi-sensoral mobile mapping system and its feasibility for tree measurements,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 65, no. 6, pp. 514–522, 2010. View at: Publisher Site | Google Scholar
- I. Colomina and P. Molina, “Unmanned aerial systems for photogrammetry and remote sensing: a review,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 92, pp. 79–97, 2014. View at: Publisher Site | Google Scholar
- J. Dandois, M. Olano, and E. Ellis, “Optimal altitude, overlap, and weather conditions for computer vision UAV estimates of forest structure,” Remote Sensing, vol. 7, pp. 13895–13920, 2015. View at: Publisher Site | Google Scholar
- T. Sankey, J. Donager, J. McVay, and J. B. Sankey, “UAV LiDAR and hyperspectral fusion for forest monitoring in the southwestern USA,” Remote Sensing of Environment, vol. 195, pp. 30–43, 2017. View at: Publisher Site | Google Scholar
- C. Torresan, A. Berton, F. Carotenuto et al., “Forestry applications of UAVs in Europe: a review,” International Journal of Remote Sensing, vol. 38, no. 8-10, pp. 2427–2447, 2017. View at: Publisher Site | Google Scholar
- C. Sothe, M. Dalponte, C. M. de Almeida et al., “Tree species classification in a highly diverse subtropical forest integrating UAV-based photogrammetric point cloud and hyperspectral data,” Remote Sensing, vol. 11, no. 11, article 1338, 2019. View at: Publisher Site | Google Scholar
- X. Feng and P. Li, “A tree species mapping method from UAV images over urban area using similarity in tree-crown object histograms,” Remote Sensing, vol. 11, no. 17, article 1982, 2019. View at: Publisher Site | Google Scholar
- C. Zhang, K. Xia, H. Feng, Y. Yang, and X. Du, “Tree species classification using deep learning and RGB optical images obtained by an unmanned aerial vehicle,” Journal of Forest Research, vol. 32, no. 5, pp. 1879–1888, 2021. View at: Publisher Site | Google Scholar
- B. Brede, A. Lau, H. M. Bartholomeus, and L. Kooistre, “Comparing RIEGL RiCOPTER UAV LiDAR derived canopy height and DBH with terrestrial LiDAR,” Sensors, vol. 17, no. 10, article 2371, 2017. View at: Publisher Site | Google Scholar
- K. Liu, X. Shen, L. Cao, G. Wang, and F. Cao, “Estimating forest structural attributes using UAV-LiDAR data in Ginkgo plantations,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 146, pp. 465–482, 2018. View at: Publisher Site | Google Scholar
- J. Cao, W. Leng, K. Liu, L. Liu, Z. He, and Y. Zhu, “Object-based mangrove species classification using unmanned aerial vehicle hyperspectral images and digital surface models,” Remote Sensing, vol. 10, no. 2, article 89, 2018. View at: Publisher Site | Google Scholar
- O. Nevalainen, E. Honkavaara, S. Tuominen et al., “Individual tree detection and classification with UAV-based photogrammetric point clouds and hyperspectral imaging,” Remote Sensing, vol. 9, no. 3, article 185, 2017. View at: Publisher Site | Google Scholar
- J. Lisein, A. Michez, H. Claessens, and P. Lejeune, “Discrimination of deciduous tree species from time series of unmanned aerial system imagery,” PLoS One, vol. 10, no. 11, article e0141006, 2015. View at: Publisher Site | Google Scholar
- A. Michez, H. Piégay, L. Jonathan, H. Claessens, and P. Lejeune, “Mapping of riparian invasive species with supervised classification of unmanned aerial system (UAS) imagery,” International Journal of Applied Earth Observation and Geoinformation, vol. 44, pp. 88–94, 2016. View at: Publisher Site | Google Scholar
- D. J. Hill, C. Taraso, G. E. Whitworth, J. Baron, J. L. Bradshaw, and J. S. Church, “Utility of unmanned aerial vehicles for mapping invasive plant species: a case study on yellow flag iris (Iris pseudacorusL.),” International Journal of Remote Sensing, vol. 38, no. 8-10, pp. 2083–2105, 2017. View at: Publisher Site | Google Scholar
- S. E. Franklin and O. S. Ahmed, “Deciduous tree species classification using object-based analysis and machine learning with unmanned aerial vehicle multispectral data,” International Journal of Remote Sensing, vol. 39, no. 15-16, pp. 5236–5245, 2018. View at: Publisher Site | Google Scholar
- F. Nex and F. Remondino, “UAV for 3D mapping applications: a review,” Applied geomatics, vol. 6, no. 1, pp. 1–15, 2014. View at: Publisher Site | Google Scholar
- A. Matese, P. Toscano, S. D. Gennaro et al., “Intercomparison of UAV, aircraft and satellite remote sensing platforms for precision viticulture,” Remote Sensing, vol. 7, no. 3, pp. 2971–2990, 2015. View at: Publisher Site | Google Scholar
- J. Hyyppä, O. Kelle, M. Lehikoinen, and M. Inkinen, “A segmentation-based method to retrieve stem volume estimates from 3-D tree height models produced by laser scanners,” IEEE Transactions on Geoscience and Remote Sensing, vol. 39, no. 5, pp. 969–975, 2001. View at: Publisher Site | Google Scholar
- L. Wallace, R. Musk, and A. Lucieer, “An assessment of the repeatability of automatic forest inventory metrics derived from UAV-borne laser scanning data,” IEEE Transactions on Geoscience and Remote Sensing, vol. 52, no. 11, pp. 7160–7169, 2014. View at: Publisher Site | Google Scholar
- M. A. Cho, O. Malahlelac, and A. Ramoelo, “Assessing the utility WorldView-2 imagery for tree species mapping in South African subtropical humid forest and the conservation implications: Dukuduku forest patch as case study,” International Journal of Applied Earth Observation and Geoinformation, vol. 38, pp. 349–357, 2015. View at: Publisher Site | Google Scholar
- N. K. Verma, D. W. Lamb, and P. Sinha, Airborne LiDAR and High Resolution Multispectral Data Integration in Eucalyptus Tree Species Mapping in an Australian Farmscape, Geocarto International, 2019.
- J. Mäyrä, S. Keski-Saari, S. Kivinen et al., “Tree species classification from airborne hyperspectral and LiDAR data using 3D convolutional neural networks,” Remote Sensing of Environment, vol. 256, article 112322, 2021. View at: Publisher Site | Google Scholar
- L. Jing, B. Hu, T. Noland, and J. Li, “An individual tree crown delineation method based on multi-scale segmentation of imagery,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 70, pp. 88–98, 2012. View at: Publisher Site | Google Scholar
- G. Yang, Y. Zhao, B. Li et al., “Tree species classification by employing multiple features acquired from integrated sensors,” Journal of Sensors, vol. 2019, Article ID 3247946, 12 pages, 2019. View at: Publisher Site | Google Scholar
- T. Brandtberg, T. A. Warner, R. E. Landenberger, and J. B. McGraw, “Detection and analysis of individual leaf-off tree crowns in small footprint, high sampling density LiDAR data from the eastern deciduous forest in North America,” Remote Sensing of Environment, vol. 85, no. 3, pp. 290–303, 2003. View at: Publisher Site | Google Scholar
- Y. Ke and L. J. Quackenbush, “A review of methods for automatic individual tree-crown detection and delineation from passive remote sensing,” International Journal of Remote Sensing, vol. 32, no. 17, pp. 4725–4747, 2011. View at: Publisher Site | Google Scholar
- M. P. Ferreira, F. H. Wagner, L. E. O. C. Aragão, Y. E. Shimabukuro, and C. R. S. de Filho, “Tree species classification in tropical forests using visible to shortwave infrared WorldView-3 images and texture analysis,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 149, pp. 119–131, 2019. View at: Publisher Site | Google Scholar
- S. Briechle, P. Krzystek, and G. Vosselman, “Silvi-Net - A dual-CNN approach for combined classification of tree species and standing dead trees from remote sensing data,” International Journal of Applied Earth Observations and Geoinformation, vol. 98, article 102292, 2021. View at: Publisher Site | Google Scholar
- Q. Chen, D. Baldocchi, P. Gong, and M. Kelly, “Isolating individual trees in a savanna woodland using small footprint LiDAR data,” Photogrammetric Engineering & Remote Sensing, vol. 72, no. 8, pp. 923–932, 2006. View at: Publisher Site | Google Scholar
- X. Lu, Q. Guo, W. Li, and J. Flanagan, “A bottom-up approach to segment individual deciduous trees using leaf-off LiDAR point cloud data,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 94, pp. 1–12, 2014. View at: Publisher Site | Google Scholar
- J. L. Genderen and C. van Pohl, “Image fusion: issues, techniques and applications,” in Intelligent Image Fusion, Proceedings EARSeL Workshop, J. L. Genderen and V. Cappellini, Eds., pp. 18–26, Strasbourg, France, 1994. View at: Google Scholar
- C. Pohl and J. L. V. Genderen, “Review article multisensor image fusion in remote sensing: concepts, methods and applications,” International Journal of Remote Sensing, vol. 19, no. 5, pp. 823–854, 1998. View at: Publisher Site | Google Scholar
- R. Pu and S. Landry, “A comparative analysis of high spatial resolution IKONOS and WorldView-2 imagery for mapping urban tree species,” Remote Sensing of Environment, vol. 124, pp. 516–533, 2012. View at: Publisher Site | Google Scholar
- S. Hartling, V. Sagan, P. Sidike, M. Maimaitijiang, and J. Carron, “Urban tree species classification using a WorldView-2/3 and LiDAR data fusion approach and deep learning,” Sensors, vol. 19, no. 6, article 1284, 2019. View at: Publisher Site | Google Scholar
- P. S. Chavez, S. C. Sides, and J. A. Anderson, “Comparison of three different methods to merge multiresolution and multispectral data: TM & SPOT panchromatic,” Photogrammetric Engineering and Remote Sensing, vol. 57, no. 3, pp. 295–303, 1991. View at: Google Scholar
- F. Gao, J. Masek, M. Schwaller, and F. Hall, “On the blending of the Landsat and MODIS surface reflectance: predicting daily Landsat surface reflectance,” IEEE Transactions on Geoscience and Remote sensing, vol. 44, pp. 2207–2218, 2006. View at: Google Scholar
- X. L. Zhu, J. Chen, F. Gao, X. H. Chen, and J. G. Masek, “An enhanced spatial and temporal adaptive reflectance fusion model for complex heterogeneous regions,” Remote Sensing of Environment, vol. 114, no. 11, pp. 2610–2623, 2010. View at: Publisher Site | Google Scholar
- X. L. Zhu, E. H. Helmer, F. Gao, D. S. Liu, J. Chen, and M. A. Lefsky, “A flexible spatiotemporal method for fusing satellite images with different resolutions,” Remote Sensing of Environment, vol. 172, pp. 165–177, 2016. View at: Google Scholar
- M. Q. Wu, Z. Niu, C. Y. Wang, C. Y. Wu, and L. Wang, “Use of MODIS and Landsat time series data to generate high-resolution temporal synthetic Landsat data using a spatial and temporal reflectance fusion model,” Journal of Applied Remote Sensing, vol. 6, no. 1, article 063507, 2012. View at: Google Scholar
- J. Xue, Y. Leung, and T. Fung, “An unmixing-based Bayesian model for spatio-temporal satellite image fusion in heterogeneous landscapes,” Remote Sensing, vol. 11, no. 3, article 324, 2019. View at: Publisher Site | Google Scholar
- H. Wan, Y. Tang, L. Jing, H. Li, F. Qiu, and W. Wu, “Tree species classification of forest stands using multisource remote sensing data,” Remote Sensing, vol. 13, no. 1, article 144, 2021. View at: Publisher Site | Google Scholar
- J. Yang, Y. Yao, Y. Wei et al., “A Robust Method for Generating High-Spatiotemporal-Resolution Surface Reflectance by Fusing MODIS and Landsat Data,” Remote Sensing, vol. 12, no. 14, article 2312, 2020. View at: Publisher Site | Google Scholar
- H. Zhai, F. Huang, and H. Qi, “Generating high resolution LAI based on a modified FSDAF model,” Remote Sensing, vol. 12, no. 1, article 150, 2020. View at: Publisher Site | Google Scholar
- L. T. Waser, M. Küchler, K. Jütte, and T. Stampfer, “Evaluating the potential of WorldView-2 data to classify tree species and different levels of ash mortality,” Remote Sensing, vol. 6, no. 5, pp. 4515–4545, 2014. View at: Publisher Site | Google Scholar
- S. Jombo, E. Adam, and J. Odindi, “Classification of tree species in a heterogeneous urban environment using object-based ensemble analysis and World View-2 satellite imagery,” Applied Geomatics, vol. 13, no. 3, pp. 373–387, 2021. View at: Publisher Site | Google Scholar
- K. Xu, Q. Tian, Z. Zhang, J. Yue, and C.-T. Chang, “Tree species (genera) identification with GF-1 time-series in a forested landscape, northeast China,” Remote Sensing, vol. 12, article 1554, 2020. View at: Google Scholar
- P. Gong, R. Pu, G. S. Biging, and M. R. Larrieu, “Estimation of forest leaf area index using vegetation indices derived from Hyperion hyperspectral data,” IEEE Transactions on Geoscience and Remote Sensing, vol. 41, no. 6, pp. 1355–1362, 2003. View at: Publisher Site | Google Scholar
- R. R. Jensen, P. J. Hardin, and A. J. Hardin, “Classification of urban tree species using hyperspectral imagery,” Geocarto International, vol. 27, no. 5, pp. 443–458, 2012. View at: Publisher Site | Google Scholar
- B. F. Leutner, B. Reineking, J. Müller et al., “Modelling forest α-diversity and floristic composition—on the added value of LiDAR plus hyperspectral remote sensing,” Remote Sensing, vol. 4, no. 9, pp. 2818–2845, 2012. View at: Publisher Site | Google Scholar
- R. Pu and D. Liu, “Segmented canonical discriminant analysis of in situ hyperspectral data for identifying 13 urban tree species,” International Journal of Remote Sensing, vol. 32, no. 8, pp. 2207–2226, 2011. View at: Publisher Site | Google Scholar
- Remote Sensing of Environment, vol. 91, no. 2, pp. 212–224, 2004. View at: Publisher Site
- R. Pu and S. Landry, “Evaluating seasonal effect on forest leaf area index mapping using multi- seasonal high resolution satellite pleiades imagery,” International Journal of Applied Earth Observation and Geoinformation, vol. 80, pp. 268–279, 2019. View at: Publisher Site | Google Scholar
- Q. Yu, P. Gong, N. Clinton, G. Biging, M. Kelly, and D. Schirokauer, “Object-based detailed vegetation classification with airborne high spatial resolution remote sensing imagery,” Photogrammetric Engineering and Remote Sensing, vol. 72, no. 7, pp. 799–811, 2006. View at: Publisher Site | Google Scholar
- B. Zhang, L. Zhao, and X. Zhang, “Three-dimensional convolutional neural network model for tree species classification using airborne hyperspectral images,” Remote Sensing of Environment, vol. 247, article 111938, 2020. View at: Google Scholar
- M. A. Hall, “Feature selection for discrete and numeric class machine learning,” in Proceedings of the Seventeenth International Conference on Machine Learning, pp. 359–366, Stanford, CA, USA, 2000. View at: Google Scholar
- M. Molinier and H. Astola, “Feature selection for tree species identification in very high resolution satellite images,” IGARSS 2011, pp. 4461–4464, 2011. View at: Google Scholar
- C. Proctor, Y. He, and V. Robinson, “Texture augmented detection of macrophyte species using decision trees,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 80, pp. 10–20, 2013. View at: Publisher Site | Google Scholar
- L. J. Quackenbush, P. F. Hopkins, and G. J. Kinn, “Developing forestry products from high resolution digital aerial imagery,” Photogrammetric Engineering and Remote Sensing, vol. 66, no. 11, pp. 1337–1346, 2000. View at: Google Scholar
- A. P. Carleer and E. Wolff, “Region-based classification potential for land-cover classification with very high spatial resolution satellite data,” in Proceedings of 1st International Conference on Object-based Image Analysis (OBIA 2006), Salzburg University, Austria, 2006. View at: Google Scholar
- T. Blaschke, “Object based image analysis for remote sensing,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 65, no. 1, pp. 2–16, 2010. View at: Publisher Site | Google Scholar
- H. J. Kux and E. H. G. Araújo, “Object-based image analysis using QuickBird satellite images and GIS data, case study Belo Horizonte (Brazil),” in Object Based Image Analysis, T. Blaschke, S. Lang, and G. J. Hay, Eds., pp. 571–588, Springer, Heidelberg, Berlin, New York, 2008. View at: Google Scholar
- P. Pu, S. Landry, and Q. Yu, “Object-based urban detailed land cover classification with high spatial resolution IKONOS imagery,” International Journal of Remote Sensing, vol. 32, no. 12, pp. 3285–3308, 2011. View at: Publisher Site | Google Scholar
- F. Hájek, “Object-oriented classification of Ikonos satellite data for the identification of tree species composition,” Journal of Forest Science, vol. 52, no. 4, pp. 181–187, 2012. View at: Google Scholar
- M. Immitzer, C. Atzberger, and T. Koukal, “Tree species classification with random forest using very high spatial resolution 8-band WorldView-2 satellite data,” Remote Sensing, vol. 4, no. 9, pp. 2661–2693, 2012. View at: Publisher Site | Google Scholar
- S.-R. Kim, W.-K. Lee, D.-A. Kwak et al., “Forest cover classification by optimal segmentation of high resolution satellite imagery,” Sensors, vol. 11, no. 2, pp. 1943–1958, 2011. View at: Publisher Site | Google Scholar
- Z. Kaszta, R. V. D. Kerchove, A. Ramoelo et al., “Seasonal separation of African savanna components using Worldview-2 imagery: a comparison of pixel and object-based approaches and selected classification algorithms,” Remote Sensing, vol. 8, no. 9, article 763, 2016. View at: Publisher Site | Google Scholar
- R. Shojanoori, H. Z. M. Shafri, S. Mansor, and M. H. Ismail, “The use of WorldView-2 satellite data in urban tree species mapping by object-based image analysis technique,” Sains Malaysiana, vol. 45, no. 7, pp. 1025–1034, 2016. View at: Google Scholar
- P. Gong and A. Zhang, “Noise effect on linear spectral unmixing,” Geographic Information Sciences, vol. 5, no. 1, pp. 52–57, 1999. View at: Publisher Site | Google Scholar
- H. Liu and C. Wu, “Crown-level tree species classification from AISA hyperspectral imagery using an innovative pixel-weighting approach,” International journal of applied earth observation and geoinformation, vol. 68, pp. 298–307, 2018. View at: Publisher Site | Google Scholar
- D. A. Roberts, M. Gardner, R. Church, S. Ustin, G. Scheer, and R. O. Green, “Mapping chaparral in the Santa Monica Mountains using multiple endmember spectral mixture models,” Remote Sensing of Environment, vol. 65, no. 3, pp. 267–279, 1998. View at: Publisher Site | Google Scholar
- D. A. Roberts, P. E. Dennison, M. Gardner, Y. Hetzel, S. L. Ustin, and C. Lee, “Evaluation of the potential of Hyperion for fire danger assessment by comparison to the airborne visible/infrared imaging spectrometer,” IEEE Transactions on Geoscience and Remote Sensing, vol. 41, no. 6, pp. 1297–1310, 2003. View at: Publisher Site | Google Scholar
- M. M. Moore and M. E. Bauer, “Classification of forest vegetation in North-Central Minnesota using Landsat multispectral scanner and thematic mapper data,” Forest Science, vol. 3, no. 2, pp. 330–342, 1990. View at: Google Scholar
- I. M. Hasmadi, J. Kamaruzaman, and M. A. N. Hidayah, “Analysis of crown spectral characteristic and tree species mapping of tropical forest using hyperspectral imaging,” Journal of Tropical Forest Science, vol. 22, no. 1, pp. 67–73, 2010. View at: Google Scholar
- R. Pu, “Chapter 14. Tree species classification,” in Remote Sensing of Natural Resources, G. Wang and Q. Weng, Eds., pp. 239–258, CRC Press, Taylor & Francis Group, 2014. View at: Google Scholar
- M. Karlson, M. Ostwald, H. Reese, H. R. Bazié, and B. Tankoano, “Assessing the potential of multi-seasonal WorldView-2 imagery for mapping West African agroforestry tree species,” International Journal of Applied Earth Observation and Geoinformation, vol. 50, pp. 80–88, 2016. View at: Publisher Site | Google Scholar
- S. Yan, L. Jing, and H. Wang, “A new individual tree species recognition method based on a convolutional neural network and high-spatial resolution remote sensing imagery,” Remote Sensing, vol. 13, article 479, 2021. View at: Google Scholar
- M. Roffey and J. Wang, “Evaluation of features derived from high-resolution multispectral imagery and LiDAR data for object-based support vector machine classification of tree species,” Canadian Journal of Remote Sensing, vol. 46, no. 4, pp. 473–488, 2020. View at: Publisher Site | Google Scholar
- J. Yang, Y. He, and J. Caspersen, “Individual tree-based species classification for uneven-aged, mixed-deciduous forest using multi-seasonal WorldView-3 images,” IGARSS 2017, pp. 827–830, 2017. View at: Google Scholar
- Y. Dian, Y. Pang, Y. Dong, and Z. Li, “Urban tree species mapping using airborne LiDAR and hyperspectral data,” Journal of the Indian Society of Remote Sensing, vol. 44, no. 4, pp. 595–603, 2016. View at: Publisher Site | Google Scholar
- I. Chuine and E. G. Beaubien, “Phenology is a major determinant of tree species range,” Ecology Letters, vol. 4, no. 5, pp. 500–510, 2001. View at: Publisher Site | Google Scholar
- J. Li, B. Hu, and M. Woods, “A two-level approach for species identification of coniferous trees in central Ontario forests based on multispectral images,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 8, no. 4, pp. 1487–1497, 2015. View at: Publisher Site | Google Scholar
- R. Pu, “Mapping urban forest tree species using IKONOS imagery: preliminary results,” Environmental Monitoring and Assessment, vol. 172, no. 1-4, pp. 199–214, 2011. View at: Publisher Site | Google Scholar
- P. A. Townsend and S. J. Walsh, “Remote sensing of forested wetlands: application of multitemporal and multispectral satellite imagery to determine plant community composition and structure in southeastern USA,” Plant Ecology, vol. 157, no. 2, pp. 129–149, 2001. View at: Publisher Site | Google Scholar
Copyright
Copyright © 2021 Ruiliang Pu. Exclusive Licensee Aerospace Information Research Institute, Chinese Academy of Sciences. Distributed under a Creative Commons Attribution License (CC BY 4.0).