Научная статья на тему 'EVALUATION OF THE QUALITY OF AUTOMATIC TREE DETECTION USING PHOTOGRAMMETRIC CANOPY HEIGHT MODELS AND ORTHOMOSAIC'

EVALUATION OF THE QUALITY OF AUTOMATIC TREE DETECTION USING PHOTOGRAMMETRIC CANOPY HEIGHT MODELS AND ORTHOMOSAIC Текст научной статьи по специальности «Медицинские технологии»

CC BY
66
23
i Надоели баннеры? Вы всегда можете отключить рекламу.
Журнал
Ecosystem Transformation
Ключевые слова
Kologrivsky Forest Nature Reserve / quadcopter / neural network / Agisoft Metashape / lidR / rLiDAR / DeepForest / ЗАПОВЕДНИК «КОЛОГРИВСКИЙ ЛЕС» / КВАДРОКОПТЕР / НЕЙРОННАЯ СЕТЬ / AGISOFT METASHAPE / LIDR / RLIDAR / DEEPFOREST

Аннотация научной статьи по медицинским технологиям, автор научной работы — Natalya V. Ivanova, Aleksandr V. Lebedev, Maхim P. Shashkov

The work was performed in the old-growth linden-spruce forest of the Kologrivsky Forest Nature Reserve (Kostroma Oblast, Russia) based on aerial photography with a quadcopter. Automatic detection algorithms made it possible to detect most of the trees in the forest canopy. Tree detection by orthomosaic using neural network algorithm ‘DeepForest’ turned out to be of better quality than detection based on the canopy height model using an algorithm based on the sliding window method. As a rule, both methods showed better results for conifers compared to deciduous trees. Comparison of the average heights of trees estimated from remote data and measured by ground survey did not reveal significant differences. Additional ground surveys to assess the quality of undergrowth detection are needed.

i Надоели баннеры? Вы всегда можете отключить рекламу.
iНе можете найти то, что вам нужно? Попробуйте сервис подбора литературы.
i Надоели баннеры? Вы всегда можете отключить рекламу.

ОЦЕНКА КАЧЕСТВА АВТОМАТИЧЕСКОГО ДЕТЕКТИРОВАНИЯ ДЕРЕВЬЕВ ПО ФОТОГРАММЕТРИЧЕСКИМ МОДЕЛЯМ ВЫСОТ И ОРТОФОТОПЛАНАМ

Работа выполнена в малонарушенном ельнике липняковом заповедника «Кологривский лес» (Костромская обл.) на основе данных аэрофотосъемки квадрокоптером. Алгоритмы автоматического детектирования позволили выделить большинство деревьев в пологе леса. Детектирование деревьев по ортофотоплану с использованием нейросетевого алгоритма Deep Forest оказалось более качественным, чем детектирование по модели высот при помощи алгоритма, основанного на методе скользящего окна. Как правило, оба метода демонстрировали более качественные результаты для хвойных деревьев по сравнению с лиственными. Сравнение средних высот деревьев, оцененных по дистанционным данным и измеренных наземными методами, не выявило значимых различий. Показана необходимость дополнительных наземных обследований для оценки качества детектирования подроста.

Текст научной работы на тему «EVALUATION OF THE QUALITY OF AUTOMATIC TREE DETECTION USING PHOTOGRAMMETRIC CANOPY HEIGHT MODELS AND ORTHOMOSAIC»

feiy^ Трансформация экосистем issn 2619-0931 online

. www.ecosysttrans.com

/L •;.• Ecosystem Transformation

Article

Evaluation of the quality of automatic tree detection using photogrammetric canopy height models and orthomosaic

Natalya V. Ivanova1* ,Aleksandr V. Lebedev2 3 , Maxim P. Shashkov1

11nstitute of Mathematical Problems of Biology RAS - the Branch of Keldysh Institute of Applied Mathematics of Russian Academy of Sciences, ul. professora Vitkevicha 1, Pushchino, Moscow Oblast, 142290 Russia

2 Russian State Agrarian University - Moscow Timiryazev Agricultural Academy, ul. Timiryazevskaya 49, Moscow, 127434 Russia

3 Kologrivsky Forest Nature Reserve, ul. Nekrasova 48, Kologriv, Kostroma Oblast, 157440 Russia *natalya.dryomys@gmail.com

Received: 18.04.2022 Revised: 01.07.2022 Accepted: 04.07.2022 Published online: 02.06.2023

DOI: 10.23859/estr-220418 UDC 528.7:630*587.2

Translated by D.M. Martynova

Abstract. The work was performed in the old-growth linden-spruce forest of the Kologrivsky Forest Nature Reserve (Kostroma Oblast, Russia) based on aerial photography with a quadcopter. Automatic detection algorithms made it possible to detect most of the trees in the forest canopy. Tree detection by orthomosaic using neural network algorithm 'DeepForest' turned out to be of better quality than detection based on the canopy height model using an algorithm based on the sliding window method. As a rule, both methods showed better results for conifers compared to deciduous trees. Comparison of the average heights of trees estimated from remote data and measured by ground survey did not reveal significant differences. Additional ground surveys to assess the quality of undergrowth detection are needed.

Key words: Kologrivsky Forest Nature Reserve, quadcopter, neural network, Agisoft Metashape, lidR, rLiDAR, DeepForest

To cite this article. Ivanova, N.V. et al., 2023. Evaluation of the quality of automatic tree detection using photogrammetric canopy height models and orthomosaic. Ecosystem Transformation 6 (2), 33-48. https://doi.org/10.23859/estr-220418

Научная статья

Оценка качества автоматического детектирования деревьев по фотограмметрическим моделям высот и ортофотопланам

Н.В. Иванова1* , A.B. Лебедев2 3 , М.П. Шашков1

1 Институт математических проблем биологии РАН - филиал ИПМ им. М.В. Келдыша РАН, 142290, Россия, Московская область, г. Пущино, ул. проф. Виткевича, д. 1

2 Российский государственный аграрный университет - МСХА им. К.А. Тимирязева, 127434, Россия, г. Москва, ул. Тимирязевская, д. 49

3 Государственный заповедник «Кологривский лес» им. М.Г. Синицына, 157440, Россия, Костромская обл., г. Кологрив, ул. Некрасова, д. 48

*natalya.dryomys@gmail.com

Поступила в редакцию: 18.04.2022 Доработана: 01.07.2022 Принята к печати: 04.07.2022 Опубликована онлайн: 02.06.2023

РСН: 10.23859^г-220418 УДК 528.7:630*587.2

Аннотация. Работа выполнена в малонарушенном ельнике липняковом заповедника «Кологривский лес» (Костромская обл.) на основе данных аэрофотосъемки квадрокоптером. Алгоритмы автоматического детектирования позволили выделить большинство деревьев в пологе леса. Детектирование деревьев по ортофотоплану с использованием нейросетево-го алгоритма Deep Forest оказалось более качественным, чем детектирование по модели высот при помощи алгоритма, основанного на методе скользящего окна. Как правило, оба метода демонстрировали более качественные результаты для хвойных деревьев по сравнению с лиственными. Сравнение средних высот деревьев, оцененных по дистанционным данным и измеренных наземными методами, не выявило значимых различий. Показана необходимость дополнительных наземных обследований для оценки качества детектирования подроста.

Ключевые слова: заповедник «Кологривский лес», квадро-коптер, нейронная сеть, Agisoft Metashape, lidR, rLiDAR, DeepForest

Для цитирования. Иванова, Н.В. и др., 2023. Оценка качества автоматического детектирования деревьев по фотограмметрическим моделям высот и ортофотопланам. Трансформация экосистем 6 (2), 33-48. https://doi.org/10.23859/estr-220418

Introduction

Data on the spatial structure of forest stands are demanded for solving many fundamental and applied problems in forest ecology and forest management (Alonzo et al., 2018; Bennett et al., 2020; Otero et al., 2018; Puliti et al., 2015). At the same time, it is necessary to analyse large amounts of actual data on the structure of stands and the characteristics of individual trees in order to obtain reliable results; these data are often difficult to obtain using traditional ground survey methods (Anderson and Gaston, 2013; Pajares, 2015; Zhang et al., 2016a). A promising approach for the rapid collection of such data is aerial photography by unmanned aerial vehicles (UAVs), or quadcopters. The quadcopter retains the set altitude during the entire flight, moves along a planned in advance route, taking a series of photos automatically with overlap at a fixed camera orientation angle. Photogrammetric processing of these images allows obtaining three-dimensional point clouds, two-dimensional raster RGB (Red, Green, Blue) orthomosaic, and digital elevation models, by which it is possible to estimate the spatial position of the studied objects (in a given coordinate system), as well measure their size.

Based on point clouds and digital height models and using ready-made algorithms, it is possible to automatically detect (i.e., find) tree tops, estimate their heights, trunk diameters and crown sizes with high accuracy (Birdal et al., 2017; Ivanova et al., 2021; Krisanski et al., 2020; Medvedev et al., 2020; Mohan et al., 2017). At the same time, the results published so far are mainly obtained in mono- or oligo-dominant forests, which were often managed (Miller et al., 2017; Picos et al., 2020). In addition, the quality of detection and height estimation of trees with a cone-shaped crown is higher compared to trees with a spherical crown (Alonzo et al., 2018; Bennett et al., 2020; Ivanova et al., 2020).

Methods based on artificial intelligence, computer vision, and machine learning algorithms are promising for analysing the structure of forest stands using orthoimage. In recent years, such methods have been widely used in ecology to address matters related to the analysis and segmentation of images (Christin et al., 2019; Lamba et al., 2019). The advantage of this approach is that the accumulated array of images of global coverage, primarily satellite imagery, may be used for analysis (Weinstein et al., 2020). For example, D.E. Kislov and K.A. Korznikov (2020) have assessed windthrow disturbances using remote data and a neural network. M. Onishi and T. Ise (2021) successfully detected tree crowns from orthoimage in the mixed forests of Japan using deep learning methods.

The study aims to evaluate the quality of tree top detection using photogrammetric canopy height mo-

Fig. 1. Permanent sampling plot on the orthoimage.

dels and orthomosaic. The research was performed on the territory of the Kologrivsky Forest Nature Reserve in a mixed old-growth forest stand.

Materials and methods

Research object

The Kologrivsky Forest Nature Reserve is located in the north-eastern part of the Kostroma Oblast and co ns ists of two cl uste rs (M a nt u ro vs ky and Ko log ri vs ky). The total area of the Reserve is 58939.6 ha. Reserve became part of the biosphere reserve of the same name as a part of the UNESCO Man and the Biosphere Program (https://en.unesco.org/biosphere/eu-na/ kologrivsky-forest) in 2020. The old coniferous-broad-leaved forest tract (area of 918 hectares), located on the territory of the Kologrivsky cluster (the so-called "core" of the Reserve), is of greatest interest for study (Korennye..., 1988). According to the literature data, the core spruce forests have not been impacted by anthropogenic disturbances over the past 350400 years (Ivanov et al., 2012; Khoroshev et al., 2013). The tree layer of these forests includes Picea abies (L.) Karst., Abies sibirica Ledeb., Tilia cordata Mill., Ulmus glabra Huds., Acer platanoides L., and Betula pubescens Erh. The stands are uneven-aged

and multilayered. The forests of the reserve "core" were significantly damaged by the storm (Lebedev and Chistyakov, 2021b); in 2021, however, some fragments of old-growth southern taiga spruce forests have remained. This work was carried out on a permanent sample plot, which was slightly affected by the consequences of a catastrophic windthrow.

The surveyed sample plot with a size of 200*50 m (1 ha) was established in 1983, a re-survey was carried out in 2017. The area consists of two adjoining subplots of 0.5 ha each: 11/83 and 12/83, according to the numbering adopted in the reserve (Fig. 1). Forest inventory attributes for 2017 are presented in Table 1 (Lebedev and Chistyakova, 2021a). In 2017, an active fragmentation of spruce stands was recorded due to the natural fallout of large spruce trees.

Methods for collecting and analysing the field data

Aerial photography of the sample plot was carried out on August 27 and 28, 2021, with a DJI Phantom 4 quadcopter in mosaic mode flight from a height of 336 m with 80% overlap of photographs (for the entire territory of the reserve "core") and from a height of 154 m with 95% overlap (for the sample plot). Flight plans were arranged with a buffer zone to avoid the edge effect during data processing. The photogrammetric processing of the obtained images was carried out using the Agisoft Metashape v. 1.5 program (2019), where dense point clouds were built: (1) for the sample plot with a density of 436.9 points/ m2 (Fig. 2), and (2) orthomosaic with a resolution of 5

and 10 cm/pixel for the sample plot and the entire territory of the reserve "core", respectively.

Since the published data on the state of forest stands at the sample plot were collected prior to the catastrophic windthrow, the windthrow damage was assessed first. To do this, manual vectorization of all visually distinguishable trunks of fallen trees was performed according to the orthoimage. The histogram of the distribution of pixel height values in the digital height model was also analysed.

A canopy height model was used to detect tree tops. The dense point cloud was processed in the R environment (R Core Team, 2021) using lidR v. 3.1.2 (Roussel et al., 2020) and rLiDAR (Silva et al., 2018). These open-source packages are designed to process airborne laser scanning (LiDAR) data and photogrammetric point clouds, as well as elevation models derived from them. The canopy height model was built on the basis of a photogrammetric point cloud using the functions of the lidR package. First, points of the ground points class were selected using the cloth algorithm simulation filtering (Zhang et al., 2016b) implemented in the classify_ground() function. Then, using the normalize_height() function, the point cloud was normalised according to the level of the ground points using the 'tin' (triangular interpolation network). After that, a tree canopy height model was built using the pit-free algorithm (Khosravipour et al., 2014) by the grid_canopy() function. As a result, a tree canopy height model with a spatial resolution of 40 cm/pixel was obtained. Based on this height model, tree tops were automatically detected using

Table 1. Forest inventory attributes of the forest stands on the studied permanent trial plot in 2017 (according to: Lebedev and Chistyakov, 2021a, with modifications).

Subplot Tree Age, years Average tree Average tree diameter, cm height, m Number of trees, ind./ha Sum of basal areas, m2/ha Stock, m3/ha

Spruce 130 25.7 23.4 200 11.4 145

Birch 135 40.6 28.2 48 6.2 81

Linden 115 32.3 22.1 224 18.4 191

11/83 Fir 100 12.6 14.4 8 0.1 1

Maple 30 10.8 12.6 22 0.2 1

Willow 100 35.7 21.8 8 0.8 8

Total 130 530 37.1 427

Spruce 125 30.2 26.1 142 10.2 136

Birch 135 29.7 25.1 26 1.8 19

12/83 Linden 115 29.5 21.2 152 10.4 103

Maple 20 8.0 11.8 4 0 0

Total 120 324 22.4 258

a sliding-window algorithm implemented in the FindTreesCHM() function of the rLiDAR package. We have tested different combinations of the sliding window of a specified size (fws argument) and the minimum tree height (minht argument).

In order to select individual trees according to the orthomosaic, we used a pretrained neural network available in the 'DeepForest' library implemented in the Python environment (Weinstein et al., 2020). This neural network is built on the basis of semi-supervised learning. The model involves the input of small amounts of labelled data to complement the datasets that do not have labels. Labelled data is used to run the system and may significantly increase the speed and accuracy of learning. The model used in 'DeepForest' was trained by developers on descriptions of 24 forest sites of the US National Environmental Monitoring Network. The data included 434551 automatically found trees and 2848 manually labelled trees (Weinstein et al., 2019). In our study, we tested different tile sizes for tree detection: 200, 400, 600, and 800 pixels, as recommended by the developers. The analysis was carried out using an orthoimage with a resolution of 10 cm/pixel.

The following values were calculated to assess the quality of the results of automatic detection: TP (true positive) is the number of trees correctly detected by the algorithm; FP (false positive) is the number of false positives of the algorithm, when a tree is either detected automatically, but is absent in the tree stand, or the found top belongs to an already detected tree; FN (false negative) is the number of missed trees that

exist in the area, but were not detected automatically (Fig. 3).

The number of correctly detected trees (true positive, TP) and false positives (FP) was estimated based on visual analysis of the orthomosaic. Since detailed data of the sample plot recalculation were not available for 2017, all trees were manually detected in the QGIS environment (QGIS Development Team, 2019) using a digital elevation model and an orthomosaic in order to estimate the number of trees omitted by the algorithm (FN). In particular, the crown margins were expertly determined for each tree visually recognized on the orthoimage, then the tree top was marked for each tree guided by the height model. After that, FN was calculated as the difference between the number of manually detected trees and the number of tops correctly detected automatically. The evaluation was performed only for stands (height > 20 m) because reliable visual detection of undergrowth trees and undergrowth in windows was often not possible. All trees (TP, FP, and FN) were indicated as belonging to deciduous or coniferous on the basis of an expert assessment according to the orthoimage. Then the scores adopted for the analysis of the quality of automatic detection were calculated (Goutte and Gaussier, 2005; Li et al., 2012; Sokolova et al., 2008).

The score p (precision) indicates the quality of tree detection; it is calculated as the proportion of trees correctly detected by the algorithm (true positive, TP) and the number of all trees found automatically:

Fig. 2. Photogrammetric point cloud in R environment.

Fig. 3. Correctly detected trees (true positive = TP), false positives (FP), and trees missed by the algorithm (false negative = FN) on a fragment of an orthomosaic.

The score r (recall) indicates the completeness of tree detection by the algorithm; it is calculated as the proportion of trees correctly detected automatically (TP) relative to the number of manually detected trees (i.e., growing on the sample plot):

F-score indicates the general quality of the results, taking into account r and p; it is calculated by the formula:

The more trees omitted by the algorithm, the smaller the value of r; low p values indicate a high number of false positives (FP). The F-value is high at high values of r and p, i.e., when most of the trees available in the area (in this case, manually detected) are found automatically and when the number of missed trees (false negative, FN) and false positives is small. Rating values may vary from 0 to 1; in the literature, the detection quality is described as high if

r, p, and F > 0.8 (Chen et al., 2022; Gongalves et al., 2022; Ivanova et al., 2021; Silva et al., 2016).

According to the results of processing the digital height model, the scores were calculated for different combinations of arguments of the FindTreesCHM() function. In each variant, the values obtained for all data were analysed only for the stand (> 20 m) and undergrowth (< 20 m). Based on the results of the orthomosaic processing using a neural network, scores were calculated for different options for the size of the tile, but only for the forest stand.

Results and discussion

According to the visual analysis of the orthoimage and canopy height model, the woody vegetation on the studied sample plot has a heterogeneous vertical structure (Figs. 1, 4, 5). It is known that the canopy height model reflects only its upper layer, so the type of the distribution of pixel heights may reveal the presence of heterogeneities and discontinuities in the canopy (Portnov et al., 2021). Two peaks are clearly visible on the histogram of the distribution of pixel height values obtained in the digital tree canopy

height model (Fig. 4). The left one corresponds to the vegetation in the canopy gaps, the right one, to the groups of the largest trees forming the stand. At the same time, the number of pixels corresponding to large trees is small, and the distribution shape differs from that specific to dense canopy, but it is closer to the areas where there are gaps in the forest stand (Ivanova and Shashkov, 2022; Portnov et al., 2021).

In addition, during remote sensing, there was no dense forest stand on subplot 11/83, and only individual large trees remained. Woody vegetation was mainly represented by undergrowth, while only single fallen trunks were visible on the orthoimage in places where there was no forest stand. This suggested that the fragmentation of the stand occurred before the catastrophic windthrow due to natural reasons, which was consistent with the results of the 2017 re-survey. Trees that fell several years ago may be hidden by layers of undergrowth and, therefore, were not visible on the orthoimage. The trees that fell as a result of a catastrophic windthrow were detected in this subplot, mainly from neighbouring areas (Fig. 1). In subplot 12/83, the number of large trees was greater than in subplot 11/83; the tree layer had gaps. A strip of fallen trees was clearly visible, oriented from the southwest to the northeast; most likely, these trees were felled by a storm in 2021. There were also small gaps, in which fallen trees were indistinguishable from the orthoimage. Apparently, they were formed before

the catastrophic windthrow as a result of the fall of individual large trees. Therefore, the woody vegetation of the studied area was heterogeneous; it was formed both as a result of the long-term natural dynamics of forest stands and because of severe windthrow timber.

From 82 to 320 tree tops were detected throughout the sample plot as a result of automatic detection of tree tops using a digital elevation model with different options for the FindTreesCHM() function arguments (Fig. 5, Table 2). In total, 136 trees were mapped (51 coniferous and 85 deciduous) by manual detection of trees in the upper layer. When comparing these data with the orthomosaic, the best results were obtained using a sliding window of 5 pixels and with a minimum height of detected trees of 10 or 15 m. The results of these experiments were used to quantify the quality of detection.

When assessing the quality of the results of automatic detection, performed for all trees and separately for layers, a high quality of the search for p was obtained for both analysed combinations of FindTreesCHM() function arguments (Table 3). This evidenced that the algorithm found tree tops correctly in most cases. At the same time, the quality of detection of coniferous trees was higher than that of deciduous trees.

The completeness of detection r was assessed only for the forest stand. For deciduous trees, this parameter was quite high and comparable in both

o o o o

o o o

CO

o o o

CD

o o o

'Si-

Ci o o CM

r o

5

10

15

20

25

n 30

Height, m

Fig. 4. Distribution histogram of the pixel height values in the digital height model. The colors correspond to the legend in Fig. 5.

Table 2. Results of automatic detection of the digital elevation model with different variants of the FindTreesCHM() arguments (minht and fws).

Minimum tree height (minht), m

Sliding window of a specified size (fws), pixels (m)

Number of detected tree tops, ind.

Tot. Including that Iotal_of height > 20 m

iНе можете найти то, что вам нужно? Попробуйте сервис подбора литературы.

10 10 15 20

3 (1.2) 5 (2) 5 (2) 5 (2)

320 174 134 82

217 134 125 82

Fig. 5. Results of automatic detection of tree tops using a digital height model for different values of the FindTreesCHM () function arguments: A - at minht = 10, fws = 5; B - at minht = 15, fws = 5; C - results of manual tree detection.

experiments, while the value of the r estimate was higher than p. This indicated that the algorithm found false tops more often than omitted trees when detecting deciduous trees. Both estimates were high for coniferous trees at minht = 10, the value of r was slightly lower than p. At minht = 15, the estimate of r was low (much lower than p). Therefore, the algorithm omitted coniferous trees more often than it found false tops.

F estimates, which indicates the general detection quality, were rather high. The highest value (0.95) was obtained for coniferous trees at minht = 10, the

lowest value (0.78), for deciduous trees at minht = 10. In both experiments, the F values for coniferous trees were higher than for deciduous trees.

As a result of tree detection by orthomosaic using the 'DeepForest' neural network algorithm, the best results were obtained with tile sizes of 400 and 600 pixels. With a tile size of up to 400 pixels, the model identified too fractional objects, due to which the largest crowns were recognized as sets of several small ones. On the contrary, when the tile size was more than 800 pixels, the crowns of several adjacent trees were detected as one tree.

When using a tile of 400 pixels, 381 trees were detected, and 218 trees with a tile of 600 pixels. The detected trees belonged both to the forest stand and to the undergrowth, so their number was higher than that obtained by detection using the height model.

The evaluation of the quality of the neural network results was performed only for the forest stand. It was noted that its tree detection accuracy was higher in comparison with the canopy height model (Table 4); at the same time, as a rule, coniferous trees were also detected better than deciduous ones. In all cases, p was higher than r, i.e., the neural network omitted trees more often than found false ones (in this case, it combined several trees into one crown). The general quality of detection, F, was high. According to this assessment, in the first experiment, the detection accuracy of coniferous and deciduous trees was the same, in the second, the results obtained for coniferous trees were of better quality.

Generally, we conclude that it is possible to identify most of the trees in the forest stand with high accuracy in the studied area of the mixed forest with the help of ready-made algorithms. As it was concluded in our previous research performed in pine and pine-spruce forests on the territory of the Prioksko-Terrasny Biosphere Reserve, the presence of trees of several species in the forest stand, pronounced layering and gaps in the forest canopy can reduce the quality of tree detection using digital elevation models (Ivanova et al., 2021). In the present study, the quality of detection is generally high, despite the polydominance and heterogeneous vertical structure of woody vegetation. Apparently, this result is explained by the absence of closed canopy in the studied area and by mature trees located singly or in groups. At the same time, the crowns of individual trees are well distinguished on the canopy height model and on the orthoimage even in the case of a group arrangement. Apparently, the low population density of trees has become the main factor for their successful detection. This conclusion fits well to earlier publications stating that the quality of tree segmentation in sparse stands is higher than in closed stands (Alonzo et al., 2014, 2018; Kolarik et al., 2020; Medvedev et al., 2020).

It is also important to note that deep learning-based tree segmentation methods continue to be actively developed. Thus, M. Onishi and T. Ise (2021) both segmented tree crowns in mixed closed deciduous forests successfully and identified nine classes of trees with high accuracy. Further development of these methods will make it possible to obtain more accurate estimates describing the structure of forest stands and to predict their dynamics.

Our results also evidence of a higher quality of detection of coniferous trees compared to deciduous ones. All coniferous trees presented at the sample plot (mainly spruce, with a small amount of fir) have

a well-defined top. Large deciduous trees (birch and linden), on the contrary, had spherical crowns, so the algorithm often found several tops within each one. In general, this result is expected and is consistent with the data available in the literature (Alonzo et al., 2018; Bennett et al., 2020; Ivanova et al., 2020).

The development of a methodology for a more complete account of undergrowth is of significant interest for further research. Obviously, it is necessary to use a smaller sliding window than for detecting mature trees to solve this problem based on the canopy height model; in addition, higher resolution canopy height models are likely to be required. The results of preliminary experiments (original unpublished data) allow to conclude that it is possible to detect a large number of tree tops that form the undergrowth layer using a height model with a resolution of 40 cm/ pixel. When using the 'DeepForest' neural network, a promising way to improve the results is to train the model on data from areas adjacent to the sample plot. This approach is recommended by the developers to better take into account the local characteristics of forest stands (Weinstein et al., 2020). In any case, the assessment of the quality of these results is not possible without ground survey data.

We have also shown that the automatically obtained estimates of average tree heights are in good agreement with the results of ground measurements (Table 5), but it is impossible to make a detailed comparison at the level of individual trees due to the lack of more detailed data. Nevertheless, our results are consistent with the conclusions obtained at other sites about the good convergence of these estimates (Bennet et al., 2020; Birdal et al., 2017; Panagiotidis et al., 2017). At the same time, it should be noted that automatic height estimates may have errors associated with artefacts of photogrammetric cloud processing when selecting points of the "ground points" class. In addition, ground-based height measurements, especially of large deciduous trees, may have significant errors due to the ambiguity of the definition of the tree top (Alonzo et al., 2018; Bennett et al., 2020; Ivanova et al., 2021).

Conclusions

This work presents the results of a study of the structure of forest stands based on orthoimage and photogrammetric models of tree canopy heights, which is a new and actively developing direction in Russia. Old-growth southern taiga spruce forests with a complex tree stand structure have been studied.

Despite the presence of several species of trees and the spatial heterogeneity of the forest stand, ready-made algorithms for processing aerial photography data make it possible to detect most of trees in the forest canopy with confidence. The quality of detection results from an orthoimage using a neural network is higher than the quality of detection from a digital

Table 3. Evaluation of the quality of the results of automatic detection of tree tops on a permanent sample plot using a digital height model.

FindTreesCHM() arguments Detected trees TP All trees FP P Tree height < 20 m TP FP P TP Tree height > 20 m FP FN p r F

Coniferous 56 0 1 10 0 1 46 0 5 1 0.90 0.95

minht = 10 fws = 5 Deciduous 94 24 0.80 26 4 0.87 68 20 17 0.77 0.80 0.78

Total 150 24 0.86 36 4 0.90 114 20 22 0.85 0.84 0.84

Coniferous 39 0 1 2 0 1 37 0 14 1 0.72 0.84

minht = 15 fws = 5 Deciduous 76 19 0.80 6 1 0.86 70 18 15 0.79 0.82 0.80

Total 115 19 0.86 8 1 0.89 107 18 29 0.86 0.79 0.82

Table 4. Evaluation of the quality of the results of detection of trees of the upper layer on a permanent sample plot using a neural network.

Tile size, pixels Detected trees TP FP FN P r F

Coniferous 45 0 6 1 0.88 0.94

400 Deciduous 76 3 6 0.96 0.93 0.94

Total 121 3 12 0.98 0.91 0.94

Coniferous 45 2 4 0.96 0.92 0.94

600 Deciduous 58 5 22 0.92 0.73 0.81

Total 103 7 26 0.94 0.80 0.86

Table 5. Comparison of tree heights based on ground measurements in 2017 and estimates obtained from aerial photography data in 2021. SD is the standard deviation, min is the minimum height, max, the maximum height.

Tree type

Average tree height, ground measurements (2017), m

Tree height, Canopy Height Model (2021), mean ± SD (min, max), m

Coniferous Deciduous

All trees

21.3

20.4

23.5 ± 3.7 (14.5, 30.0) 21.4 ± 4.0 (11.1, 29.0)

Coniferous Deciduous

Tree height > 20 m 24.8 24.9 ± 2.5 (20.0, 30.0)

24.1 23.4 ± 1.8 (20.2, 29.0)

elevation model using an algorithm based on the sliding window method. In both cases, the detection quality of coniferous trees is generally slightly higher than that of deciduous trees. The average heights estimated from digital height models are in good agreement with the results of ground measurements. Additional ground surveys are required to assess the quality of undergrowth detection.

In general, the obtained results confirm that the remote data collected by means of UAVs make it possible to obtain realistic estimates of the characteristics of forest stands. We conclude that the use of these methods in forestry practice is quite promising for carrying out planned forest inventory work, as well as for promptly obtaining data on the state of forest stands after catastrophic events. The use of this approach is especially relevant for hard-to-reach areas where in situ studies are difficult to perform.

ORCID

N.V. Ivanova 0000-0003-4199-5924

A.V. Lebedev 0000-0002-8939-942X

M.P. Shashkov 0000-0002-1328-8758

Funding

The work was carried out within the budget themes for Institute of Mathematical Problems of Biology RAS - the Branch of Keldysh Institute of Applied Mathematics of Russian Academy of Sciences and the Kologrivsky Forest Nature Reserve.

References

Agisoft LLC,. 2019. Agisoft Metashape (Version 1.5). Software. URL: https://www.agisoft.com/

Alonzo, M., Bookhagen, B., Roberts, D.A., 2014. Urban tree species mapping using hyperspectral and LiDAR data fusion. Remote Sensing of Environment 148, 70-83 http://www.doi. org/10.1016/j.rse.2014.03.018

Alonzo, M., Andersen, H.E., Morton, D.C., Cook, B.D., 2018. Quantifying boreal forest structure and composition using UAV structure from motion. Forests 9 (3), 119. http://www.doi.org/10.3390/ f9030119

Anderson, K., Gaston, K.J., 2013. Lightweight unmanned aerial vehicles will revolutionize spatial ecology. Frontiers in Ecology and the Environment 11 (3), 138-146. http://www.doi. org/10.1890/120150

Bennett, G., Hardy, A., Bunting, P., Morgan, P., Fricker, A., 2020. A transferable and effective method for monitoring continuous cover forestry at the individual tree level using UAVs. Remote

Sensing 12 (13), 2115. http://www.doi.org/10.3390/ rs12132115

Birdal, A.C., Avdan, U., Türk, T., 2017. Estimating tree heights with images from an unmanned aerial vehicle. Geomatics, Natural Hazards and Risk 8 (2), 1144-1156. http://www.doi.org/10.1080/19475 705.2017.1300608

Chen, Q., Gao, T., Zhu, J., Wu, F., Li, X., Lu, D., Yu, F., 2022. Individual tree segmentation and tree height estimation using leaf-off and leaf-on UAV-LiDAR data in dense deciduous forests Remote Sensing 14 (12), 2787. https://doi.org/10.3390/rs14122787

Christin, S., Hervet, É., Lecomte, N., 2019. Applications for deep learning in ecology. Methods in Ecology and Evolution 10, 1632-1644. http:// www.doi.org/10.1111/2041-210X.13256

Gongalves, V.P., Ribeiro, E.A.W., Imai, N.N., 2022. Mapping areas invaded by Pinus sp. from geographic object-based image analysis (GEOBIA) applied on RPAS (Drone) color images. Remote Sensing 14 (12), 2805. https://doi.org/10.3390/rs14122805

Goutte, C., Gaussier, E., 2005. A probabilistic interpretation of precision, recall and F-score, with implication for evaluation. In: Losada, D.E., Fernández-Luna, J.M. (eds.), Advances in Information Retrieval. ECIR 2005. Lecture Notes in Computer Science, vol 3408. Springer, Berlin -Heidelberg, 345-359. https://doi.org/10.1007/978-3-540-31865-1_25

Ivanova, N.V., Shashkov, M.P., 2022. Tree stand assessment before and after windthrow based on open-access biodiversity data and aerial photography. Nature Conservation Research 7 (Suppl. 1), 52-63. https://dx.doi.org/10.24189/ ncr.2022.018

Ivanov, A.N., Butorina, E.A., Baldina, E.A., 2012. Mnogoletnyaya dinamika korennykh yuzhno-taezhnykh el'nikov v zapovednike Kologrivskii les [Long-term dynamics of primary spruce forests (southern taiga) in the Kologriv Forest Nature Reserve]. Vestnik Moskovskogo Universiteta. Seria 5. Geografía [Moscow University Bulletin. Series 5. Geography] 3, 74-79. (In Russian).

Ivanova, N.V., Shashkov, M.P., Shanin, V.N., Grabarnik, P.Ya., 2020. Otsenka kachestva avtomaticheskogo detektirovaniya derev'ev po materialam aerofotos'emki s pomoshch'iu kvadrokoptera [Quality assessment of automatic tree detection based on aerial photography using a

quadcopter]. Doklady mezhdunarodnoi konferentsii «Matematicheskaya biologiya i bioinformatika». Lakhno, V.D. (ed.). T. 8 [Proceedings of the International Conference "Mathematical Biology and Bioinformatics". Lakhno, V.D. (ed.). Vol. 8]. Institute of Mathematical Problems of Biology RAS, Pushchino, Russia, proceeding no. e36. (In Russian). http://www.doi.org/10.17537/icmbb20.31

Ivanova, N.V., Shashkov, M.P., Shanin, V.N., 2021. Issledovanie struktury drevostoev sosnovykh lesov Prioksko-terrasnogo biosfernogo zapovednika (Rossiya) po materialam aerofotos'emki s kvadrokoptera [Study of pine forest stand structure in the Priosko-Terrasny State Nature Biosphere Reserve (Russia) based on aerial photography by quadcopter]. Nature Conservation Research. Zapovednaya nauka. [Nature Conservation Research] 6 (4), 1-14. (In Russian). http://www. doi.org/10.24189/ncr.2021.042

Khoroshev, A.V., Nemchinova, A.V., Koshcheeva, A.S., Ivanova, N.V., Petukhov, I.N., Terentieva, E.V., 2013. Landshaftnye i suktsessionnye faktory sootnosheniya nemoral'nykh i boreal'nykh svoistv travyanogo yarusa v zapovednike Kologrivskii les [Landscape and succession factors determining the balance between nemoral and boreal features of the grass layer in the Kologriv Forest Reserve]. Vestnik Moskovskogo Universiteta. Seria 5. Geografía [Moscow University Bulletin. Series 5. Geography] 5, 11-18. (In Russian).

Khosravipour, A., Skidmore, A.K., Skidmore, M., Wang, T., Hussin, Y., 2014. Generating pit-free canopy height models from airborne LiDAR. Photogrammetric Engineering and Remote Sensing 9, 863-872. http://www.doi.org/10.14358/ PERS.80.9.863

Kislov, D.E., Korznikov, K.A., 2020. Automatic windthrow detection using very-high-resolution satellite imagery and deep learning. Remote Sensing 12 (7), 1145. http://www.doi.org/10.3390/ rs12071145

Kolarik, N.E., Gaughan, A.E., Stevens, F.R., Pricope, N.G., Woodward, K., Cassidy, L., Salerno, J., Hartter, J., 2020. A multi-plot assessment of vegetation structure using a micro-unmanned aerial system (UAS) in a semiarid savanna environment. ISPRS Journal of Photogrammetry and Remote Sensing 164, 84-96. http://www.doi.org/10.1016Zj.isprsjprs.2020.04.011

Korennye temnokhvoinye lesa yuzhnoi taigi (rezervat «Kologrivskii les») [Old dark coniferous forests of

the southern taiga ("Kologrivsky forest" reserve)], 1988. Abaturov Yu.D., Pis'merov A.V., Orlov, A.Ya. et al. (eds.). Nauka, Moscow, Russia, 220 c. (In Russian).

Krisanski, S., Taskhiri, M.S., Turner, P., 2020. Enhancing methods for under-canopy unmanned aircraft system based photogrammetry in complex forests for tree diameter measurement. Remote Sensing 12 (10), 1652. http://www.doi.org/10.3390/ rs12101652

Lamba, A., Cassey, P., Segaran, R.J., Koh, L.P., 2019. Deep learning for environmental conservation. Current Biology 29, R977-R982. http://www.doi. org/10.1016/j.cub.2019.08.016

Lebedev, A.V., Chistyakov, S.A., 2021a. Dolgovremennye nabliudeniya na probnykh ploshchadyakh v drevostoyakh yadra zapovednika «Kologrivskii les» [Long-term observations on permanent sample plots in stands of the Kologrivski Forest Nature Reserve]. Materialy konferentsii «Vklad OOPT v ekologicheskuiu ustoichivost' regionov: sovremennoe sostoianie i perspektivy [Proccedings of the Conference "Contribution of Protected Areas to the Ecological Sustainability of Regions: Current State and Prospects]. Kologriv, Russia, 31-43. (In Russian).

Lebedev, A.V., Chistyakov, S.A., 2021b. Otsenka posledstvii vetrovala 2021 goda na territorii biosfernogo rezervata «Kologrivskii les» [Assessment of the impact of the windfall timber in 2021 on the Kologrvski Forest Biosphere Reserve]. Materialy konferentsii «Vklad OOPT v ekologicheskuiu ustoichivost' regionov: sovremennoe sostoianie i perspektivy [Proccedings of the Conference "Contribution of Protected Areas to the Ecological Sustainability of Regions: Current State and Prospects]. Kologriv, Russia, 71-77. (In Russian).

Li, W., Guo, Q., Jakubowski, M.K., Kelly, M., 2012. A new method for segmenting individual trees from the LiDAR point cloud. Photogrammetric Engineering and Remote Sensing 78 (1), 75-84. http://www.doi.org/10.14358/PERS.78.175

Medvedev, A.A., Telnova, N.O., Kudikov, A.V., Alekseenko, N.A., 2020. Analiz i kartografirovanie strukturnykh parametrov redkostoinykh severo-taezhnykh lesov na osnove fotogrammetricheskikh oblakov tochek [Use of photogrammetric point clouds for the analysis and mapping of structural variables in sparse northern boreal forests]. Sovremennye problemy distantsionnogo zondirovaniya Zemli iz kosmosa [Current Problems

in Remote Sensing of the Earth from Space] 17 (1), 150-163. (In Russian). http://www.doi. org/10.21046/2070-7401-2020-17-1-150-163

Miller, E., Dandois, J.P., Detto, M., Hall, J.S., 2017. Drones as a tool for monoculture plantation assessment in the steepland tropics. Forests 8 (5), 168. http://www.doi.org/10.3390/f8050168

Mohan, M., Silva, C.A., Klauberg, C., Jat, P., Catts, G. et al., 2017. Individual tree detection from Unmanned Aerial Vehicle (UAV) derived canopy height model in an open canopy mixed conifer forest. Forests 8 (9), 340. http://www.doi. org/10.3390/f8090340

Onishi, M., Ise, T., 2021. Explainable identification and mapping of trees using UAV RGB image and deep learning. Scientific Reports 11, 903. http:// www.doi.org/10.1038/s41598-020-79653-9

Otero, V., Van De Kerchove, R., Satyanarayana, B., Martínez-Espinosa, C., Fisol, M.A.B. et al., 2018. Managing mangrove forests from the sky: forest inventory using field data and unmanned aerial vehicle (UAV) imagery in the Matang Mangrove Forest Reserve, peninsular Malaysia. Forest Ecology and Management 411, 35-45. http://www. doi.org/10.1016/j.foreco.2017.12.049

Pajares, G., 2015. Overview and current status of remote sensing applications based on unmanned aerial vehicles (UAVs). Photogrammetric Engineering and Remote Sensing 81 (4), 281-330. http://www.doi.org/10.14358/PERS.81.4.281

Panagiotidis, D., Abdollahnejad, A., Surovy, P., Chiteculo, V., 2017. Determining tree height and crown diameter from high-resolution UAV imagery. International Journal of Remote Sensing 38 (810), 2392-2410. http://www.doi.org/10.1080/0143 1161.2016.1264028

Picos, J., Bastos, G., Míguez, D., Alonso, L., Armesto, J., 2020. Individual tree detection in a eucalyptus plantation using unmanned aerial vehicle (UAV)-LiDAR. Remote Sensing 12 (5), 885. http://www.doi.org/10.3390/rs12050885

Portnov, A.M., Bykhovets, S.S., Din, E.S., Ivanova, N.V., Frolov, P.V., Shanin, V.N., Shashkov, M.P., 2021. Kolichestvennaya otsenka razmerov okon v pologe starovozrastnogo shirokolistvennogo lesa nazemnymi i distantsionnymi metodami [Quantitative assessment of the size of gaps in the canopy of an old broad-leaved forest by in situ and remote methods]. Materialy Sed'moy konferentsii

«Matematicheskoe modelirovanie v ekologii» EkoMatMod-2021 [Proceedings of the Seventh Conference "Mathematical Modeling in Ecology" EcoMatMod-2021]. Pushchino, Russia, 99-102. (in Russian).

Puliti, S., 0rka, H.O., Gobakken, T., N^sset, E., 2015. Inventory of small forest areas using an unmanned aerial system. Remote Sensing 7 (8), 9632-9654. http://www.doi.org/10.3390/rs70809632

QGIS Development Team, 2019. QGIS Geographic Information System. Open Source Geospatial Foundation Project. URL: http://qgis.osgeo.org

R Core Team, 2021. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL: https://www.R-project.org/

Roussel, J.-R., Auty, D., Coops, N.C., Tompalski, P., Goodbody, T.R.H. et al., 2020. lidR: An R package for analysis of airborne laser scanning (ALS) data. Remote Sensing of Environment 251, 112061. http://www.doi.org/10.1016Zj.rse.2020.112061

Silva, C.A., Hudak, A.T., Vierling, L.A., Loudermilk, E.L., O'Brien, J.J. et al., 2016. Imputation of individual Longleaf Pine (Pinus palustris Mill.) tree attributes from field and LiDAR Data. Canadian Journal of Remote Sensing 42 (5), 554-573. https://doi.org/10.1080/07038992.2016. 1196582

iНе можете найти то, что вам нужно? Попробуйте сервис подбора литературы.

Silva, C.A., Klauberg, C., Mohan, M., Bright, B.C., 2018. LiDAR analysis in R and rLiDAR for forestry applications. NRS 404/504 LiDAR Remote Sensing for Environmental Monitoring. University of Idaho, Moscow, Idaho, USA, 90 p.

Sokolova, M., Japkowicz, N., Szpakowicz, S., 2008. Beyond accuracy, F-score and ROC: A family of discriminant measures for performance evaluation. Advances in Artificial Intelligence 4304, 10151021. http://dx.doi.org/10.1007/11941439_114

Weinstein, B.G., Marconi, S., Bohlman, S., Zare, A., White, E., 2019. Individual tree-crown detection in RGB imagery using semi-supervised deep learning neural networks. Remote Sensing 11 (11), 1309. http://www.doi.org/10.3390/rs11111309

Weinstein, B.G., Marconi, S., Aubry-Kientz, M., Vincent, G., Senyondo, H., White, E.P., 2020. DeepForest: a Python package for RGB deep learning tree crown delineation. Methods in Ecology and Evolution 11, 1743-1751. http://www. doi.org/10.1111/2041-210X.13472

Weinstein, B.G., Marconi, S., Bohlman, S., Zare, A., White, E., 2019. Individual tree-crown detection in RGB imagery using semi-supervised deep learning neural networks. Remote Sensing 11 (11), 1309. http://www.doi.org/10.3390/rs11111309

Zhang, J., Hu, J., Lian, J., Fan, Z., Ouyang, X., YeW., 2016a. Seeing the forest from drones: testing the potential of lightweight drones as a tool for long-term forest monitoring. Biological Conservation 198, 60-69. http://www.doi.org/10.1016/]. biocon.2016.03.027

Zhang, W., Qi, J., Wan, P., Wang, H., Xie, D., Wang, X., Yan, G., 2016b. An easy-to-use airborne LiDAR data filtering method based on cloth simulation. Remote Sensing 8 (6), 501. http://www. doi.org/10.3390/rs8060501

Финансирование

Работа выполнена в рамках бюджетных тем

ИМПБ РАН - филиал ИПМ им. М.В. Келдыша РАН

и заповедника «Кологривский лес».

Список литературы

Иванов, А.Н., Буторина, Е.А., Балдина, Е.А., 2012. Многолетняя динамика коренных южнотаежных ельников в заповеднике Кологривский лес. Вестник Московского университета. Серия 5. География 3, 74-79.

Иванова, Н.В., Шашков, М.П., Шанин, В.Н., Грабарник, П.Я., 2020. Оценка качества автоматического детектирования деревьев по материалам аэрофотосъемки с помощью квадрокоптера. Доклады международной конференции «Математическая биология и биоинформатика». Лахно, В.Д. (ред.). Т. 8. ИМПБ РАН, Пущино, Россия, статья № e36. http://www.doi.org/10.17537/icmbb20.31

Иванова, Н.В., Шашков, М.П., Шанин, В.Н., 2021. Исследование структуры древостоев сосновых лесов Приокско-Террасного биосферного заповедника (Россия) по материалам аэрофотосъемки с квадрокоптера. Nature Conservation Research. Заповедная наука 6 (4), 1-14. http://www.doi.org/10.24189/ncr.2021.042

Коренные темнохвойные леса южной тайги (резерват «Кологривский лес»), 1988. Абатуров, Ю.Д., Письмеров, А.В., Орлов, А.Я. и др. (ред.). Наука, Москва, СССР, 220 с.

Лебедев, А.В., Чистяков, С.А., 2021a. Долговременные наблюдения на пробных площадях в древостоях ядра заповедника

«Кологривский лес». Материалы конференции «Вклад ООПТ в экологическую устойчивость регионов: современное состояние и перспективы. Кологрив, Россия, 31-43.

Лебедев, А.В., Чистяков, С.А., 2021b. Оценка последствий ветровала 2021 года на территории биосферного резервата «Кологривский лес». Материалы конференции «Вклад ООПТ в экологическую устойчивость регионов: современное состояние и перспективы. Кологрив, Россия, 71-77.

Медведев, А.А., Тельнова, Н.О., Кудиков, А.В., Алексеенко, Н.А., 2020. Анализ и картографирование структурных параметров редкостойных северотаежных лесов на основе фотограмметрических облаков точек. Современные проблемы дистанционного зондирования Земли из космоса 17 (1), 150-163. http://www. doi.org/10.21046/2070-7401-2020-17-1-150-163

Портнов, А.М., Быховец, С.С., Дин, Е.С., Иванова, Н.В., Фролов, П.В., Шанин, В.Н., Шашков, М.П., 2021. Количественная оценка размеров окон в пологе старовозрастного широколиственного леса наземными и дистанционными методами. Материалы Седьмой конференции «Математическое моделирование в экологии» ЭкоМатМод-2021. Пущино, Россия, 99-102.

Хорошев, А.В., Немчинова, А.В., Кощеева, А.С., Иванова, Н.В., Петухов, И.Н., Терентьева, Е.В., 2013. Ландшафтные и сукцессионные факторы соотношения неморальных и бореальных свойств травяного яруса в заповеднике Кологривский лес. Вестник Московского университета. Серия 5. География 5, 11-18.

Agisoft LLC,. 2019. Agisoft Metashape (Version 1.5). Software. URL: https://www.agisoft.com/

Alonzo, M., Bookhagen, B., Roberts, D.A., 2014. Urban tree species mapping using hyperspectral and LiDAR data fusion. Remote Sensing of Environment 148, 70-83 http://www.doi. org/10.1016/].rse.2014.03.018

Alonzo, M., Andersen, H.E., Morton, D.C., Cook, B.D., 2018. Quantifying boreal forest structure and composition using UAV structure from motion. Forests 9 (3), 119. http://www.doi.org/10.3390/ f9030119

Anderson, K., Gaston, K.J., 2013. Lightweight unmanned aerial vehicles will revolutionize spatial ecology. Frontiers in Ecology and the

Environment 11 (3), 138-146. http://www.doi. org/10.1890/120150

Bennett, G., Hardy, A., Bunting, P., Morgan, P., Fricker, A., 2020. A transferable and effective method for monitoring continuous cover forestry at the individual tree level using UAVs. Remote Sensing 12 (13), 2115. http://www.doi.org/10.3390/rs12132115

Birdal, A.C., Avdan, U., Türk, T., 2017. Estimating tree heights with images from an unmanned aerial vehicle. Geomatics, Natural Hazards and Risk 8 (2), 1144-1156. http://www.doi.org/10.1080/19475 705.2017.1300608

Chen, Q., Gao, T., Zhu, J., Wu, F., Li, X., Lu, D., Yu, F., 2022. Individual tree segmentation and tree height estimation using leaf-off and leaf-on UAV-LiDAR data in dense deciduous forests Remote Sensing 14 (12), 2787. https://doi.org/10.3390/rs14122787

Christin, S., Hervet, É., Lecomte, N., 2019. Applications for deep learning in ecology. Methods in Ecology and Evolution 10, 1632-1644. http:// www.doi.org/10.1111/2041-210X.13256

Gongalves, V.P., Ribeiro, E.A.W., Imai, N.N., 2022. Mapping areas invaded by Pinus sp. from geographic object-based image analysis (GEOBIA) applied on RPAS (Drone) color images. Remote Sensing 14 (12), 2805. https://doi.org/10.3390/rs14122805

Goutte, C., Gaussier, E., 2005. A probabilistic interpretation of precision, recall and F-score, with implication for evaluation. In: Losada, D.E., Fernández-Luna, J.M. (eds.), Advances in Information Retrieval. ECIR 2005. Lecture Notes in Computer Science, vol 3408. Springer, Berlin -Heidelberg, 345-359. https://doi.org/10.1007/978-3-540-31865-1_25

Ivanova, N.V., Shashkov, M.P., 2022. Tree stand assessment before and after windthrow based on open-access biodiversity data and aerial photography. Nature Conservation Research 7 (Suppl. 1), 52-63. https://dx.doi.org/10.24189/ ncr.2022.018

Khosravipour, A., Skidmore, A.K., Skidmore, M., Wang, T., Hussin, Y., 2014. Generating pit-free canopy height models from airborne LiDAR. Photogrammetric Engineering and Remote Sensing 9, 863-872. http://www.doi.org/10.14358/ PERS.80.9.863

Kislov, D.E., Korznikov, K.A., 2020. Automatic windthrow detection using very-high-resolution

satellite imagery and deep learning. Remote Sensing 12 (7), 1145. http://www.doi.org/10.3390/ rs12071145

Kolarik, N.E., Gaughan, A.E., Stevens, F.R., Pricope, N.G., Woodward, K., Cassidy, L., Salerno, J., Hartter, J., 2020. A multi-plot assessment of vegetation structure using a micro-unmanned aerial system (UAS) in a semiarid savanna environment. ISPRS Journal of Photogrammetry and Remote Sensing 164, 84-96. http://www.doi.org/10.1016Zj.isprsjprs.2020.04.011

Krisanski, S., Taskhiri, M.S., Turner, P., 2020. Enhancing methods for under-canopy unmanned aircraft system based photogrammetry in complex forests for tree diameter measurement. Remote Sensing 12 (10), 1652. http://www.doi.org/10.3390/ rs12101652

Lamba, A., Cassey, P., Segaran, R.J., Koh, L.P., 2019. Deep learning for environmental conservation. Current Biology 29, R977-R982. http://www.doi. org/10.1016/j.cub.2019.08.016

Li, W., Guo, Q., Jakubowski, M.K., Kelly, M., 2012. A new method for segmenting individual trees from the LiDAR point cloud. Photogrammetric Engineering and Remote Sensing 78 (1 ), 75-84. http://www.doi.org/10.14358/PERS.78.1.75

Miller, E., Dandois, J.P., Detto, M., Hall, J.S., 2017. Drones as a tool for monoculture plantation assessment in the steepland tropics. Forests 8 (5), 168. http://www.doi.org/10.3390/f8050168

Mohan, M., Silva, C.A., Klauberg, C., Jat, P., Catts, G. et al., 2017. Individual tree detection from Unmanned Aerial Vehicle (UAV) derived canopy height model in an open canopy mixed conifer forest. Forests 8 (9), 340. http://www.doi. org/10.3390/f8090340

Onishi, M., Ise, T., 2021. Explainable identification and mapping of trees using UAV RGB image and deep learning. Scientific Reports 11, 903. http:// www.doi.org/10.1038/s41598-020-79653-9

Otero, V., Van De Kerchove, R., Satyanarayana, B., Martínez-Espinosa, C., Fisol, M.A.B. et al., 2018. Managing mangrove forests from the sky: forest inventory using field data and unmanned aerial vehicle (UAV) imagery in the Matang Mangrove Forest Reserve, peninsular Malaysia. Forest Ecology and Management 411, 35-45. http://www. doi.org/10.1016/j.foreco.2017.12.049

Pajares, G., 2015. Overview and current status of remote sensing applications based on unmanned aerial vehicles (UAVs). Photogrammetric Engineering and Remote Sensing 81 (4), 281-330. http://www.doi.org/10.14358/PERS.81.4.281

Panagiotidis, D., Abdollahnejad, A., Surovy, P., Chiteculo, V., 2017. Determining tree height and crown diameter from high-resolution UAV imagery. International Journal of Remote Sensing 38 (810), 2392-2410. http://www.doi.org/10.1080/0143 1161.2016.1264028

Picos, J., Bastos, G., Miguez, D., Alonso, L., Armesto, J., 2020. Individual tree detection in a eucalyptus plantation using unmanned aerial vehicle (UAV)-LiDAR. Remote Sensing 12 (5), 885. http://www.doi.org/10.3390/rs12050885

Puliti, S., 0rka, H.O., Gobakken, T., N^sset, E., 2015. Inventory of small forest areas using an unmanned aerial system. Remote Sensing 7 (8), 9632-9654. http://www.doi.org/10.3390/rs70809632

QGIS Development Team, 2019. QGIS Geographic Information System. Open Source Geospatial Foundation Project. URL: http://qgis.osgeo.org

R Core Team, 2021. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL: https://www.R-project.org/

Roussel, J.-R., Auty, D., Coops, N.C., Tompalski, P., Goodbody, T.R.H. et al., 2020. lidR: An R package for analysis of airborne laser scanning (ALS) data. Remote Sensing of Environment 251, 112061. http://www.doi.org/10.1016Zj.rse.2020.112061

Silva, C.A., Hudak, A.T., Vierling, L.A., Loudermilk, E.L., O'Brien, J.J. et al., 2016. Imputation of individual Longleaf Pine (Pinus palustris Mill.) tree attributes from field and LiDAR Data. Canadian Journal of Remote Sensing 42 (5), 554-573. https://doi.org/10.1080/07038992.2016. 1196582

Silva, C.A., Klauberg, C., Mohan, M., Bright, B.C., 2018. LiDAR analysis in R and rLiDAR for forestry applications. NRS 404/504 LiDAR Remote Sensing for Environmental Monitoring. University of Idaho, Moscow, Idaho, USA, 90 p.

Sokolova, M., Japkowicz, N., Szpakowicz, S., 2008. Beyond accuracy, F-score and ROC: A family of discriminant measures for performance evaluation. Advances in Artificial Intelligence 4304, 10151021. http://dx.doi.org/10.1007/11941439_114

Weinstein, B.G., Marconi, S., Bohlman, S., Zare, A., White, E., 2019. Individual tree-crown detection in RGB imagery using semi-supervised deep learning neural networks. Remote Sensing 11 (11), 1309. http://www.doi.org/10.3390/rs11111309

Weinstein, B.G., Marconi, S., Aubry-Kientz, M., Vincent, G., Senyondo, H., White, E.P., 2020. DeepForest: a Python package for RGB deep learning tree crown delineation. Methods in Ecology and Evolution 11, 1743-1751. http://www. doi.org/10.1111/2041-210X.13472

Weinstein, B.G., Marconi, S., Bohlman, S., Zare, A., White, E., 2019. Individual tree-crown detection in RGB imagery using semi-supervised deep learning neural networks. Remote Sensing 11 (11), 1309. http://www.doi.org/10.3390/rs11111309

Zhang, J., Hu, J., Lian, J., Fan, Z., Ouyang, X., YeW., 2016a. Seeing the forest from drones: testing the potential of lightweight drones as a tool for long-term forest monitoring. Biological Conservation 198, 60-69. http://www.doi.org/10.1016/j. biocon.2016.03.027

Zhang, W., Qi, J., Wan, P., Wang, H., Xie, D., Wang, X., Yan, G., 2016b. An easy-to-use airborne LiDAR data filtering method based on cloth simulation. Remote Sensing 8 (6), 501. http://www. doi.org/10.3390/rs8060501

i Надоели баннеры? Вы всегда можете отключить рекламу.