A Spectral-Spatial-Temporal Attention Network for Tree Species Mapping Using DESIS Hyperspectral Imagery

MCML Authors

Xiaoxiang Zhu

Prof. Dr.

Principal Investigator

Data Science in Earth Observation

Abstract

Accurate mapping and monitoring of forest tree species are crucial for understanding ecosystem dynamics [1], assessing biodiversity [2], and enabling sustainable forest management [3]. Tree species adapt their morphology and phenology to the environment [4], leading to variability in spectral signatures across geographic regions. Furthermore, the spectral reflectance of a given tree species varies significantly with growth stages and seasons [5], making the classification based solely on RGB data extremely challenging. At the local level, spectral variability also closely correlates with stand structure factors such as crown size, stand density, and gap sizes. This results in varying signal reflectance from different parts of the same crown, further complicating tree species classification [6]. Thus, we proposed a spectral-spatial-temporal constrained deep learning method, an end-to-end multi-head attention-based network, to automatically extract deep features for tree species mapping. Employing this model on multi-temporal hyperspectral imagery from the DLR Earth Sensing Imaging Spectrometer (DESIS), we produced a 30 m resolution forest species distribution map of the Harz Forest in Germany. DESIS, a VNIR sensor aboard the International Space Station, captures detailed Earth images upon request, offering extensive spectral data across 235 bands ranging from 400 to 1000 nm [7]. Our methodology leverages the comprehensive spectral information provided by DESIS, enhancing the tree species mapping accuracy. Utilizing the reference data from TreeSatAI Benchmark Archive [8], we prepared 134,886 hyperspectral data patches, each labelled with tree species information. The evaluation involved assessing the F1-score, Jaccard index, Hamming loss, and accuracy for various tree species using National Forest Inventory (NFI) data plots. The results reveal the potential of deep learning using hyperspectral data in the precise and automated mapping of forest tree species distribution, thereby supporting evidence-based decision-making in sustainable forest management.

inproceedings

---

EGU 2024

General Assembly of the European Geosciences Union. Vienna, Austria, Apr 14-19, 2024.

---

Authors

Y. Mu • M. Shahzad • X. Zhu

---

Links

DOI

---

Research Area

 C3 | Physics and Geo Sciences