International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume XXXIX-B7, 2012
XXII ISPRS Congress, 25 August — 01 September 2012, Melbourne, Australia
THE BENEFITS OF TERRESTRIAL LASER SCANNING AND HYPERSPECTRAL DATA
FUSION PRODUCTS
S. J. Buckley", T. H. Kurz*, D. Schneider"
“Uni CIPR, Postboks 7810, N-5020 Bergen, Norway - simon.buckley@uni.no, tobias.kurz@uni.no
Technische Universität Dresden, Institute of Photogrammetry and Remote Sensing, D-01062 Dresden, Germany —
danilo.schneider{@tu-dresden.de
TS VII/3, VII/6, I11/2, V/3: Integration of hyperspectral and lidar data
KEY WORDS: Hyper spectral, lidar, fusion, visualization, analysis, texture, value-added, photo-realism
ABSTRACT:
Close range hyperspectral imaging is a developing method for the analysis and identification of material composition in many
applications, such as in within the earth sciences. Using compact imaging devices in the field allows near-vertical topography to be
imaged, thus bypassing the key limitations of viewing angle and resolution that preclude the use of airborne and spaceborne
platforms. Terrestrial laser scanning allows 3D topography to be captured with high precision and spatial resolution. The
combination of 3D geometry from laser scanning, and material properties from hyperspectral imaging allows new fusion products to
be created, adding new information for solving application problems. This paper highlights the advantages of terrestrial lidar and
hyperspectral integration, focussing on the qualitative and quantitative aspects, with examples from a geological field application.
Accurate co-registration of the two data types is required. This allows 2D pixels to be linked to the 3D lidar geometry, giving
increased quantitative analysis as classified material vectors are projected to 3D space for calculation of areas and examination of
spatial relationships. User interpretation of hyperspectral results in a spatially-meaningful manner is facilitated using visual methods
that combine the geometric and mineralogical products in a 3D environment. Point cloud classification and the use of photorealistic
modelling enhance qualitative validation and interpretation, and allow image registration accuracy to be checked. A method for
texture mapping of lidar meshes with multiple image textures, both conventional digital photos and hyperspectral results, is
described. The integration of terrestrial laser scanning and hyperspectral imaging is a valuable means of providing new analysis
methods, suitable for many applications requiring linked geometric and chemical information.
1. INTRODUCTION Compact and portable hyperspectral sensors are now
available, and are applicable to many close range
Applications in photogrammetry and remote sensing are often applications, especially in the earth sciences, where the
enhanced by the use of multiple sensors that provide remote analysis of mineralogical distribution is often
complementary information and therefore improved products important. Such sensors have high spectral resolution,
for users. A common example is the combination of laser allowing increasingly complex mineral variations to be
scanning and photogrammetry, both terrestrial and aerial, detected (Kurz et al, 2012). In addition, the close range
where the high density and precise geometric data from lidar instrument position makes it possible to image steep terrain
is given added value using the increased radiometric, spectral and building façades, without the traditional problems
and spatial resolution provided by digital metric or semi- associated with airborne and spaceborne imaging where
metric imagery (e.g. Axelsson, 1999; Frueh et al., 2005; Fassi spatial resolution and a nadir field of view are problematic.
et al., 2011; Guo et al., 2011). Multispectral or hyperspectral The integration of hyperspectral imagery with terrestrial laser
sensors have the potential to further complement laser scanning (TLS) has high potential for assisting application
scanning topographic data, as an extended part of the experts with interpretation and validation of classification
electromagnetic spectrum is recorded with a greater number results, owing to the improved spatial component provided
of spectral bands. Such sensors measure many narrow bands, by linking 2D spectral data to 3D lidar geometry.
allowing near-continuous reflectance curves to be derived per
component image pixel (van der Meer and de Jong, 2001). This paper assesses the benefits of integrating TLS data and
Such high spectral sampling makes it possible to analyse close range hyperspectral imagery, focussing on the
small variations in material composition, even at the sub- combined products obtainable from these complementary
pixel range (Keshava and Mustard, 2002). While the value of techniques. A geological application is used to illustrate the
combined airborne lidar and hyperspectral data, for example proposed data fusion products. The paper is structured to
in forestry, is being realised (Koch, 2010), in close range give a background to the component techniques and the
applications the integration is only now emerging as a multi-sensor integration (Section 2), before the data
potential means of linking geometrical and material collection, processing and registration is described (Section
properties (Kurz et al., 2008). 3). Section 4 outlines visual methods for exploring the
combined data, whilst Section 5 covers quantitative methods
and accuracy assessment.
" Corresponding author.
541
