Full text: Real-time imaging and dynamic analysis

  
This paper firstly presents methods of resolution enhancement 
of digital imagery as reported by other researchers. There are 
an increasing number of hardware and software solutions 
becoming available to enhance image resolution. 
The resolution enhancement algorithm developed by the 
authors is described and applied to a close-range application. 
Digital photogrammetry was used to create a digital terrain 
model (DTM) of a test object using original digital images and 
images enhanced by the algorithm. The accuracy of each 
DTM was analysed and compared. Over 200,000 points from 
each DTM were used in the comparison to deduce if the 
enhancement of the resolution of the digital images had 
increased the accuracy of the determined surface models. 
Factors of the experimentation which were taken into 
consideration included control points, illumination, image 
enhancement and DTM creation. A description of future 
research directions is also presented. 
2. RESOLUTION ENHANCEMENT OF DIGITAL 
IMAGES 
The objective of image enhancement is to produce an image 
which is more suitable for an application than the original 
image (Gonzalez and Wintz, 1987). The difference between 
enhancement and restoration is that restoration is a means of 
modifying the image so it becomes how it appeared originally. 
Enhancement is trying to improve the original image to give 
better visualization (Weeks, 1996), or accuracy in 
classifications or measurements. 
The enhancement being investigated in this paper is that of 
determining higher resolution images. Hardware and software 
solutions are the two main ways this enhancement can be 
achieved. Hardware techniques include increasing the size 
and number of pixels of the sensor, decreasing the pixel size, 
and modifying a camera to move the sensor by known 
amounts. Software solutions include using one or more low 
resolution images to interpolate or solve for a higher 
resolution image when there are initially unknown amounts of 
shift between images. 
2.1 Hardware Techniques 
There have been many investigations into medium and high 
resolution cameras which are commercially available and, as 
previously mentioned, relatively expensive. Kochi (et al., 
1995) reported the development of a measurement system 
using a high resolution camera with sensor dimensions of 
4096 x 4096 pixels. The system is modular, including image 
acquisition, measurement and calibration software. Peipe 
(1995) presented an investigation on the Kodak DCS460, 
which is a digital still camera with a 3000 x 2000 pixel sensor. 
The camera was found to be suitable for off-line single sensor 
applications and the relative accuracy achievable was in the 
order of 1/180,000. 
Some hardware techniques have modified cameras to produce 
high resolution digital images. Godding and Woytowicz 
(1995) described a system of providing a digital back for a 
Rollei film camera, with a sensor resolution of 2048 x 2048 
pixels, which could achieve relative accuracies of 1/150,000. 
118 
Lenz and Lenz (1993) used a method based on the accurate 
movement of the CCD array at a sub-pixel level and described 
this method of resolution enhancement as micro-scanning. 
Also discussed was a method termed macro-scanning, which 
involved mosaicking patches of digital imagery thus 
producing a large digital image at the same resolution as the 
original images. These methods can be combined and used 
simultaneously, which occurs in the ProgRes 3000 camera 
(ibid, p59). The CCD chip is actually moved inside the 
camera left-to-right and up-and-down by increments as small 
as 3um to capture multiple images of an object. These are 
integrated to give a higher resolution image, but the cost of 
adding the electronic drive system to move the array is very 
high (approximately US$30,000). 
A relatively new invention is in the Pixera Pro camera (Reis, 
1997), which uses a magneto-optical effect found in special 
glass to achieve accurate shifts in the direction of light rays 
through the lens system, such that the scene can be positioned 
onto four different areas of the sensor. This is used to create 
an image with an apparent resolution four times greater than 
the resolution of the sensor. 
2.2 Software Solutions 
Jensen and Anastassiou (1995) presented a non-linear 
interpolation scheme for enhancing the resolution of digital 
still images by determining edges within the images to sub- 
pixel level. This method is very specific in the type of images 
it can be used to enhance. Jensen intended this method to be 
used in conjunction with other methods of image resolution 
enhancement. 
Long (et al, 1993) presented a method for generating 
enhanced resolution radar images of the earth’s surface using 
spaceborne scatterometry. Although the data being enhanced 
was different from the usual images used in photogrammetry, 
the strategy is still applicable and noteworthy. The method 
was based on an image reconstruction technique which 
utilised the spatial overlap in scatterometer measurements 
made at different times. A least squares solution was 
employed, involving singular value decomposition analysis. 
The limit in the final resolution was determined by a 
combination of the noise level in the measurements and in 
their overlap. 
A notable point raised by Long (ibid) was that noise in the 
refined images increased as the resolution was improved. 
This is a problem which has to be closely monitored and 
precisely modelled in resolution enhancement techniques to 
ensure the enhanced image has not suffered any noticeable 
degradation in accuracy. 
Wiman (1993) presented a method where a scanner was used 
to acquire several images of an aerial photograph at known 
sub-pixel translations from the first image. Equations linking 
the images were set up with the unknowns being the values of 
the pixels of a combined, higher resolution image. The grey 
values of the pixels in the high resolution image were 
determined using a pseudo-inverse method as the equation 
system was under-determined. Wiman did not pursue the 
experimentation after initial results were inconclusive as the 
system of equations he developed could not be accurately 
solved. He su 
before definite c 
The image proc 
often based o 
Stevenson (199 
which used bot 
sequence of vi 
determine the p 
noted that the q 
quality of the « 
frame, this prob 
a unique solutic 
independent obj 
A method whicl 
due to non-zero 
1997). This me 
removing acqui: 
components, be 
the removal of 
image resolutio: 
 
	        
Waiting...

Note to user

Dear user,

In response to current developments in the web technology used by the Goobi viewer, the software no longer supports your browser.

Please use one of the following browsers to display this page correctly.

Thank you.