PanoWS Dresden2004 Chapman
PanoWS Dresden2004 Chapman
PanoWS Dresden2004 Chapman
INDUSTRIAL FACILITIES
a
Department of Geomatic Engineering, University College London, London WC1E 6BT - [email protected]
b
As-Built Solutions Ltd, CAB International, Noseworthy Way, Wallingford OX10 8DE - (atdd, jlb)@absl.co.uk
ABSTRACT:
Digital photogrammetry continues to evolve from specialist applications such as topographic mapping and is rapidly emerging as a
highly accessible method for capturing geometric data. A range of general-purpose softcopy photogrammetric systems are now
widely available to end users who are thus able to exploit images captured from an increasing number of high-resolution non-metric
digital cameras. In parallel with these developments an increasing diversity of range-imaging systems are being developed to
facilitate the rapid acquisition of geometric data. To date these devices do not offer the resolution, portability or speed afforded by
digital cameras, however this paper anticipates the development of hybrid range and intensity imaging systems. Through the
extension of such systems to facilitate the acquisition of omnidirectional imagery the paper seeks to demonstrate the utility of such
data in the rapid documentation of complex objects. The paper will demonstrate the development and exploitation of omnidirectional
digital photogrammetry and range imaging systems to enable the creation and exploitation of massive image databases of large
industrial objects such as process-plants, offshore oil platforms or power stations. Furthermore the paper will demonstrate the extent
to which computer vision based analyses of such databases can, in turn, permit precise yet cost-effective documentation of a wide
range of industrial facilities.
1. INTRODUCTION - MOTIVATIONS FOR AS-BUILT believe that the deployment of appropriate omni-directional
MODELLING OF INDUSTRIAL PLANT imaging systems enables the cost effective acquisition of
massive image achives that document the as-built status of very
Industrial facilities are often very dynamic environments in complex industrial environments.
which new or improved equipment items are constantly being Thus a number of strategies have been developed to exploit
incorporated in order to improve efficiency, increase safety or these archives to facilitate the creation of As-Built CAD models
reduce emissions. Costs associated with loss-of-production with the principle objectives of:
during planned maintenance are invariably very important to − Reverse engineering CAD models of existing
plant owner-operators and thus it is vital that any refurbishment structures;
is carefully planned to minimise unanticipated expenditure or − Exploiting these models to ensure first-time fit, clash
loss of production revenue. It is essential that during such free, of new equipment; and hence
operations there is a 'first-time-fit' of new equipment with the − Reduction of time spent on site
existing structures and that such installations are 'clash-free' i.e.
they do not physically conflict with new or existing plant items. 2. IMAGE-BASED AS-BUILT REPRESENTATIONS OF
Plant design or modification is now routinely planned using 3D INDUSTRIAL ENVIRONMENTS
Computer Aided Design tools that enable the creation of a
coherent 3D plant database in which the various design Complete automation of the transformation of either primary or
disciplines can share both geometric and attribute data relating secondary survey data into CAD based representation a has
to their specialisations. It has been suggested that maintaining long been a goal of a large community of engineers,
such CAD models throughout the life of the plant would result mathematicians and computer scientists. However, the size and
in significant downstream benefits to facility managers who complexity of the geometric models required to fully document
would be able to maintain the database to reflect the current dense, complex process plant environments poses real
operating status of the plant. Unfortunately design models are challenges to the Photogrammetric and Computer Vision
only rarely maintained after commissioning of the plant and communities seeking to automate scene description from image
often only drawings derived from the plant database are data.
archived. This is, in part, due to the cost of upgrading design
models to their true As-Built status. Frequently it is not possible In the mid 1990’s several authors (e.g. Debevec, 1996)
to predict prior to commissioning which areas of a plant are questioned whether there were classes of applications that
likely to require the very detailed dimensioning to support might benefit from an alternative of Imaged Based Rendering
subsequent modifications and, in most cases, a full three- (IBR) approach to scene representation. This activities were
dimensional survey of a facility is prohibitively expensive. directed towards the rendering of interactive views of an object
Thus in many cases local As-Built surveys are undertaken for directly from image data bypassing, or at least minimising, the
each plant modification in order to accurately document the requirement for any geometric model of the scene. (Figure 1).
interfaces between new and exiting plant. Informed by more
than ten years commercial activity in this sector the authors
The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. 34, Part XXX
Rendering
Modeling
Images Images + Depth
Photographs, Images Many applications would benefit from a high resolution wide
Range scans
Renderings Light Field area image coverage to facilitate the cration of panoramic
image archives and consequently a number of imaging
Movie Map
configurations have been developed. (summarised in the table
Panorama below). As can be seen from the table none of these
Figure 1. Image based rendering – from images to images, after configurations totally satisfy the conflicting requirements of
Debevec, 1999. high resolution, high speed and very wide angle coverage at a
‘reasonable’ cost.
Representation Movement Geometry Lighting Sensor Wide High Dynamic Geometric Typical Example
Geometry + Continuous Global Dynamic Configuration FOV
Resolution imaging
Stability cost
Materials Single camera
Geometry + Continuous Global Fixed with fish-eye M M L H M
lens
Images
Images + Depth Continuous Local Fixed
Light Fields Continuous None Fixed
Movie Map Discrete None Fixed Single camera
with catadioptric H L H M L
Panorama None None Fixed Lens
Ideally we would wish to exploit panoramic range images to Table 2. Categorisation of omnidirectional imaging systems
complement image archives to extend and enhance the current
state-of-the art. In order to achieve this we require a compact In our application we require very high resolution images
panoramic range-imaging sensor. captured within a robust geometrical framework. This led to the
Ideally this sensor would be capable of: development of a a Video-theodolite based omnidirectional
imaging system.
− flexible deployment as detailed in section 1.
Images are acquired using a robotic video-theodolite system
− delivery of a calibrated gigapixel panoramic colour
based upon a Spectra Precision motorised theodolite. A camera
image
module attached to the theodolite enables the acquisition of
− accurate ( better than +/- 2mm) ranging associated
either monochrome or colour images via a IEEE 1394, firewire,
with each pixel
connection to thecontrolling PC. Each image is 'tagged' with the
− capturing a panorama sufficiently quickly (less than 2 azimuth and altitude angle of the theodolite at the time of
minutes) that the sensor can be deployed throughout capture. The theodolite is driven in scan pattern enabling a
the facility at spacings less than those in current panoramic mosaic of up to 150 individual images to be
HAZMAP deployments ( i.e. less than 1m centres in captured at each theodolite location (or station).
X,Y and Z).
The authors remain convinced that such a sensor will be Calibration of the camera with respect to the telescope axis is
developed in the next 2-5 years, however in the absence of such done on site using the method proposed by Huang (Huang &
a we show how such data may be included into an existing Harley, 1990) and with the adjustment of these observations
omni-directional image based rendering systems to deliver being undertaken as a conventional bundle adjustment. New
enhanced performance in as-built modelling. camera technologies allow less than 40 images to captured at
The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. 34, Part XXX
the same resolution as the older cameras, thereby reducing the are available projects are available for accurate measurement of
time and costs of such surveys. features through standard photogrammetric principles.
Once a station has been captured a single panoramic image is An image browser and measurement tool linked to the
automatically generated from the image mosaic through a back ViewPano panoramic browser supports multi-station
projection from image space to a cylinder with a predefined measurement together with a geometric calculator function that
radius in object space. This projection uses the interior and enables the extraction of a wide range of dimensional data. The
exterior orientation parameters from the bundle adjustment, principle advantage of this tool is that it enables ad-hoc
rather than correlation based stitching more commonly found in measurement to support engineering decision making and thus
other packages, since this is both more robust and yields results the package is intended to be used by plant engineers. Since
in the absence of well defined image texture. such users often do not have extensive photogrammetric
experience they must, therefore, be provided with sufficient
guidance from the software and operating procedures to ensure
that all data captured is 'fit for purpose'.
Such techniques for the refinement of an initial model has been archive to undertake qualitative assessments of plant condition
further demonstrated by researchers at the Delft University of and to inform early design decisions. In several instances
Technology (c.f. Tangelder et.al. 2000, Earmes 2000) who use circumstances relatively basic image inspection with very
an interative solution to match model edges to image edgels. limited superimposition lead to some significant results
including:
In practice, whilst such applications do offer some degree of − images of a failed weld in a nuclear environment that
operator assistance their practical application proved to be indicated that a displaced unit had snagged a
constantly compromised by the relative sparsity of high quality, thermocouple housing – necessitating a modification
homologous edges in image archives of the environments we to the robotic recovery strategy;
are seeking to model. In many, perhaps the majority, of cases − images that clearly indicated that small bore piping
the edge refinement technique was corrupted by specular that should have been installed with a slight fall to
reflections along the pipe or by occluding features – ensure self draining was, in fact, not parallel to other
particularly in the very common situation where parallel pipe pipe runs and in fact run up rather than downhill;
runs are packed together in pipe racks. Thus in practise only a − an ‘as-built’ model that contained equipment cabinets
very small minority of components benefited from automated that had, in fact, never been commissioned and
refinement and the overhead of manual intervention in the therefore were not present in the image archive;
myriad of failure cases required the development of alternative − the overlay of a design model clearly showing that a
strategies. structural member was of a significantly smaller
diameter than had been used in a load-analysis based
on the design data.
In each case there was little, or no, requirement for any
environment modelling but each required rapid access to
multiple views to confirm that these visual artefacts were not
simply optical illusions.
Figure 14a. Design pipe superimposed on image archive Figure 14b. Range image loaded
Figure 14c. ‘Shrink wrap’ surface fitted to range data Figure 14d. Points within +/- 10mm of design selected for least-
The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. 34, Part XXX
REFERENCES