Viewpoint-Invariant Visual Acquisition


VIVA - 6448

Work Area: Computer Vision

Keywords 2D and 3D shape description, 2D and 3D shape recognition, invariants, calibration-free vision, affine and projective transformations


Start Date: 1 August 92 / Duration: 36 months / Status: running

[ participants / contact ]


Abstract VIVA is identifying and implementing numerical quantities which are measurable on images and are invariant under deformations induced by specific projection-related transformations. Such invariants are of special interest because they allow efficient matching of spatial structures when comparing images taken from different viewpoints. The results obtained under VIVA are expected to broaden the scope of object recognition to the efficient handling of general viewpoints, to eliminate the need for painstaking calibration procedures and to make motion and stereo correspondence search faster and more reliable.


Aims

Invariants are properties of geometric configurations that remain unchanged under an appropriate class of transformations. The key objective is to identify and implement numerical quantities which are measurable on images and are invariant under deformations induced by specific projection-related transformations. Successful extraction of these invariants drastically lowers recognition times because the determination of positional information can be completely decoupled from determining object type. Moreover, their use might render calibrations obsolete to some point, depending on whether camera parameters can be absorbed into the transformation already imposed by the group deformations under projection.

Approach and Methods

The emphasis in the project is on cases that go beyond the intuitive type of invariance, like straightness of a line. Therefore, the consortium envisages developing a theoretical framework which encompasses the different aspects of invariants, and which will provide the vision community with tools which make possible a systematic search for, and a thorough investigation of, new classes of invariants. Current emphasis is shifting towards detecting situations that allow the extraction of invariants for non-planar structures, both from simple and multiple views. Secondly, these scientific advances will be incorporated in the development of new and robust practical vision competences.

Moreover in view of the intricate and complex nature of the issues at hand, the consortium intends to tackle the problems on as broad a front as possible. For this reason the partners have made sure that they are in a position to assign interdisciplinary teams, consisting of engineers, phycisists, mathematicians and psychologists, to the different tasks, because they are convinced that an approach which integrates these different sources of expertise stands a better chance of making real progress.

Progress and Results

Tangible results are available for several tasks by now. For the recognition of planar shapes from single orthographic and perspective views, several invariant-based methods for recognition are available and have been compared. Efforts towards their integration into a single programme are underway. Recognition remains possible under a wide range of conditions, due to the complementary scope of the different methods (eg convex or concave shapes, segments between bitangent points or between inflections, etc.) Some unanticipated theoretical results were obtained as well, such as invariants for articulated objects and scenes with additional constraints or symmetries.

Important progress has been made on the extraction of invariants for non-planar structures. Not only have invariants been found for single views of 3-D structures such as polyhedra and symmetric objects. Moreover, crucial progress has been made in understanding the information that can be extracted from both orthographic and perspective stereo views. It was shown for instance that reconstruction up to a 3-D projectivity is possible from a general perspective stereo view if 8 point correspondences can be found. On the other hand, constraining the stero rig to have coplanar image planes reduces the complexity to only 5 point correspondences for a reconstruction up to an affinity.

Quite some emphasis has been put on issues of robustness. For instance detailed analysis on the accuracy and noise sensitivity of the cross-ratio was carried out and methods were developed for improved extraction of contour coordinate derivatives.

One of the ambitious goals of VIVA is to deal with curved surfaces. Apart from results on the qualitative distinction between physical versus occluding contours, substantial progress was made in deepening the understanding of surface duals height funtions, and aspect graphs and the relevance thereof for vision. As a new tool, a real time interactive geometry viewer for algebraic surfaces was developed, which is suspected to strongly support this work in the future.

Psychophysical results have shown that affine structure can to a large extent be retrieved from minimal information (4 points), but that qualitative aspects such as collinearity and parallelism have an important influence. These non-accidental properties therefore seem good candidates to be included more firmly into the recognition strategies, since their basis is to be found in invariance theory as well.

Potential

Several longstanding problems in the application of machine vision may well benefit from the results. The expected impact is to broaden the scope of object recognition to the efficient handling of general viewpoints and large databases, to eliminate the need for painstaking calibration procedures if recognition rather than precise Euclidean reconstruction matters and to make motion and stereo correspondence searches faster and more reliable. The potential use lies mainly in assembly, inspection, surveillance, security, agriculture and medical imaging.

Latest Publications

Further information about VIVA is available from the VIVA home page <URL:http://www.esat.kuleuven.ac.be/~konijn/viva.html>.


Coordinator

Katholieke Universiteit Leuven - B
Kardinaal Mercierlaan 94
B - 3031 HEVERLEE

Partners

Universität Hamburg - D
INRIA - F
Universiteit van Utrecht - NL
University of Oxford - UK
GEC Marconi Ltd - UK

Associate Partners

University of Keele - UK
Royal Institute of Technology - S
Lund Institute of Technology - S
University of Liverpool - UK

CONTACT POINT

Mr. L. Van Gool
tel +32/16 220 931 Ext. 1705
fax +32/16 221 855
e-mail: vangool@esat.kuleuven.ac.be


LTR synopses home page LTR work area index LTR acronym index LTR number index LTR Projects index
All synopses home page all acronyms index all numbers index

VIVA - 6448, August 1994


please address enquiries to the ESPRIT Information Desk

html version of synopsis by Nick Cook