Vision Systems for a Natural Human Environment


INSIGHT II - 6019

Work Area: Computer Vision

Keywords middle-level vision, optic flow, cue integration, surfaces, objects


Start Date: 1 August 92 / Duration: 36 months / Status: running

[ participants / contact ]


Abstract INSIGHT II aims at gaining understanding of the computational problems of natural vision and their solution in biological and silicon systems. The project draws on the disciplines of psychophysics, neurophysiology and computer vision to study key areas including the measurement of optic flow, cue integration, task-dependent use of optic flow, and surface and object representations. The work builds on results achieved in INSIGHT I (3001).


Aims

The aim of INSIGHT II is to improve our understanding of vision at the computational level, that is, to identify the representations to be used and the algorithms to compute them for general-purpose vision systems operating in a fluctuating natural environment.

Approach and Methods

Using the results of a previous action (INSIGHT, 3001) as a guide, a number of key areas have been identified, mainly in middle-level vision, where rapid progress can be expected. These areas include the measurement of optic flow, cue integration, the task-dependent use of optic flow, and surface and object representation. These five topics are approached from a multidisciplinary point of view combining psychophysics and neurophysiology in studying biological visual system in primates, and computer science in studying computer vision. While psychophysics studies human or primate performance and conjectures about underlying mechanisms, physiology measures these mechanisms directly. The strategies employed by the most successful computer (the primate brain) will thus be confronted with those used in computer vision to solve similar problems.

Progress and Results

The discovery of the site of convergence of luminance, motion and texture cues specifying shape in the primate brain.

New insights into the receptive field structure of higher order visual neurons and on the integration of visual and eye movement signals in the primate brain.

On the psychophysical side, a new technique has been developed for the measurement of subjects' perception of surfaces. A wealth of new data on the estimation by humans of surface position, orientation and curvature specified by disparity, motion, luminance, texture and other cues has been obtained.

On the computational side, a new theory has been developed on the recovery of surfaces from the structure of the disparity field.

In computer vision, the consortium has been extremely active at all levels, mathematical theory, implementation and experimentation, with the estimation of optic flow and its use for recovering object 3D structure and 3D motion.

Potential

The vision knowledge gained from these fundamental studies will give firm ground to more applied projects in which vision is used to guide robots or recognise patterns.

Latest Publications

Information Dissemination Activies

The work of this consortium is presented at the leading conferences in computer vision, neuroscience and psychophysics.

The work of INSIGHT I has been published in Artificial and Biological Vision Systems, eds. G.A. Orban and H.-H. Nagel, Springer Verlag, 1992.


Coordinator

Katholieke Universiteit Leuven - B
Laboratorium voor Neuro- en Psychofysiologie
Campus Gasthuisberg
Herestraat 49
B - 3000 LEUVEN

Partners

Universitätsspital Zurich - CH
Ruhr Universität Bochum - D
Universität Karlsruhe - D
INRIA - F
Università di Genova - I
Rijksuniversiteit Utrecht - NL
Royal Institute of Technology Stockholm - S
University of Oxford, Dept. of Experimental Psychology - UK
University of Oxford, Dept. of Engineering Science - UK
University of Sheffield - UK

Associate Partners

Katholieke Universiteit Leuven, ESAT - B
Université de Nice-Sophia Antipolis - F
Computer Technology Institute, Patras - GR
Stirling University - UK

CONTACT POINT

Prof. G.A. Orban
tel +32/16-345740
fax +2/16-345993
e-mail: gorban@cc3.kuleuven.ac.be


LTR synopses home page LTR work area index LTR acronym index LTR number index LTR Projects index
All synopses home page all acronyms index all numbers index

INSIGHT II - 6019, August 1994


please address enquiries to the ESPRIT Information Desk

html version of synopsis by Nick Cook