Reconstruction of Reality from Image Sequences

REALISE - 8878

Work Area: Foundations of Visualisation and Multi-Modal Interfaces

Keywords computer vision, reconstructions of scenes, reflectance analysis, virtual reality, simulation

Start Date: to be announced / Status: starting

[ participants / contact ]

Abstract The goal of this project is to extract from sequences of images acquired with a slowly moving camera the information necessary for determining the 3D structure of a scene and its photometric aspects. This information will be transformed according to the requirements of the database needed for virtual reality systems, then enabling the original scene to be simulated. Research will be done in the area of computer vision (structure from motion); photometry (estimation of Bidirectional Reflection Distribution Function, 3D texture) and computer graphics (adaptation of databases: noise elimination, data structuring).


Virtual reality systems offer exciting possibilities. We propose to help construct virtual reality databases automatically from sequences of images taken by moving camera(s). Such sequences contain, a priori, the necessary information for being able to determine the 3D structure of a scene and its photometric aspects.

Approach and Methods

The principal objective is to define and develop algorithms for extracting data from sequences of images acquired with a slowly moving camera. We hope to define a sequence of operations such that the construction of the database from the sequences of images is as automatic as possible.


Our first result will be to provide new interesting insights in the three research areas that we address: structure from motion in computer vision, understanding of the reflectance properties of materials and synthesis of images from noisy and unstructured data. We aim to setup the following exciting demonstration: select an old film which includes sequences of images of a building which no longer exists and then create a database for it. Other possibilities include the construction of databases necessary for the simulation of driving cars, trains, boats, planes or for the design of furniture.


Thomson-CSF - F
Laboratoire Central de Recherches
Domaine de Corbeville
F- 91404 ORSAY


Flux (University of Utrecht) - NL


Dr. R. Vaillant
tel +33/1 60 197316
fax +33/1 60 197120

LTR synopses home page LTR work area index LTR acronym index LTR number index LTR Projects index
All synopses home page all acronyms index all numbers index

REALISE - 8878, August 1994

please address enquiries to the ESPRIT Information Desk

html version of synopsis by Nick Cook