Navigation

You are here: Home / Research

Research Projects

by year:  all years   2013   2012   2011   2010   2009   2008   2007   2006   2005   2004   2003   2002   2001   2000   1999   1998   1997   prior projects
by contact:  all contacts
Show Contacts
Maurer Michael Saffari Amir Schulter Samuel Seichter Hartmut Zeisl Bernhard Lex Alexander Arth Clemens Barakonyi István Bauer Joachim Beichel Reinhard Bischof Horst Bornik Alexander Reitinger Bernhard Bauer Christian Gruber Lukas Kainz Bernhard Pirchheim Christian Wagner Daniel Kalkofen Denis Donoser Michael Elbischger Pierre Ferstl David Fraundorfer Friedrich Reitmayr Gerhard Godec Martin Graber Gottfried Grabner Markus Grubert Jens Hartl Andreas Hauswiesner Stefan Riemenschneider Hayko Grabner Helmut Hirzer Martin Hofer Manuel Hoppe Christof Irschara Arnold Newman Joseph Junghanns Sebastian Khan Inayatullah Kalkusch Michael Karner Konrad Khlebnikov Rostislav Klaus Andreas Klopschitz Manfred Kluckner Stefan Köstinger Martin Kontschieder Peter Pirker Katrin Kruijff Ernst Langlotz Tobias Langs Georg Leberl Franz Lee Felix Leistner Christian Leitner Raimund Lenz Martin Mauthner Thomas Meixner Philipp Mendez Erick Grabner Michael Heber Markus Mühl Judith Mulloni Alessandro Ober Sandra Pacher Georg Partl Christian Pflugfelder Roman Pinz Axel Roth Peter M. Pock Thomas Puff Werner Pan Qi Ram Surinder Ranftl René Grasset Raphael Recky Michal Regenbrecht Holger Reinbacher Christian Rüther Matthias Rumpler Markus Santner Jakob Sareika Markus Schall Gerhard Schmalstieg Dieter Schulz Hans-Jörg Sormann Mario Steinberger Markus Sternig Sabine Storer Markus Straka Matthias Streit Marc Tatzgern Markus Nguyen Thanh Nguyen Thuy Trobin Werner Unger Markus Uray Martina Urschler Martin Veas Eduardo Waldner Manuela Wendel Andreas Werlberger Manuel Winter Martin Wohlhart Paul Zach Christopher Zebedin Lukas Zollmann Stefanie
by keyword:  all keywords
Show Keywords
3D Computer Vision 3D reconstruction Aerial Vision Augmented Reality Augmented Video Best Paper Award Biometrics Caleydo Computational Photography Computer Graphics Computer Vision Convex Optimization Coordinate transformations detection face Fingerprint Georeferencing GPU GUI HOG Human Computer Interaction Image Labelling Industrial Applications Information Visualization integral imaging Interaction Interaction Design Machine Learning Medical computer vision Medical Visualization Mixed Reality Mobile computing Mobile phone Model Multi-Display Environments Multiple Perspectives Object detection Object recognition Object reconstruction Object Tracking On-Line Learning Robotics Segmentation Shape analysis shape from focus SLAM Software Projects Structure from Motion Surveillance SVM Symmetry Tracking Fusion Tracking, Action Recognition User Interfaces Variational Methods Virtual reality and augmented reality Visual Tracking Visualization
per page:    all   50   20
  Title     Abstract     Start     End  
3D Object Scanner
(details)

The creation of three-dimensional digital models of complex real-world objects is the task of this project. These models represent documents which have to be readable by a CAD-system for industrial use.
Our approach is based on high resolution digital images of the object from different view points to generate shape from stereo.

3-Dimensional Measurement and Virtual Reconstruction of Ancient Lost Worlds of Europe (MURALE)
(details)

Tools will be developed for the reconstruction of a currently excavated archaeological site for different periods throughout the time of its occupation. This includes the development of 3D acquisition systems that can measure a range of objects of different dimensions to produce accurate and realistic looking 3D models and of tools for virtual reconstruction, documentation and classification of objects ranging from pottery sherds to entire urban building complexes. The project will provide archaeologists with the tools to support the analysis and restoration of their finds. The virtual artefacts and buildings together with the related information will be stored in a multimedia database with appropriate searching and querying functionality. 3D visualisation technologies will be developed for the interactive presentation of archaeological results in museums and via the internet, to the broad public as well as to experts. To provide Europe with an archaeological lead.

Partner:

Departement Elektrotechniek ESAT-PSI, Katholieke Universiteit Leuven

2000 2003
3D Paper Structure Analysis
(details)

Most technological paper qualities are directly or indirectly influenced by the three-dimensional paper structure which means the spatial arrangement of fibres, fillers, pores and if necessary of the coating. In the area of the structure analysis, two main groups can be distinguished: destructive and non-destructive approaches.

The paper structure analysis methods have to fulfil the following basic requirements. The quality of the 3D data must be high enough to make an exact delimitation between the relevant paper contents possible. Furthermore the spatial resolution must at least lie in the area of a micron. In order to be able to make statistically reasonable statements for the complete paper sample, sizes of the range of at least one square centimetre must be analyzed. To conclude, the time expenditure to the digitalization of the paper sample should also lie within a practicable area of hours.

Primary objective of the project is the detailed analysis of the fibre network structure of a paper sample by means of image analysis methods. Still this application is an extremely complex problem and in this resolution (microns) and sample size (square centimetre) unsolved. Therefore the development of a completely new concept is necessary. This concept should finally make a general assignment of the three-dimensional paper structure to pre-defined paper-ingredients classes possible. As a final result the segmentation of single fibres and their three-dimensional tracking is realizable.

2003 2008
3D Reconstruction of Electrical Impulse Discharges
(details)

Electrical impulse discharges in nature are visible as lightning. Their impact point can be electro magnetically located up to a precision of several hundred meters. In some restricted areas such as industrial plants, airports etc. it desirable to know the the impact region and path of the lightning up to a precision of a few meters. If visibility is not too restricted by weather conditions, a multi-camera setup would be a viable option to locate path and impact area of the discharge.

In this project impulse discharges of a few meters are synthetically generated under laboratory conditions and reconstructed using a multi camera setup.

2007 2008
A Low-Cost System for Automatic People Tracking in a Labyrinth
(details)

After medical treatment of visually handicapped people it is desirable to evaluate the benefit of the treatment for the patient. Especially the capability of the patient to orient himself in a three-dimensional environment, to navigate and recognize obstacles is of interest.

For a clinical evaluation under controlled circumstances a labyrinth has been built through which the patient ha to navigate. Obstacles may be randomly placed in the labyrinth. A multi-camera system keeps track of the patients movements and extracts parameters such as position, speed, head rotation etc.

2006 2007
Active Appearance Models in Quantitative Musculo Skeletal Radiology
(details)

Rheumatoid Arthritis (RA) is an incurable disease leading to severe disabling mutilations of synovial joints. RA affects predominantly the peripheral joints of the appendicular skeleton. RA is with 17% one of the leading causes of disability among persons aged 15 years or older. The prevalence is 1-2%. A recent study estimated the total cost to the North American economy caused by arthritis and its related effects to be 64 billion.

The accurate quantification of the progression of the disease is a decisive factor during its treatment. Until now mainly manual quantification procedures are utilized. They are time consuming and lack reproducibility as well as accuracy. Among others these restrictions have severe adverse effects to clinical trials and to continuous therapy of patients.

We propose a computer based method that performs the quantification by means of automated image analysis and pattern recognition. The goal is to fully automatically identify the bones of the hand/wrist and extract exact quantitative information about the extent of the erosions caused by rheumatoid arthritis based on a radiograph.

The following lines will be investigated during the project:

  • A fully automatic method for quantification of RA based on hand radiographs.
  • A more accurate, detailed scoring system for RA assessment.
  • Novel concepts of Active Appearance Models (AAMs).
  • Applicability of the developed methods to other similar diseases.
2004 2007
Active Fusion Using Bayesian Networks
(details)
Active Fusion with Evidence Theory
(details)
Active Fuzzy Fusion
(details)

Information fusion deals with the integration of information from several different sources. The necessity to fuse fuzzy information arises quite naturally in problems of image understanding because imprecision, uncertainty and ambiguity can be found at all levels, from the image itself to the results of high-level processing. In addition individual visual cues are often unreliable, even misleading. Thus integration of vision modules is necessary to obtain a reliable interpretation of complex images.

The Active Fusion approach followed in this research project has as its final goal the construction of a proto type system which is active in the sense that at each step of processing it can select and request the most promising next source of information and fuse the new results with the already gathered information. We expect Active Fusion not only to become a powerful new mechanism for the efficient control of an image understanding system but also to provide a way to deal with wrong, missing or ambiguous data. For example, the system is intended to be capable of actively choosing among different processing sequences and different views of the same scene to resolve ambiguities.

The research project Uncertain Information Fusion in Image Understanding pursues a thorough investigation of possibilities to incorporate the above ideas in an eigenspace based object recognition system.

Active Inspection System for Steel Quality Control
(details)

In the steel-producing industry it is very important to control the quality of steels. At the moment the estimation is mainly done by human inspection of specially prepared steel surfaces with the help of light-microscopes. Each particular steel specimen is classified by assigning it to a reference chart, corresponding to the micro-structure of interest. For example, in the case of carbide distribution the reference chart consists of 28 classes arranged in 4 rows of 7 columns according to the 4 types and 7 degrees of the carbide distributions.

The purpose of this project is to automate the assessment of the micro-structure of steel specimens (e.g. the carbide distribution) by means of an active inspection system consisting of a computer-controlled light microscope and a workstation with classification and control software. The system yields a quantitative evaluation of the micro-structures, in contrast to the qualitative estimation of human inspection and consequently, more reproducible results. Moreover, an improved objective redefinition of the standard chart can be achieved.

Active Interpretation of Occlusion
(details)

Occlusion plays an important role in recovering relevant structure from a dynamic scene. In the region near the edges it causes a change of visual information that is implicitly modeled by projective relations between two viewpoints in a stereo camera setting. In the case of uncalibrated images, a new contribution is to apply the framework of plane homographies in projective space under epipolar constraints to define a rule base for edge classification.

Analysis of Combustion Processes in Engines
(details)

Using an endoscope for the optical access to the combustion chamber of an engine makes it possible to study injection and combustion phenomena without compromising engine operation conditions.

Based on the endoscope technique the company AVL developed a new digital image capturing system, where a CCD camera instead of a high speed movie camera is used to observe combustion processes. This has great advantages in the area of image management and with regard to the possibility of online image processing. The disadvantage of using a CCD camera is that only one image per combustion cycle can be obtained. Stochastic cycle-to-cycle variations of the combustion process make it necessary to capture and analyze a statistically significant multitude of images of each crank angle.

With the confined number of images per crank angle a maximum of information of the combustion process should be gained with the help of image processing. One major goal of this project is to synthesize a movie sequence of the combustion process from images of different cycles. This image sequence should show a representative combustion process and the image to image transitions should be as smooth as possible.
For the analysis of images of a specific crank angle, methods are investigated to visualize cycle-to-cycle variations and to calculate or to select the most representative image.
From combustion images of Diesel engines the flame temperature can be determined by the two color method. For this purpose, the color CCD camera is calibrated using a tungsten striplamp to measure light density in two spectral ranges.

APAFA: Automated Photogrammetric Aerial Feature Analysis
(details)

The systematic creation of models of the real world to support the locational awareness on the Internet can be achieved if previously required massive manual labor gets replaced by automated procedures. A particular challenge exists in the automation of the extraction of the 4 classical map features buildings, circulation spaces (e.g. road networks), vegetation and water bodies, as well as their interaction. Decennia of research have been unable to automate the extraction of these features from classical aerial photography towards an economically viable result. However, we believe that we can succeed in the proposed project to develop automated procedures to create feature data for three reasons. First is the recent advent of digital aerial sensors producing highly redundant digital large format aerial photography. Redundancy will be obtained by using high forward and side overlaps, say at 80% and 60%, so that every point in the terrain is imaged at least 10 times, and any algorithm can rely on multiple analysis results that then can either reinforce or cancel one another. Second, the geometric redundancy gets augmented by a radiometric redundancy using 4 spectral bands, adding an infrared band to the classical red, green and blue color channels. Third, we will combine the classical "object reconstruction" approach available from stereo procedures, by new recognition methods. While classically a "car" on a street may have been seen via a "point cloud" and would have to get recognized simply by a representation of local height anomaly on an otherwise flat reference surface, recognition includes the use of stored images of cars in a data base to actually recognize a car as a human would do when inspecting an aerial image. The project is split up into five work packages which will focus on how reconstruction and recognition techniques can help each other and how additional information either from a previous mission or GIS can be integrated in the 3D modeling framework. One work package will address the assessment of the obtained quality, another will address project management and dissemination activities. Within the project we will develop an extensive library of combined recognition/reconstruction methods, and apply them to a range of test data sets. Test data will vary in geometric resolution (pixel size), overlaps, and types of terrain scenarios.

2007 2010
Application of Image Processing in Materials Science
(details)

The purpose of the project is to develop a powerful tool for the investigation of the deformation and fracture behaviour of materials. It is an interdisciplinary project combining the fields of materials science and computer science. The aim of the project related to computer science, more precisely to computer vision is: To develop a system for the automatic reconstruction of surfaces from scanning electron stereophotograms, integrating various reconstruction techniques (shape from stereo, photometric stereo etc.). The system shall be especially appropriate for analyzing fracture surfaces and for recording the local deformation fields during in-situ loading experiments in the scanning electron microscope.

**Partnerlist:**

"Erich-Schmid-Institute for Solid State Physics, Austria":http://www.oeaw.ac.at/esi/

1998 2000
AR4DOC - Augmented Reality for Document Inspection
(details)

Smartphones have evolved considerably in processing power over the last years. They now feature multi-core CPUs as well as GPUs and consumer-quality cameras up to HD resolution. This makes them an interesting platform for graphics and vision and opens new opportunities for research.

The aim of AR4DOC is to facilitate the task of document inspection by a human operator. This requires the person to have detailed knowledge about the nature of a document, which may be outdated or even unavailable at the time of inspection.

We seek to provide this information in an interactive way using Mobile Augmented Reality (AR), so that a well-grounded decision on the vailidity of a document is possible. This involves several tasks such as document localization, recognition, tracking, presentation as well as interaction.

 

 

 

 

2010 2013
ARIS*ER - Augmented Reality in Surgery
(details)

ARIS*ER is a Marie Curie Research Training Network addressing a cross-disciplinary area, critically in need of developing researchers with the understanding of the cross-cutting issues involved in developing tools for Minimally Invasive Therapy. The multidisciplinary consortium, aims at providing training for young researchers through a structured training and knowledge transfer program – that will provide Europe with human resources with knowledge that will lead to better healthcare to citizens in Europe. The particular focus of the research training and joint project will be software that is user-friendly, fast and reliable for the practitioners of minimal invasive therapy (MIT). MIT is a compound of minimally invasive surgery, image guided surgery and interventional radiology. MIT makes use of numerous sources of information including multi-modal images and patient information systems. Intelligent processing of this information comprises a vast pool of knowledge that can aid the operator in his decisions. The ultimate goal of the joint project, which will give the recruited researcher training-by-doing, is to create an Augmented Reality system for interactive image guided therapy providing the clinical user with a new generation of decision support tools. This system will integrate intra-operative and pre-operative image-information and enable the user to see beyond the organ surface to inner structures and pathology. An intuitive human computer interface consisting of 3D display systems, haptics and robotics will hide the underpinning complexity of the decision support tools. Demonstrators will be made aiming at providing a seamless workflow for the clinical user conducting image-guided therapy.

2005 2009
AUGUR: portable AR visualization of structure within structure using high precission detection
(details)

This project aims to develop portable measurement tools with in-situ visualization for the construction industry. A future measurement tool will provide a direct augmented reality view of measured properties over the real environment together with instructions as to where and how a certain task can be completed. For example, a metal detection tool should be able to provide direct visual feedback on the location of hidden metallic structures over a live video view of the inspected wall area. Furthermore it can guide a construction engineer to the optimal position for drilling a hole, avoiding any damage to existing structures.

Thus the tools should combine information from several sources to provide interactive and contextaware

guidance: Measurements from built-in sensors; location-aware through online tracking and registration; spatial, semantic information retrieved from a building information system (BIM). At the same time, future tools need to be simple to be used by non-expert users; therefore the system needs to be intuitive and guide users in the correct operation to fulfil their tasks. To accomplish this goal, The project addresses the following challenges:

  • Tracking for mobile devices in changing and unknown environments for correct visual overlays. We will investigate the combination of visual online reconstruction methods with range finders and coarse models for absolute registration.
  • X-Ray visualization of hidden and abstract information in unknown environments. Here we will investigate automatic approaches that take the environment’s appearance and the virtual information into account to select the best visualization method.
  • User guidance based on measured and plan information requires automatic analysis of the spatial arrangements and automatic visualization.
2012 2013
Automated 3D Reconstruction of Buildings from Aerial Images Using GIS Data
(details)

In a CyberCity buildings are the most important part. In this case, they are fully phototextured and include parts such as roofs with chimneys and skylights, facades with balconies and bay- windows, etc. In the past roofs were modelled interactively on photogrammetric workstations or special programs were used with intervention of the human operator. The current research is oriented towards the automation of the data collection process so that large numbers of buildings of a city can efficiently be collected and regularly updated.

The roofs are being reconstructed from aerial images, the initial body of a building (building box) derives from known building footprints from a multi-purpose digital map, this is being extended in the vertical direction up to the roof. Roofs will be phototextured from aerial images, the building box (facades) will be phototextured after improvements with automated measurements of facades-detail from street level photography.

As an input dataset for the roof reconstruction we use aerial images with known orientation parameters, digital elevation models (DEM) and GIS-data (building footprints at the ground level and approximate elevation of the roofline from the multi-purpose digital map).

Automated Geocoding of Satellite Radar Images
(details)
Automated Melanoma Recognition
(details)

During the last fifty years the occurrence of melanoma has increased dramatically. Whereas in the thirties of this century one out of 100 000 people living in the United States or Europe suffered from melanoma, this number has risen to 15 out of 100 000 nowadays and is still increasing.

Because of the curability of melanoma by surgical excision in the early stages of tumor development, early tumor recognition is of utmost importance. During the last few years a significant improvement in early tumor recognition has been achieved by using the so-called epiluminescence microscopy (ELM). This technique uses oil immersion to render the epidermis translucent, thus giving insight into sub-surface structures of the skin which are not visible otherwise.

This project deals with the computerized analysis of digitized ELM-images of pigmented skin lesions, the final goal being the automatic classification of the lesions as benign or malignant (i.e. melanoma).

The analysis is carried out in several steps: The first step is the segmentation process, in which the skin lesion is extracted from the background in the ELM-image.

In the next step, a set of parameters which contain information about the malignity of the skin lesion are determined. The choice of the appropriate parameters is based on information found in medical literature, as well as on personal discussions with experienced dermatologists.

Finally, a classification based on the previously extracted parameters is carried out. The evaluated results show that the initial efforts already provide the correct result in 86% of all cases examined thus far.

1994 1997

[Powered by Plone]