Transcript WP1 Apron Activity Model Overview

Project Overview
Video Understanding
Evaluation
David CHER
R&D department
SILOGIC S.A.S , Toulouse, France
INRIA, NICE, December 7th-8th 2006
ETISEO / Techno-Vision
ETISEO is part of the Techno-Vision program
Partially funded by the French government.
2 years duration, started in January 2005
To evaluate vision techniques
for video surveillance applications.
INRIA, NICE, December 7th-8th 2006
Project committee
• INRIA Sophia-Antipolis–ORION,
scientific leader.
• SILOGIC S.A., Coordinator, evaluator
& Data provider.
• INRETS-LEOST, Data provider.
• C.E.A.-LIST,
Data provider.
INRIA, NICE, December 7th-8th 2006
ETISEO Main objectives
- To promote evaluation usage in image
processing domain,
- To diffuse good practices,
- To create perennial evaluation structure.
INRIA, NICE, December 7th-8th 2006
The way
- To support resources
generation & diffusion,
- To create specific tools & metrics,
- To support evaluation cycles,
- To
encourage
a
large
&
active
participation
- International open participation,
- To communicate evaluation results.
INRIA, NICE, December 7th-8th 2006
Detailed Objectives
To conceive automatic evaluation tools for
vision algorithms to allow a fair and
quantitative comparison between algorithm
results and reference data.
- To acquire precise knowledge of vision
algorithms capabilities to assess technological
limits.
To have a meaningful evaluation
INRIA, NICE, December 7th-8th 2006
Main steps
- Nice, May 2005
first INRIA seminar
- Lille, December 2005
INRETS Seminar
- Evaluation cycle 1 – January 2006
to evaluate the process
- ETISEO Evaluation – May 2006
final evaluation
INRIA, NICE, December 7th-8th 2006
Resources production
- ETISEO Metrics definition
- ETISEO video annotation rules
- ETISEO data-set collection:
· Content definition
· Partners equipment installation
· Video sequences recording
· Data set management
- ETISEO corpus annotation
- Automatic comparison tool.
INRIA, NICE, December 7th-8th 2006
Evaluation schedule
- First evaluation cycle ( for test )
- ETISEO evaluation cycle ( 2nd cycle).
Jan
April
Seminar
May
July
Oct
Dec
CYCLE 1
First evaluation
Evaluation review
CYCLE 2
Etiseo evaluation
Evaluation review
Seminar
INRIA, NICE, December 7th-8th 2006
Dissemination
VS-PETS 2005
2nd Joint IEEE International Workshop on Visual Surveillance
and Performance Evaluation of Tracking and Surveillance.
October 15-16 2005 Beijing, China
In Conjonction with
ICCV 2005
(10th IEEE International Conference on Computer Vision )
ASTI’2005
2èmes meetings of Sciences and Information Technologies
Techno-langue / Techno-vision Journey
October 21th 2005, Clermont-Ferrand, France
INRIA, NICE, December 7th-8th 2006
Dissemination
RFIA 2006
15th French-speaking congress AFRIF–AFIA
Pattern recognition and Artificial Intelligence
"Performance evaluation in image processing and vision by
computer" Rond table
January 25-27 2006, Tours, France
PETS 2006
Workshop on Visual Surveillance and Performance Evaluation of
Tracking and Surveillance
June 18 -2006 New-York , USA
In Conjonction with
CVPR 2006
(IEEE Conference on Computer Vision and Pattern Recognition
2006 )
INRIA, NICE, December 7th-8th 2006
Dissemination
CLEAR 2006
Evaluation Campaign and Workshop - Classification of Events,
Activities and Relationships- supported by the European
Integrated project CHIL, the US ARDA VACE program and the US
National Institute of Standards and Technology (NIST).
April 2006, Southampton, U.K.
INRIA, NICE, December 7th-8th 2006
ETISEO Participation
- All participants are welcome to participate.
- Voluntary is the rule:
participants are expected to test their algorithms on
their own and to send their results to the evaluator.
- After the participant’s commitment,
video database with ground truth and metrics with
evaluation tools will be transmitted.
- All participants will be welcome to attend freely
workshops organized during the project.
INRIA, NICE, December 7th-8th 2006
ETISEO participants
-
Barco
Capvidia NV
INRIA-ORION
Lab. LASL University ULCO Calais
Nizhny Novgorod State University
Queen Mary, University of London
Queensland University of Technology
Robert Bosch GmbH
Univeristy of Southern California
Université Paris Dauphine
University of Central Florida
University of Illinois at Urbana-Champaign
University of Maryland
University of Reading
University of Udine
VIGITEC SA/NV
INRIA, NICE, December 7th-8th 2006