Transcript inria cr1, 2007

Concour chargés de recherche de 1ère classe,
INRIA Rennes, May 2 2007
Fabio Cuzzolin
Now Marie-Curie fellow with the
Perception project
INRIA Rhone-Alpes
career path and mobility

Master’s thesis on gesture recognition
at the University of Padova
 Visiting student, ESSRL, Washington University in St. Louis, and
at the University of California at Los Angeles (2000)

Ph.D. thesis on belief functions and uncertainty theories (2001)

Researcher at the Politecnico di Milano with the Image and Sound
Processing group (2003-2004)

Post-doc at the University of California at Los Angeles, in the
UCLA Vision Lab (2004-2006)

Marie Curie fellowship, INRIA Rhone-Alpes
scientific production/collaborations


13 single-name publications, + 9 first author, 3 single-name
IEEE Transactions
collaborations with several groups
UBoston
SIPTA
EPFL-IDIAP
Carnegie Mellon
Setubal
Pompeu Fabra


collaborations with journals: IEEE PAMI IEEE SMC-B CVIU
Information Fusion Int. J. Approximate Reasoning
currently 7 journal papers and 7 conference papers under review
an interdisciplinary record
Machine Learning
 learning Riemannian metrics
Discrete
Mathematics
research
 abstract independence (1+1pubs)
Computer Vision
 motion analysis (12+2 pubs)
 gesture and action recognition
 object pose estimation
 data association
 gait identification
 bodypart segmentation
Belief functions and
Imprecise Probabilities
 geometric approach to uncertainty theory
(9+9 pubs)
 algebraic analysis (3+1 pubs)
major contribution: unification of
uncertainty theories
 a number of formal descriptions of uncertainty have been proposed:
 probabilities, possibilities, fuzzy sets, random sets, monotone
capacities, inner measures
 how to arrange them in a single, unified framework?
 I formulated a geometric approach to uncertainty theories,
which unifies additive and non-additive measures
 Fabio Cuzzolin, “Geometry of Dempster's rule of combination”, IEEE Transactions on Systems, Man,
and Cybernetics part B, 34(2), pages 961- 977, April 2004
 Fabio Cuzzolin, “Two new Bayesian approximations of belief functions based on convex geometry”,
IEEE Transactions on Systems, Man, and Cybernetics part B, 37(4), August 2007
 Fabio Cuzzolin, “A geometric approach to the theory of evidence”, IEEE Transactions on Systems, Man,
and Cybernetics part C, 2007 (to appear)
geometric approach
uncertainty measures can be represented as points of a simplex!
P(b)
P
p
P(b’)
b
b’
b
f

working with belief functions is
working with convex sets of probs

approximating belief functions
with probabilities or fuzzy sets
another example: spectral matching


central problem in vision (and not only): matching
nonlinear embeddings (LLE,ISOMAP) map a dataset onto an embedding
space while preserving local structure or geodesic distances
But then they map articulated bodies into a stable shape
0.1
0.05
50
0
45
45
0.05
40
40
35
35
0.1
30
0.2
0.15
0.08
30
25
25
20
20
15
15
0.1
0.06
0.04
0
0.02
0
0.1
0.02
0.2
0.15
0.1
0.05
10
10
5
5
0
0.05
30
0
20
10
10
0
0
10
20
5
10
0
0
0. 1
0.2
0.1
0
0. 1
0. 2
0.06
0.04
0.02
0
0.02
0.04
0.06
0.08
spectral matching
they can then be used to match dense shapes by simply
aligning their images after embedding!
graph matching
motion capture
protein analysis
bodypart
segmentation
 Fabio Cuzzolin, Diana Mateus, Edmond Boyer, and Radu Horaud, “Robust spectral 3D-bodypart segmentation in time”, submitted to the
International Conference on Computer Vision (ICCV 2007), Rio de Janeiro, April 10 2007
 Diana Mateus, Fabio Cuzzolin, Edmond Boyer, and Radu Horaud, “Articulated Shape Matching by Robust Alignment of Their Embedded
Representations”, submitted to ICCV2007, Rio de Janeiro, 2007
 Fabio Cuzzolin, “Learning Riemannian Metrics for Classification of Dynamical Models”, submitted to the International Conference on Computer
Vision (ICCV 2007), Rio de Janeiro, April 10 2007
A view of the future: an integrated
multi-camera framework

very promising direction in vision: multi-camera systems

an integrated, hierarchical framework
marker-less
motion capture
surveillance
identity
recognition
model fitting
(stick-articulated)
action recognition
action
segmentation
unsupervised body-part
segmentation
image data fusion
3D reconstruction
multiple views
Contributions to Vista and
the Unité de Recherche

on the methodologies: new expertise in fields like:





on the problems: familiarity with applications like




non-Bayesian theories
spectral methods
discrete math
sensor fusion under uncertainty
surveillance and identity recognition
context-aware applications (event detection, gesture analysis)
possible new directions: smart rooms, driver’s behavior
networking: links with groups in computer vision, statistics,
machine learning imprecise probabilities, graph theory
Bibliography
Journal papers
•
•
•
•
Fabio Cuzzolin,
Fabio Cuzzolin,
Fabio Cuzzolin,
Fabio Cuzzolin,
Geometry of Dempster's rule of combination, IEEE Transactions on Systems, Man, and Cybernetics part B, 34(2), pages 961- 977, April 2004.
Algebraic structure of the families of compatible frames of discernment, Ann. Math. Artif. Intell. 45(1-2), pages 241-274, 2005
Two new Bayesian approximations of belief functions based on convex geometry, IEEE Transactions on Systems, Man, and Cybernetics part B, 37(4), August 2007
A geometric approach to the theory of evidence, IEEE Transactions on Systems, Man, and Cybernetics part C, 2007 (to appear)
Journals under review
•
•
•
•
•
•
•
Fabio Cuzzolin,
Fabio Cuzzolin,
Fabio Cuzzolin,
Fabio Cuzzolin,
Fabio Cuzzolin,
Fabio Cuzzolin,
Fabio Cuzzolin,
The geometry of consonant belief functions: simplicial complexes of possibility measures, Fuzzy Sets and Systems, August 2006
On the fiber bundle structure of the space of belief functions, Annals of Combinatorics, October 2006
Geometry and combinatorics of plausibility and commonality functions, International Journal of Uncertainty, Fuzziness, and Knowledge-Based Systems, December 2006
The discrete mathematics of consistent belief functions, Information Sciences, December 2006
Dual properties of relative belief of singletons, IEEE Trans. Fuzzy Systems, February 2007
On the properties of the intersection probability, Artificial Intelligence, March 2007
The geometry of the relative plausibility of singletons, Annals of Mathematics and Artificial Intelligence, April 2007
Refereed conference papers
• Andrea Sorrentino, Fabio Cuzzolin and Ruggero Frezza, Using hidden Markov models and dynamic size functions for gesture recognition, Proceedings of the 8th British Machine Vision Conference (BMVC97) (Adrian F. Clark,ed.), vol. 2, pp. 560-570, 1997
• Fabio Cuzzolin and Ruggero Frezza, An evidential reasoning framework for object tracking, SPIE – Photonics East 99 - Telemanipulator and Telepresence Technologies VI vol. 3840, pp. 13-24, September 19-22, 1999
• Fabio Cuzzolin and Ruggero Frezza, Integrating feature spaces for object tracking, Proceedings of MTNS2000, Perpignan, France, June 21-25, 2000
• Fabio Cuzzolin, Families of compatible frames of discernment as semimodular lattices, International Conference of the Royal Statistical Society (RSS2000), Reading, September 12-15, 2000
• Fabio Cuzzolin and Ruggero Frezza, Geometric analysis of belief space and conditional subspaces, Proceedings of the 2nd International Symposium on Imprecise Probabilities and Their Applications (ISIPTA'01), Ithaca, NY, June 26-29, 2001
• Fabio Cuzzolin and Ruggero Frezza, Lattice structure of the families of compatible frames of discernment, Proceedings of the 2nd International Symposium on Imprecise Probabilities and Their Applications (ISIPTA'01), Ithaca, NY, June 26-29, 2001
• Fabio Cuzzolin, Lattice modularity and linear independence, 18th British Combinatorial Conference (BCC'01), University of Sussex, Brighton, UK, July 1-6, 2001
• Fabio Cuzzolin, Geometry of Dempster's rule, Special Session on Knowledge Representation under Vagueness and Uncertainty, 2002 International Conference on Fuzzy Systems and Knowledge Discovery (FSKD'02), Singapore, November 18-22, 2002
• Giambattista Gennari, Alessandro Chiuso, Fabio Cuzzolin and Ruggero Frezza, Integrating shape and dynamic probabilistic models for data association and tracking , proceedings of the IEEE 2002 Conference on Decision and Control, The Venetian Hotel,
Las Vegas, Nevada, December 10-13, 2002
• Fabio Cuzzolin, Ruggero Frezza, Alessandro Bissacco and Stefano Soatto, Towards unsupervised detection of actions in clutter, Proceedings of the 2002 Asilomar Conference on Signals, Systems, and Computers, vol.1, pp. 463-467, Asilomar Conference
Center in Paci¯c Grove, CA
• Fabio Cuzzolin, Geometry of upper probabilities, Proceedings of the 3nd International Symposium on Imprecise Probabilities and Their Applications (ISIPTA'03), Lugano, Switzerland, July 14-17, 2003
• Fabio Cuzzolin, Simplicial complexes of finite fuzzy sets, Proceedings of the International Conference on Information Processing and Management of Uncertainty IPMU'04, pp. 1733-1740 Perugia, Italy, July 4-9, 2004
• Fabio Cuzzolin, Augusto Sarti and Stefano Tubaro Action modeling with volumetric data, Proceedings of the 2004 International Conference on Image Processing ICIP'04, vol. 2, pp. 881- 884, Singapore, October 24-27, 2004
• Giambattista Gennari, Alessandro Chiuso, Fabio Cuzzolin and Ruggero Frezza Integration of shape constraints in data association filters, IEEE Conference on Decision and Control (CDC'04), vol.3, pp. 2668- 2673, Bahamas, December 14-17, 2004
• Fabio Cuzzolin, Augusto Sarti and Stefano Tubaro Invariant action classification with volumetric data, International Workshop on Multimedia Signal Processing, pp. 395-398, Siena, Italy, 9/29-10/1 2004
• Fabio Cuzzolin and Ruggero Frezza, Evidential modeling for pose estimation, Proceedings of the 4th International Symposium on Imprecise Probabilities and Their Applications (ISIPTA'05), Carnegie Mellon University, Pittsburgh, 2005
• Fabio Cuzzolin, On the properties of relative plausibilities, Proceedings of the International Conference of the IEEE Systems, Man, and Cybernetics Society (SMC'05), vol.1, pp. 594-599, Hawaii, USA - October 10-12, 2005
• Fabio Cuzzolin, The geometry of relative plausibilities, 11th International Conference on Information Processing and Management of Uncertainty IPMU'06, special session on \Fuzzy measures and integrals, capacities and games", Paris, July 2006
• Fabio Cuzzolin, Using Bilinear Models for View-invariant Action and Identity Recognition, Proceedings of CVPR'06, pp. 1701-1708, New York, June 18-22 2006
Under review
•
•
•
•
•
•
•
Fabio Cuzzolin, On the orthogonal projection of a belief function, submitted to the 5th International Symposium on Imprecise Probabilities and Their Applications (ISIPTA'07), Prague, February 23 2007
Fabio Cuzzolin, On the properties of the intersection probability, submitted to the International Conference on Uncertainty on Artificial Intelligence (UAI'07), Vancouver, March 2 2007
Fabio Cuzzolin, The convex geometry of consistent belief functions, submitted to the International Conference on Uncertainty on Artificial Intelligence (UAI'07), Vancouver, March 2 2007
Fabio Cuzzolin, On the nature of independence in the theory of evidence, submitted to the 5th International Symposium on Imprecise Probabilities and Their Applications (ISIPTA'07), Prague, March 4 2007
Fabio Cuzzolin, Learning Riemannian Metrics for Classification of Dynamical Models, submitted to the International Conference on Computer Vision (ICCV 2007), Rio de Janeiro, April 10 2007
Fabio Cuzzolin, Diana Mateus, Edmond Boyer, and Radu Horaud, Robust spectral 3D-bodypart segmentation in time, submitted to the International Conference on Computer Vision (ICCV 2007), Rio de Janeiro, April 10 2007
Diana Mateus, Fabio Cuzzolin, Edmond Boyer, and Radu Horaud, Articulated Shape Matching by Robust Alignment of Their Embedded Representations, submitted to the International Conference on Computer Vision (ICCV2007), Rio de Janeiro, 2007