Transcript Angle Measure Technique (AMT) for multivariate image

A comprehensive database for texture and signal characterization
and
the eAMTexplorer (Angle Measure Technique) software system
Knut Kvaal, Maths Halstensen, Sergei V. Kucheryawski, Simen Kvaal,
Andreas S. Flø, Penti Minkinen
and Kim H. Esbensen
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
Primary goal and background
 Present an implementation of a database for storage and
retrieval of texture images and 1D signals
 Describe the software package to handle AMT calculations
– eAMTexplorer
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
Texture - A matter of scale
Yann Arthus-Bertrand
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
Texture - A matter of scale and illumination
Takes advantage of low
illumination angle to
enhance surface
morphology (shadows)
@Knut Kvaal
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
The Database
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
Evaluation of texture algorithms
 In order to investigate (compare) the performance of different
texture algorithms there is a need to have
– Image samples with systematically ordered properties
– References to other research on the same image samples
– Easy retrieval of image samples with wanted properties
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
IMAGE DATABASE VS COLLECTIONS
 Image collections
– Often stand-alone image samples with special properties
– Following an article or a research project
– Global availability by point to point download
– Not searchable - unless you are ”Googleing”
 Image database
– Central storage of collections
– Defined criteria of storage
– Information retrieval by search criteria
– Controlled revisions
– Global availability
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
THE BRODATZ IMAGE COLLECTION
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
The Brodatz collection evolving in the litterature
 Brodatz texture album includes black and white photos of
structured textures (e.g. D25, D74)
– textures with dominating orientations (e.g. D11, D15)
– random textures with microscopic structures (e.g. D59, D90)
– large scale structures, etc.
– The album has become the de facto standard for evaluating texture
algorithms.
 Problem:
– Where are the originals? (Actually in a printed book!)
– Copyright ?
– Mostly used: “Randen Collection”
• NB Very bad for small scales
 Common solution: Researchers make/scan their own Brotatz
samples?
 Or: A central database?
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
WE HERE PRESENT AN OPEN SOURCE WEB ENABLED
DATABASE BASED ON
LINUX
Operating system
APACHE
Web server system
LAMP
MySQL
Database management system
PHP
Programming language
The Application: IMAGE DATABASE
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
THE IMAGE DATABASE: SPECIFICATIONS
 Open source implementation with a working implementation
and still under development supported by the community
 Well documented system and extensible to new features
 Selective image upload and download
– Images are up and down loaded as ZIP archives
– Whole collections or single image retrieval
– SQL Structured Query Language.
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
GALLERY2
Image
collections
added from a
remote PC
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
LAMP
&Gallery2
Search for:
“BAGUETTES”
Work on the same
copy of the selection
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
IMAGE COLLECTIONS ORGANISED IN A DATABASE
 Photex
 Brodatz
 Noctua
 Lazebnik
 Ribe
 DESTEX
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
GALLERY2
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
eAMTexplorer
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
AMT – Angle Measure Technique
 Over 10 years AMT has evolved into a powerful and flexible
method (with many implementations variants)
 There is a need for a flexible and well defined software
package to help in the explorative analysis process
 AMT consortium 2006 has defined the central aspects of AMT:
– Spiral unfolding, “chop chop”
– Regular sampling, stratified random
– Circle algorithm (original Andrle)
– Mean Angle, MDY, Variogram, (median angle)
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
AMT – Angle Measure Technique – “Crash intro”
Jacob Laugesen, IMAT
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
Vectorise an image cont.
Jacob Laugesen, IMAT
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
Vectorise an image cont
The 2D image is unfolded to
a 1D representation (vector)
This representation is now
a 1-dimensional SIGNAL
Jacob Laugesen, IMAT
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
Compute the AMT measures
MA(s) = 1/N * Si=1,N (ai)s
MEAN ANGLE
MEAN DIFFERENCE Y MDY(s) = 1/N * Si=1,N (|Biy -Aiy|)s
Ai
Bi
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
THE IMPLEMENTATION OF AMT ALGORITHM IN
eAMTexplorer
 Several versions of AMT implementations
– Authors have made their own implementations
 The AMT algorithm used to have many optional parameters
 We present guides for choosing a minimalist set of parameters
– Spiral unfolding, “chop chop”
– Regular sampling, stratified random
– Circle algorithm (original Andrle)
– Mean Angle, MDY, Variogram, (median angle)
 eAMTexplorer is based on a flexible framework written in
Delphi and C++
– Each algorithm part is implemented as a DLL (Dynamic Link Library)
– Input from database selections, scanners etc
– The DLLs are loadable from other applications
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
Delphi Components
 Delphi components
– Ready made object oriented packages written by professional developers
 Image processing
– HIComponents
 Data handling and visualisation
– SDL component suite
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
eAMTexplorer
www.umb.no
External
routines for
other texture
measures
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
eAMTexplorer dialogue applied on an image
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
eAMTexplorer dialogue applied on a 1-dimensional signal
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
BAGUETTE SAMPLES RETRIEVED FROM THE DATABASE
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
eAMTexplorer
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
Restults from eAMTexplorer analysed by the Unscrambler
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
PCA SCORES OF AMT VIA UNSCRAMBLER
MACHINE
MADE (2)
HAND
MADE (1)
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
IMAGES MOUNTED AS POINTS IN THE AMT PCA SCORES
USING PLS-TOOLBOX ++
PC 2
HAND
MADE
MACHINE
MADE
PC 1
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
AMT applied on the BRODATZ texture database
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
AMT spectra for the Brodatz texture database
MA (Mean Angle)
MDY
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
AMT spectra represented as bitmaps
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
Example: PCA scores of AMT spectra
Closed vs open
Coarse vs Fine
www.umb.no
NORWEGIAN UNIVERSITY OF LIFE SCIENCES
Summary
 Texture Image Database (Gallery2) used as front-end for an
image database is flexible and shows very promising results
 eAMTexplorer is a versatile tool for visual exploration of AMT
features and a powerful generator for AMT complexity spectra
 Database and eAMTexplorer are available as stand-alone
freeware
 eAMTexplorer DLL- to be incorporated in chemometrics
software
www.umb.no