Transcript RISK-EOS Delivering geoinformation services for floods and fires

Joint EEA - PROMOTE User Workshop on
GMES Atmosphere Services
EEA, Copenhagen 12 and 13 June 2008
AT M O S P H E R I C
I N F O R M AT I O N
QUALITY STRATEGY
Rosalia Delgado and Jean-Christopher Lambert
Belgian Institute for Space Aeronomy
BIRA – IASB, Brussels
13.06.2008
atmospheric information quality strategy
1/16
Joint EEA - PROMOTE User Workshop on
GMES Atmosphere Services
EEA, Copenhagen 12 and 13 June 2008
introduction
PROMOTE QA/Validation Office
FP6 IP GEMS model evaluation
FP6 IP GEOMon (“in situ” component of GAS)
FP7 MACC – GAS System Engineering
Network for the Detection of Atmos. Composition Change
(NDACC)
INSPIRE implementation
CEOS WG on Cal/Val / Atmospheric Composition Sub Group
13.06.2008
atmospheric information quality strategy
2/16
Joint EEA - PROMOTE User Workshop on
GMES Atmosphere Services
EEA, Copenhagen 12 and 13 June 2008
contents
RATIONALE
A GLOBAL FRAMEWORK
COMPONENTS AND INITIATIVES
THE PROMOTE QUALITY STRATEGY
IMPLEMENTATION
USERS AND USER NEEDS
SUMMARY & CONCLUSION
13.06.2008
atmospheric information quality strategy
3/16
Joint EEA - PROMOTE User Workshop on
GMES Atmosphere Services
EEA, Copenhagen 12 and 13 June 2008
rationale
WHY A GLOBAL DATA QUALITY STRATEGY?
Without proper quality assessment and
characterisation of the actual information
offered by a data product, this data
product is useless.
13.06.2008
atmospheric information quality strategy
4/16
Joint EEA - PROMOTE User Workshop on
GMES Atmosphere Services
EEA, Copenhagen 12 and 13 June 2008
rationale
WHY A GLOBAL DATA QUALITY STRATEGY?
“There is no formalised arrangement in Europe or elsewhere in the
World, to ensure the general validity of Earth Observation (EO)
data. Indeed, there is strong evidence that data collected by
different EO instruments often have significant discrepancies and
that this problem gets worse as higher level data products are
produced... The discrepancies and biases do not arise from any
lack of care in the design and calibration of EO instrumentation,
nor on the processing steps used to generate higher level data
products, but from the extremely challenging requirements for
accuracy that are made on such instruments, if the data they
collect are to meet the requirements of policy makers and
regulators, and of the challenges of operating in the hostile space
environment.”
Nigel Fox, NPL
CEOS WGCV
WG on Calibration and Validation:
http://wgcv.ceos.org
13.06.2008
atmospheric information quality strategy
5/16
Joint EEA - PROMOTE User Workshop on
GMES Atmosphere Services
EEA, Copenhagen 12 and 13 June 2008
rationale
KEYWORDS
standardization
calibration
interoperability
multi-mission
compatibility
service
sustainability
traceability
validation
harmonization
quality
controlled
data
TARGETS
FITNESS FOR
PURPOSE
BENEFITS
USER REQUIREMENTS
13.06.2008
Improved
capabilities
USER NEEDS
atmospheric information quality strategy
6/16
Joint EEA - PROMOTE User Workshop on
GMES Atmosphere Services
EEA, Copenhagen 12 and 13 June 2008
a global framework
THE GEO-CEOS DATA QUALITY STRATEGY
GEO Task DA-06-02: To develop a GEO data quality
strategy, beginning with space based observations
and evaluating expansion to in-situ observations.
Major topics
• Characterisation and classification of
Sites
• Satellite and In Situ Cal/Val Data Access
• Methodology and guidelines for Cal/Val
• Harmonisation of Quality Information
Cal/Val
Group on Earth Observations
http://earthobservations.org
Committee on EO Satellites:
http://www.ceos.org
13.06.2008
atmospheric information quality strategy
7/16
Joint EEA - PROMOTE User Workshop on
GMES Atmosphere Services
EEA, Copenhagen 12 and 13 June 2008
a global framework
DATA QUALITY
• Content/writing of a « procedure »
• Evaluating uncertainty
• Validating models and algorithms
• Selecting of « reference standards » • Organising and analysing comparisons
DATA POLICY
• Common metadata content and its linkage with datasets
• Domain harmonized formats for Cal/Val data exchange
• « Code of practice » for Cal/Val data providers&users
COMMUNICATION & EDUCATION
• Dictionary of terminology
• Mantainance, evolution & utilization of a Cal/Val Portal for all EO sensor
domains
13.06.2008
atmospheric information quality strategy
8/16
Joint EEA - PROMOTE User Workshop on
GMES Atmosphere Services
EEA, Copenhagen 12 and 13 June 2008
components and initiatives
THE CEOS CAL/VAL PORTAL
“…This portal shall support worldwide activities on
calibration and validation, and specifically ensure that
sensor intercalibration is favoured in a standardised
way. The overall goal is to increase measurement
accuracy of all the sensors which will be supported by
this system, so that the GMES (…) programme can be
served with the best information products available.”
http://calvalportal.ceos.org
Group on Earth Observations
http://earthobservations.org
Committee on EO Satellites:
http://www.ceos.org
13.06.2008
atmospheric information quality strategy
9/16
Joint EEA - PROMOTE User Workshop on
GMES Atmosphere Services
EEA, Copenhagen 12 and 13 June 2008
components and initiatives
GEO
CEOS
ESA
EC
INSPIRE
GEMS
GEOMON
GSE
PROMOTE
strategy,
best practices,
recommendations,
data policy,
education
13.06.2008
MACC
GAS
validation of
observations,
model
evaluation,
standard
definitions
centralized
expertise,
cooperation,
framework
developement
atmospheric information quality strategy
operational
services
10/16
Joint EEA - PROMOTE User Workshop on
GMES Atmosphere Services
EEA, Copenhagen 12 and 13 June 2008
components and initiatives
INSPIRE DIRECTIVE
http://www.ec-gis.org/inspire/index.cfm
“… trigger the creation of a European spatial information
infrastructure that delivers to the users integrated spatial
information services. These services should allow the users to
identify and access spatial or geographical information from a
wide range of sources, from the local level to the global level, in
an inter-operable way for a variety of uses.”
GMES SERVICE ELEMENT
• Set-up of QA/Validation Office for each GMES Service Element.
• Creation and implementation of validation protocols.
• Service quality control and compliance with user domain
standards, working practices and legislative requirements.
PROMOTE QUALITY STATEGY
Setup of a sustainable and reliable network of operational
services to support informed decisions on the atmospheric
policy issues...
13.06.2008
atmospheric information quality strategy
11/16
Joint EEA - PROMOTE User Workshop on
GMES Atmosphere Services
EEA, Copenhagen 12 and 13 June 2008
the promote quality strategy
GEO
CEOS
…
high level
requirements
VALIDATION
OFFICE
SERVICE
USER
SERVICE
PROVIDER
user
requirements
user
needs
SERVICE
LEVEL
AGREEMENT
13.06.2008
atmospheric information quality strategy
12/16
Joint EEA - PROMOTE User Workshop on
GMES Atmosphere Services
EEA, Copenhagen 12 and 13 June 2008
the promote quality strategy
ALGORITHM
DEVELOPMENT
THE VALIDATION PROTOCOL
RESEARCH
PARTNERS
VALIDATIONAGAINST
AGAINST
VALIDATION
INDIVIDUALCOMPONENTS
COMPONENTS
INDIVIDUAL
OPERATION
IMPLEMENTATION
• General rules to ensure
independent validation
unbiased
and
• Definition of services and data products
validation roadmaps
• Requirements for reference data sources for
validation
documentation,
document
availability, access and distribution rules
• Maintenance of validation standards, reports
and data sets
SYSTEM
DEVELOPERS
VALIDATION AGAINST
SPECIFICATIONS
OPERATION
USERS
USERS
AGAINST USER
REQUIREMENTS
UTILIZATION
SERVICE
PROVIDERS
PROVIDERS
QUALITY CONTROL
SERVICE
EXTENSION
13.06.2008
atmospheric information quality strategy
13/16
Joint EEA - PROMOTE User Workshop on
GMES Atmosphere Services
EEA, Copenhagen 12 and 13 June 2008
implementation
SERVICE PROVISION
SERVICE IMPLEMENTATION
VALIDATION
DOCUMENTATION
VALIDATION
MONITORING
SERVICE
QUALITY
VALIDATION
&DELIVERY
SERVICE
UTILIZATION
SLA*
VALIDATION
PROTOCOL
EXPAND,
UPGRADE,
ENHANCE
SERVICE
PORTFOLIO
SERVICE
REVIEW
QUALITY
ASSESSMENT
&
ANALYSIS
QUALITY PLAN
RECOMMENDATIONS
SERVICE EXPANSION UPDATE
SERVICE UTILIZATION/EVALUATION
Key inputs
Specifications
Global User Needs
User needs and standards
Service Utility Reports
Service Level Agreements
Outputs
Validation Protocol C5
Validation Report
C6
Quality Plan
M2
Issues
Consistency of Network structure
Service documentation process
Traceability of user needs
*Service Level Agreement
13.06.2008
atmospheric information quality strategy
14/16
Joint EEA - PROMOTE User Workshop on
GMES Atmosphere Services
EEA, Copenhagen 12 and 13 June 2008
users and user needs
WHAT IS A SERVICE LEVEL AGREEMENT (SLA)?
A Service Level Agreement regulates the relationship
between each service-network and each user organization
receiving service.
Essential user requirements are defined through Service
Level agreements (SLA).
Role
A communication support for Users and Service Providers
Objectively sets the purpose of products and services
Guarantee fitness for purpose of the QA/validation
Enforces product and service fitness for purpose
Benefits
•SLA’s help strengthening the service network structure
•Set targets for product and service improvement
•Support product and service traceability
•Are the base for service sustainability
13.06.2008
atmospheric information quality strategy
15/16
Joint EEA - PROMOTE User Workshop on
GMES Atmosphere Services
EEA, Copenhagen 12 and 13 June 2008
summary and conclusion
GEOSS/GMES
requirements
–
Traceability
and
interoperability of atmospheric data systems, products,
services, and their QA/QC, are only possible in the
framework of a global quality strategy implemented
consistently across all levels.
Although not always visible, such a strategy is being
developed and implemented at European level, e.g.
through
QA/Validation
offices
and
INSPIRE
implementation.
The PROMOTE QA/Validation Office is paving the way to
an integrated quality strategy for GAS CS and DS,
compliant with other GEOSS implementation initiatives.
By endorsing and building service level agreements,
users have the key for the success of an integrated
approach crucial for fitness for purpose of products,
services and QA.
Contact: [email protected]
13.06.2008
atmospheric information quality strategy
16/16