Transcript BSS Presentation - Teamwork

The New Zealand Bio data Services
Stack Project (BSS)
Vision
New Zealand’s bio data is easily and seamlessly exchangeable,
combinable and federated from multiple data providers to multiple data
users through a national “Bio data Services Stack” (BSS). This will make
the management of New Zealand’s ecosystem and biosecurity risks
more effective and comprehensive.
Implementation
The BSS will be implemented as a set of national standards, guidelines and
systems and continuously supported and maintained by relevant agencies
including central and local government.
Jochen Schmidt, Chief Scientist Environmental Information, NIWA
Bio Data Access - a common situation
Joe Fish
Don
Need fish data!
Hmm maybe Don can help…
To: Joe
Hmm,
I’ve got
01/02/09,
3.2,one
3, 1 dataset.
I’ll01/02/11,
send it through…
3.1, 3, 1
*RING RING*
Hi Don, I need some
*RING RING* upper Waimak fish
10
minutes…
observations for my
Ok. Got the data.
model. Any ideas?
Where is the site
located?
10 minutes…
Oh, it’s at laughing jack bridge.
Ummm. (papers shuffle)
147.123 -41.588
Coordinates?
What reference
system??
Ok. What method is
used?
Oh…how does this compare
to electric fishing?
DON?
I think it’s GDA94
Umm, I think observations are
done by Fyke net..
Umm......
*CLICK*
Modified From Peter Taylor (CSIRO)
Bio Data Access - a future situation
To: Joe
01/02/09, 3.2, 3, 1
01/02/16, 3.1, 3, 1
Joe Fish
Need fish data!
Have fish data!
Magic BSS Button
01/02/09, 3.2, 3, 1
01/02/11, 3.1, 3, 1
01/02/14, 3.1, 3, 1
01/03/14, 3.1, 3, 1
01/10/15, 3.1, 3, 1
To: Joe
01/02/09, 3.2, 3, 1
01/02/15, 3.1, 3, 1
To: Joe
01/02/09, 3.2, 3, 1
01/02/14, 3.1, 3, 1
To: Joe
01/02/09, 3.2, 3, 1
01/02/12, 3.1, 3, 1
What a future could look like
• Automatic and always up-to-date distribution maps for
• Invasive species
• Threatened species
• From all data sources!
• Online access to most recent biodata and data sources, including metadata
• This invasive species has been found by Joe Fish.
• I can contact him about the observation to discuss mitigation options.
• Push-of-a-button maps and reports for
• SoE
• Indicators (MCI)
• … much more
What do we need??
Mission of TFBIS BSS Project
Dataset a
user a
Dataset b
user e
Dataset c
?
Dataset e
Dataset d
Data Sources
different formats,
different owners,
different organisations
Dataset b
TFBIS
BSS
project
user b
user c
user d
Data compilation
ad-hoc,
manual,
repeated,
costly!!
Dataset c
Dataset d
Dataset e
Data Access:
Portals, Web services, queries
Dataset a
use case a
use case b
use case c
BSS
standard formats and vocabularies,
standard metadata,
standard web service delivery
Vision for New Zealand: Interoperability through open standards
Multiple Uses
Data User
Data User
Data User
NIWA
Council
Joe Public
Interoperability
App/Portal
ei.niwa.co.nz
BSS
Data Delivery
Standards
Data Archiving
Standards
App/Portal App/Portal App/Portal App/Portal
NIWA QGIS
ALA
LakeSPI
LAWA
(R)
Services Stack
(Set of Standard Web Services)
Data Archive
Data Archive
Data Archive
NIWA (NEMO)
Auckland Council
Wellington Council
QA/Management
QA/Management
QA/Management
CADDIS
Excel
FFDB
Data Collection&QA
Standards
Science User
Observations / Surveys / Data collection
(to standards!)
Information Management made
consistent through a “services stack”
- biodata Standard Web
Delivery Services
Web Delivery
Web Delivery
Metadata
Services
Taxonomic Information
Services
Web Delivery
Instutiutional Data
Archives
Datase
t1
...
DS3
...
Instutiutional Data
Archives
DS2
DS1
(LAKES
(FFDB)
PI)
Consistency
through
Policy,
Roles
and Tools
Datase
t1
...
Procedures & Methods
Information Services
DS2
DS1
(LAKES
(FFDB)
PI)
Web Delivery
Instutiutional Data
Archives
Instutiutional
Data Archives
DS2
Datase
t1
...
DS3
...
Web Delivery
Observation &
Measurement Names
Services
DS3
...
Instutiutional Data
Archives
Datase
Dataset
1
t1
... ...
DS3
...
DS3
...
DS2
DS1
(LAKES
(FFDB)
PI)
DS1
(LAKES
(FFDB)
PI)
Web Delivery
Instutiutional Data
Archives
DS2 Datase DS1DS2
DS3
(LAKES
(LAKESPI) t...1 (FFDB)
...
PI)
DS1
(FFDB)
Towards a New Zealand interoperable biodata infrastructure
- strawperson Data Management
• Consistent and globally unique dataset identifiers
• Consistent quality descriptors (codes)
• Consistent metadata
• Consistent taxa descriptors
• Consistent reference information (geospatial, temporal)
• Consistent description of data (parameter, method, etc.)
Delivery
• Agreed open standard web services
BSS project - Focus
• Federation of species occupancy – Presence; Presence-Absence;
Abundance.
• Domains: Birds, Pest Plants, Fish, Invertebrates.
• Re-use of existing standards and technology.
• Demonstration clients through “partner portals” – ALA, LAWA, EIB, …
BSS project - Structure
BISG Steering Committee (in-kind)
BSS Project Director (in-kind)
BSS Work Stream Leader Terrestrial
BSS Work Stream Leader Freshwater
BSS Work Stream Leader Infrastructure
Work Stream members (in-kind)
Work Stream members (in-kind)
Work Stream members (in-kind)
National Bio Information Steering Group (BISG)
• Oversees strategic direction of biological information sharing in New
Zealand.
• Not tied to a specific project, but ensures that national, regional, and
institutional activities are aligned and jointly work towards a vision of
New Zealand Biodata Infrastructure as a partnership approach
between organisations.
• Provide guidance from the key stakeholder/member agencies/sectors,
in a spirit of inter-agency collaboration, for the development,
implementation and ongoing success of the New Zealand Biological
Data Infrastructure.
BSS project - Workplan
PHASE I (2014/2015)
• Clearly identify and document use cases (for occupancy data) and barriers.
• Birds/Weeds work stream (Landcare)
• Fish/Invertebrate work stream
• Define required solutions and specify BSS infrastructure.
(standards, guidelines, vocabularies)
• Demonstrate working prototype for Weeds federation.
• Infrastructure work stream
PHASE II (2015/2016)
• Implement infrastructure for a limited set of organisations and data sources.
• Implementation work stream
• Landcare, NIWA, DOC, TePapa, Horizons, Southland, Hawkes Bay
PHASE III (2016 onwards)
• Role-out across New Zealand, supported through RC, NEMS, MfE, Stats NZ, DOC, Councils, etc.
Mobilising bio data through BSS:
what to expect for participating data providers
BSS Project Goal:
Mobilising of Species occurrence data
through open standards
BSS use cases:
(Birds, Weeds, Fish, Invertebrates):
Where is the data?
What status is it in?
How do we want the data delivered?
Define BSS Standards:
• Data exchange
• Vocabularies
• Guidelines for implementation
Improvements
based on
feedback
End users / evaluation
Implement harvesting / delivery
systems (re-use existing systems):
ALA, LAWA, NIWA Qmap, …
National infrastructure
e.g. vocabulary services
Agency X implements
BSS connector based on
standards and guidelines
Other data consumers /
clients developed based
on BSS Open Standards.
BSS Connector Agency X (Web services)
Agency X (Data Provider):
Institutional Data Management systems
based on institutional business needs
Data Providers: DoC, NIWA, Landcare Horizons, Southland, HBRC, …
BSS project - What happens next?
• A number of workshops will be held across New Zealand to gather information
(James Lambie, Horizons; Mike McMurtry, Auckland)
• How is biodata currently managed
• How end users want to access biodata
• Draft guidelines for BSS implementation for agencies developed by July 2014
(tested for weeds use case)
• NIWA, Landcare Research, DOC
• Participating agencies implement by November 2014
(for weeds data)
• Demonstration clients developed by December 2014
(for weeds data)
Federation demonstrated by December 2014; 2015 refinement and
implementation for other domains (fish, birds, invertebrates).