Transcript PHYS-ESFRI-einfrax

E-infrastructure requirements from
the ESFRI Physics, Astronomy and
Analytical Facilities cluster
• Provisional material based on outcome of
workshop held at ILL on 13-14 September
• Participating projects distilled their IT and data
management requirements into a set of
domains of common interest
15 September 2010
Ian Bird & Bob Jones
1
PHYS ESFRI projects involved
– ESRFup: Upgrade of the European Synchrotron Radiation
Facility http://www.esrf.eu/AboutUs/Upgrade
– ILL20/20: Upgrade of the European Neutron Spectroscopy
Facility http://www.ill.eu/science-technology/the-esfri-projects/
– SLHC: “super” Large Hadron Collider
http://www.cern.ch/SLHCPP/
– EuroFEL: Complementary Free Electron Lasers in the
Infrared to soft X-ray range http://www.eurofel.eu
– European XFEL: Hard X-ray Free Electron Laser in Hamburg
http://www.xfel.eu/
– ESS: European Spallation Source for neutron spectroscopy
http://neutron.neutron-eu.net/n_ess
– FAIR: Facility for Antiproton and Ion Research
http://www.gsi.de/fair
15 September 2010
Ian Bird & Bob Jones
2
Objectives
• Establish base elements of an IT platform for the
processing, storage and access to data for a cluster of
Physics, Astronomy and Analytical Facilities Research
Infrastructures:
– Authorisation and authentication system permitting access to
data and IT resources
– Solutions for high-speed recording of data to permanent storage
and its long-term archival
– A metadata management and data mining service across
participating ESFRI RIs
– High-speed and reliable data access mechanisms to facilitate
processing of data and its access to large-scale user
communities distributed across Europe and beyond
– Establish an environment permitting a data continuum from raw
data through to publications
15 September 2010
Ian Bird & Bob Jones
3
Authorisation and Authentication
• Objectives
– Address the need for a common Authentication,
Authorization Infrastructure and Single Sign On
– Tasks:
• Identify common use cases, and work with einfrastructures to define requirements
• Test and deployment of AAI system for access to data
and resources, for specific use cases at a few labs
• Analysis of initial deployment
15 September 2010
Ian Bird & Bob Jones
4
Data Access
• Objectives:
– Solutions for high speed recording of data to
permanent storage, long term archive and data
access
– Tasks:
•
•
•
•
Solutions for recording to archives + data integrity
Investigate standard access protocols, caching, etc.
Evaluate data protection and authorization schemes
Prototype implementation and verification
15 September 2010
Ian Bird & Bob Jones
5
Metadata catalogue and mining
• Objectives: Develop a federated metadata
catalogue of experiments, to enable metadata
mining. Describes conditions, samples, etc.
– Tasks:
• Working, documented implementation of a metadata
catalogue, based on evaluation of existing technologies
• Implementation of simplified queries for data mining
• Initial deployments in all participating institutes, with at
least one example of significant data sample
15 September 2010
Ian Bird & Bob Jones
6
Data Continuum
• Objectives: Common mechanism to link
publications to experimental datasets
– Tasks:
• Survey of different technologies and structures,
providing persistent dataset identifiers
• Elaborate data publication process and create metadata
schema
• Limited test deployment; and adapt existing catalogues
• Cooperate with major publishers
15 September 2010
Ian Bird & Bob Jones
7
Distributed infrastructure
• Objectives: Evolution of the distributed
infrastructures for all projects
– Tasks:
• Networking: coordinate with GEANT/NRENs to ensure
connectivity
• Basic set of common data management tools for
distributed computing
• Evolution of grid technology
15 September 2010
Ian Bird & Bob Jones
8