Transcript Network services

French Federation meeting
Lyon 11 June 2004
Network Activities
www.eu-egee.org
Jean-Paul Gautier
CNRS/UREC
Some slides are from Bob Jones’ presentations
EGEE is a project funded by the European Union under contract IST-2003-508833
Contents
• Context overview
• Networking activities summary.
• Main tasks in progress
French Federation meeting - Lyon 11 June 2004 - 2
EGEE Applications
• EGEE Scope : ALL-Inclusive for
academic applications (open to industrial
and socio-economic world as well)
• The major success criterion of EGEE:
how many satisfied users from how many
different domains ?
• 5000 users (3000 after year 2) from at
least 5 disciplines
• Two pilot applications selected to guide
the implementation and certify the
performance and functionality of the
evolving infrastructure: Physics &
Bioinformatics
Application domains are for illustration only
French Federation meeting - Lyon 11 June 2004 - 3
Grid Challenges for Networks
Router
Routed IP Network
Router
“layer-2” split out of
wavelength
[e.g. Ethernet]
Grid applications will stress the network and need reservable/scheduled
access to better than best efforts IP services.
Visualization and scheduled data delivery need guaranteed access to end-to-end
channels
LHC raw data alone will need multi-gigabit channels to be available for weeks at a time
Network provision can itself be view as a class of Grid resource.
French Federation meeting - Lyon 11 June 2004 - 4
Network services in Europoe
• EGEE : 70 partners.
• 33 NRENS involved
• GEANT as the European backbone
 GN1 to day
 GN2 in 2005
 NRENs connectivity : 34 Mbs to 10 Gbs.
• Summary of the operational services
• not exhaustive, gathering under way




IPv4 : 34
IPv6 : 17
IP Multicast : 11
QoS : 6
• DiffServ, MPLS, Managed Bandwidth
French Federation meeting - Lyon 11 June 2004 - 5
EGEE Activities
32 Million Euros EU funding over 2 years starting 1st April 2004
24% Joint Research
JRA1: Middleware Engineering and
Integration
JRA2: Quality Assurance
JRA3: Security
JRA4: Network Services
JRA4: Network
Development
Services
28% Networking
NA1: Management
NA2: Dissemination and Outreach
NA3: User Training and Education
NA4: Application Identification and
Support
DevelopmentNA5: Policy and International
Cooperation
48% Services
SA1: Grid Operations, Support and Management
SA2: Network Resource provision
SA2: Network Resource Provision
Emphasis in EGEE is on
operating a production
grid and supporting the
end-users
French Federation meeting - Lyon 11 June 2004 - 6
SA2: Network Resource Provision
• Objectives: Ensure EGEE access to network services provided by
GEANT and the NRENs to link users, resources and operational
management
 3 partners, 5 people, approx 1.5% of total project budget.
CNRS/UREC, GRNET, RCC KI.
 Most work will be associated with defining SLR/SLAs.
• Key deliverables/milestones
 Jun’04 First meeting of EGEE-GEANT/NRENS Liaison Board (MSA2.1)
 Sep’04 Survey of pilot application requirements on networks, initial SLRs
and service classes (DSA2.1)
• To Do
 Clarify organisation/composition of the liaison board with DANTE/NRENS
 Understand how the requirements for such service levels will take into
account applications needs (NA4) and operations (SA1) realities
 Determine how sites get involved in the decision making process
 Verify the roles/engagement of all partners
French Federation meeting - Lyon 11 June 2004 - 7
JRA4: Network Services
Development
• Objectives
Network oriented joint research to provide end-to-end services such as :
• Network reservation, performance monitoring and diagnostics tools.
• Explore links to how Grid resources are organise/allocated.
• Investigation of potential impact IPv6 on grids.
 5 partners, 13 people, approx 2.5% of total project budget
• UCL, CNRS / UREC, DANTE, DFN, GARR
 Tight collaboration with DANTE and the NRENs, especially through
future GN2 project and potential network oriented FP6 projects
• Key deliverables/milestones



Jun’04 Requirements and use cases for monitoring and diagnostics tools for users,
middleware and operations (MJRA4.1)
Sep’04 Definition of initial network performance metrics and composite measurements
required (MJRA4.2)
Sep’04 Specification of interfaces for bandwidth reservation services (DJRA4.1)
• To Do


Understand how JRA4 software will be integrated with JRA1 & JRA3
Clarify plans for IPv6 testbed with 6NET
French Federation meeting - Lyon 11 June 2004 - 8
EGEE
Applications (NA4)
Operations (SA1)
GN1/GN2
Performance Measurement
and Management (JRA1)
Network Services
Development (JRA4)
New Service
Development
(JRA3)
Network Operations and
Basic Services (SA2)
End to End QoS
(SA3)
DANTE
GEANT
NOC
Network Resource
Provision (SA2)
NREN
NREN
NREN
NRENs
NRENs
NRENs
NOC
NOC
NOC
French Federation meeting - Lyon 11 June 2004 - 9
Technical Network Liaison Committee
• The purpose of the committee is to provide an efficient
place to deal with “practical” issues of interface between
GEANT/NRENs and EGEE.
• Memorandum of Understanding.
 Between the EU EGEE and GN2 projects.
 Purpose
• GN2 will provide a high bandwith network.
• EGEE requires network services between its consortium members.
Ultimate goal is to provide services from GN2 to EGEE.
Both projects have a common interest in a close
cooperation in order to achieve their respectives
objectives.
French Federation meeting - Lyon 11 June 2004 - 10
Technical Network Liaison Committee
• Terms of reference
 SLAs
–
–
–
–
To approved the SLSs which will be delivered by GEANT and NRENs.
To present, disseminate and discuss prosed SLAs.
To approve SLA monitoring procedures.
To receive and assess reports network performance against the SLAs.
 Network services
– To agree recommendations for deployment of network services.
– To receive repoprts on the proposed network services.
– To receive requests from the EGEE team for new features.
 Operational interface
– To present formal EGEE requirements and use cases to GEANT/NRENs
– To present EGEE traffic usage monitoring for assessment of the network usage. The
TNLC should use these reports for decisions and futures recommendations.
• Composition
• EGEE :
– Jean-Paul Gautier (SA2),
– Javier Orellana (JRA4),
– Jules Wolfrat (SA1)
• NRENs
– Roberto Sabatino (DANTE)
– Enzo Valente (GARR)
– Clauss Ulman (DFN)
– Afrodite Sevasti (GRNET)
French Federation meeting - Lyon 11 June 2004 - 11
Network services
• Application identification and support (NA4)
Grid Operations, Support and Management (SA1)
 Collection of application network requirements (SA2 and JRA4 document)
• To get real use cases.
• Translation in terms of SLRs (Service Level Requirements)
– Bandwidth, Service end-points, Duration, Scheduling, Quality of service, Differentiation,
Prioritization, Availability monitoring, Others?
 Definition of SLS (Service Level Specifications).
• Services to be implemented by GEANT and the NRENs, in conjunction with JRA4
activity.
 Definition of SLAs (Service Level Agreements).
• Formalization by contract between partners
– Client : Operations, Applications, Virtual Organizations ?
– GEANT/NRENs
 Follow-up of SLA adherence.
SA2 will provide the means for formal communication between users,
application and network providers.
French Federation meeting - Lyon 11 June 2004 - 12
Operational Interface
• To control, to organize the information flows which come from the
networks.
 Define interactions and operational model between GOCs and NOCs

Procedures, Trouble Ticketing, Escalations ..
• Network Operation Centre (NOC) operational procedure study on
GEANT and NRENS
 Selection among a group of NRENs
• In EGEE : GARR, DFN, GRNET, CESNET,
• Outside EGEE : SURFNET, RENATER, UKERNA …
• Incremental integration with EGEE GOCs
 After a Trouble Ticket systems study.
 Definition of interfaces.
• Homogenous system at the EGEE level.
French Federation meeting - Lyon 11 June 2004 - 13
Operational Interface
EGEE
Management
DANTE
GEANT
NOC
NREN
NREN
NREN
NRENs
NRENs
NOC
NRENs
NOC
NOC
SA1 & SA2 will work together aout the Operational Networking model
The SA2 manager reports to the Operations Manager of SA1
French Federation meeting - Lyon 11 June 2004 - 14
Network Service Development
(JRA4) Objectives
JRA4 will provide common interfaces between
Grid middleware and Network Resources
Resources & Information
Consumers
JRA4
• Advertising Resources
• Publishing Information
Grid
Middleware
OGSA requirements:
• Self contained
Network Services • Modular entity
Network
Resources & Information
• IP Premium
• MPLS paths & tunnels
• Light paths
• Network Metrics
• Performance
French Federation meeting - Lyon 11 June 2004 - 15
JRA4 Tasks and Context
•
Main sub-activities:



•
Bandwidth Allocation and Reservation
Network Performance Monitoring and Diagnostic tools
and, also IPv6 uptake
DANTE already deploying basic infrastructure in GEANT
(current GN1 and the coming GN2 projects):


Introduction of Layer 3 differentiated services (Premium, BE, LBE)
Instrumentation for network measurement
SA1
EGEE
SA2
JRA4
GN1-2
GGF
Others
French Federation meeting - Lyon 11 June 2004 - 16
Bandwidth Allocation & Reservation
•
Network Resources:



•
•
Layer 3 - diffserv based traffic: IP Premium, Scavenger, …
Layer 2 : VLAN, MPLS
Layer 1 : lightpaths
Allocating network resources : immediate, advance
Features:
 Users as part of Virtual Organizations
 Authorization, Authentication and Accounting of end users
Consumer (User Application)
Grid Middleware
Disk Service
CPU Service
Common Interface (OGSA)
Domain_A
Domain_B
Network Service
Network
(GEANT+NRENs)
Domain_X
French Federation meeting - Lyon 11 June 2004 - 17
Bandwidth Allocation & Reservation
Architecture
French Federation meeting - Lyon 11 June 2004 - 18
JRA4 : Network Performance Monitoring
• Grid Performance closely linked to Network Performance
• Network Performance?, what for? :
 Problem diagnostic and rectification
 Facilitate resources allocation
 Performance monitoring and SLA adherence
Grid
Middleware
NOC: Network Operation Center
GOC: Grid Operation Center
GOCs
NOCs
Operations
Performance Monitoring
Service
Common Interface (OGSA)
Domain_A
Grid
Users
Domain_B
....
Network
(GEANT+NRENs)
Domain_X
French Federation meeting - Lyon 11 June 2004 - 19
JRA4 : Net. Perf. Monitoring
Use case
ie. OWD from point A to B ?
DM 1
DM 2
DM 3
WeWe
gotDON’T
that already
yet
B
A
PMS 1
NREN A
PMS 2
PMS 3
GEANT
NREN B
OWD=OWD1+OWD2+OWD3
•
•
PMSx and DMx
 Are independent implementation for the measurements
Features
 Multiple domains, AAA, OGSA/OGSI
DM Domain Manager
PMS Performance Monitoring System
Signalling between DM
Request of Measurement
French Federation meeting - Lyon 11 June 2004 - 20
JRA4 : Net. Perf. Monitoring
Use case
ie. OWD from point A to B ?
DM 1
DM 2
DM 3
We DON’T yet
B
A
PMS 1
NREN A
PMS 2
PMS 3
GEANT
NREN B
OWD=OWD1+OWD2+OWD3
OWD=OWD_A-B
•
•
DM Domain Manager
PMS Performance Monitoring System
PMSx and DMx
 Are independent implementation for measurement
Features
 Multiple domains, AAA, OGSA/OGSI
Signalling between DM
Request of Measurement
French Federation meeting - Lyon 11 June 2004 - 21
IPv6 Uptake
Study of the advantages of using IPv6 in Grid context:
•
•
DANTE deploying IPv6 (already started).
IPv6 is effective if deployed in all domains.
The report will cover:
• Study of features of IPv6, highlighting the ones of interest
for Grids
• Availability of IPv6 in NRENs and access networks
• EGEE internal awareness of IPv6
Also:
• Collaboration with 6NET
• Possibility of building a testbed, needs to be agreed
French Federation meeting - Lyon 11 June 2004 - 22
Conclusion
Network provision must itself be view as a class of Grid
resource.
This resource is highly dependent of the network services
provided by the NRENs.
SA2 and JRA4 Activities work in a long term perspective.
We need inputs from the EGEE application layer.
French Federation meeting - Lyon 11 June 2004 - 23