Transcript Next Generation Networks and Grids

Next Generation Networks and Grids
Bill St. Arnaud [email protected]
CANARIE Inc.- Overview
•
Federal leadership: Concept born in 1990 out of Industry Canada discussions
•
Founding: Incorporated in 1993 by industry and academia
•
Funding: From Industry Canada: For networks and research applications from
Canadian Heritage, HRDC, Health Canada
•
Mission: To facilitate development and use of Canada’s advanced
communications infrastructure
•
Primary stakeholders: Government Departments, universities, provincial
research networks, broader research community, colleges, carriers, IT sector,
SMEs, broader education sector, broader health sector, provinces
CANARIE’s S&T Integration
Platform: CA*net 4
CANARIE supports federal and provincial innovation and
government science centers across Canada.
CSA
NRC
NRCAN
Genome
Canada
Granting
Councils
NCEs
DFO
Ag-Cda
CFI
CRC
Stats
Can
DND
Canada’s National Research and Innovation Network:
Links 200+ Research Organizations
10 provincial networks,
10+ provincial institutes
80 universities
50 colleges
Provincial
Research
Institutes &
Universities
International
Research
Institutes
56 international peer
networks in Asia (12),
Europe (30), and
North/South America (14)
40 countries connected
Canada as a global network
hub
> Canada through CA*net 4 is
becoming a global hub for
international research
network connectivity
> Countries such as Korea,
Japan, Taiwan, Ireland, etc
are acquiring wavelengths
across CA*net 4 and routing
their traffic through Canada
> New milestones in scientific
collaboration have been
achieved
Canada’s role:
Huygens probe Titan/Saturn
> Real time eVLBI data from
Huygens/Cassini satellite with be
distributed from Australian receiving
dishes across Canada’s CA*net 4 to
correlators in Netherlands
> First time demonstration of collection
and distribution of satellite eVLBI data
using advanced networks
> Critical for mid-course correction and
analyzing descent into Titan atmosphere
> Understanding Titan’s atmosphere will
give insight into our own climate and
atmosphere
Grid Canada’s Certification
Service
> In partnership with NRC, CANARIE operates Canada’s
national certificate and authentication service
– Canada’s science “passport” to authenticate users for access to
remote labs and facilities
– Recognized around the world by science labs, grids and facilities
– Allows single sign on to multiple resources
– One of the largest science certificate authorities in the world with
over 1000 users
> For more information – www.gridcanada.ca
Enabling US Science Integration:
“Cyber-Infrastructure”
> To provide an integrated, high-end system of computing, data facilities,
connectivity, software, services, and instruments that enables all
scientists, engineers and educators to work in new ways on advanced
research problems that would not otherwise be solvable … Peter
Freeman, National Science Foundation
> “[Science is] a series of peaceful interludes punctuated by intellectually
violent revolutions . . .[in which] . . . one conceptual world view is
replaced by another.” --Thomas Kuhn, from The Structure of Scientific
Revolutions
> We are in the midst of just such a revolution – Peter Freeman NSF
> Proposed budget of $1 billion per year
> In addition NASA, DoE, DARPA plan to spend $250m per year in related
areas
“i-Infrastructure”:
CANARIE’s proposed platform to enable S&T
Integration Strategy
> i-Infrastructure – “intelligent infrastructure”
> CA*net 4 has made Canada a world leader in next
generation optical networks
> Through intelligent infrastructure we have an
opportunity to leverage our leadership in optical
networking to help Canada become a world
leader in integrative science infrastructure
Canadian i-Infrastructure
Projects
Neptune Canada
eVLBI for GPS
SAFORAH
Canadian Light Source
Canadian Virtual
Observatory
TRIUMF- ATLAS
GEO-ICT Sensor Web
Canadian Bio-Informatics Resource
Canadian Forestry Grid
> SAFORAH (System of Agents for
Forest Observation Research with
Automation Hierarchies).
> SAFORAH connects five locations
across the country to support the
monitoring of Canada's forests
> Together, all five locations will
generate data equaling 40
terabytes (TB) per month
> Integrates data from satellites,
sensors, chemical, biologic info,
etc
Neptune Integrative Science
• Plate tectonic processes and earthquake
dynamics
• Dynamic processes of fluid fluxes and
gas hydrates in the sea bed
•
•
Regional ocean/climate
dynamics and effects on the
marine biota
Deep-sea ecosystem dynamics
Purpose of i-Infrastructure
> To use common network services architectures to improve
ability to access and control instruments, facilities,
databases, computers and sensors across the network
> To allow remote access to distributed or difficult to reach
instruments and facilities
– E.g. Undersea sensors, remote telescopes
> To facilitate international S&T collaboration relating to large
expensive scientific instruments
– ….and provide developing world scientists access to Canadian facilities
> To reduce waste and duplication by enabling consolidation
and shared use of scientific instruments and facilities
– E.g. Ottawa U/NRC Nuclear Magnetic Resonance Farm
How it will work
> i-Infrastructure uses web services and web services
workflow architectures
– Includes User Controlled Lightpaths (UCLP) technology developed by
CANARIE
> Web has been about accessing images, text, video and data
> Next generation “web services” makes instruments,
databases, sensors, etc an integral part of the web
> Web services workflow tools will allow scientists to construct
multi-disciplinary scientific orchestrations integrating data
from sensors across networks linked to computers and
databases
UCLP Objectives
> Allow institutions to integrate wavelengths and fiber from
different suppliers and integrate with institution's network
management domain
– And offer VPNs to users
> Create discipline specific re-configurable IP networks
– Multihomed network which bypasses firewalls with direct
connect to servers and routers
> User controlled traffic engineering
– Active replacement for Sockeye and Route Science
– Alternative to MPLS
Today’s hierarchical IP network
Other national networks
National or Pan-Nationl IP Network
NREN A
NREN C
NREN B
Regional
University
NREN D
Tomorrow’s peer to peer IP
network
World
World
National DWDM
Network
World
Child
Lightpaths
NREN A
University
Server
NREN B
NREN C
Regional
Child
Lightpaths
NREN D
Creation of application VPNs
University
Dept
High Energy
Physics Network
Commodity
Internet
University
Research
Network
CERN
University
Bio-informatics
Network
University
University
eVLBI
Network
CANARIE provides APN to
TRIUMF
1G Interface WS
URI: http://canarie_apns/triumf_apn.ws
5G Interface WS
10G Lightpath WS
1G Lightpath WS
Toronto
Amsterdam
Vancouver
Edmonton
Montreal
Ottawa
Victoria
To Fermi
New York
1.
2.
3.
Note: An incoming lightpath (STS) can be
assigned to an outgoing STS or a specific
interface
TIUMF UCLP GUI would only see this APN
CANARIE UCLP GUI can this APN or
underlying network or other APN
To Brookhaven
Geneva
TRIUMF APN web service
(illustrative example)
<TRIUMF-APN>
<Administrator: Steven MacDonald, ID: 99999>
/etc/
/List of Lightpath web services/
<OC48: Victoria-Vancouver>
<OC192: Vancouver-Edmonton>
<OC192: Edmonton-Toronto> /via winnipeg thunder bay/
<OC192: Toronto-New York>
<OC192: New York-Amsterdam>
<OC192: Amsterdam-Geneva>
/etc/
/List of Interface Web services/
<10Gbe Interface Vancouver>
<Gbe Interface Vancouver>
<GbE interface Edmonton>
<5GbE interface Toronto>
<5GbE interface Victoria
/etc/
</TRIUMF-APN>
TRIUMF GUI harvests other
APNs
TRIUMF
Tier 1
UBC
Physics
UoVictoria Physics
Tier 2
TRIUMF
APN
1G Interface WS
UoToronto Physics
Tier 2
UA
Physics
5G Interface WS
UoT
Physics
UoT
APN
Toronto
10G Lightpath WS
UdM
Physics
Carleton
Physics
External links or APNs
Amsterdam
Vancouver
Edmonton
Montreal
UoV
APN
Ottawa
Victoria
CA*net 4
New York
Geneav
Chicago
Note: Typical View on
TRIUMF UCLP GUI
FERMI
Tier 1
Brookhaven
Tier 1
CERN
Tier 0
TRIUMF partitions APN and
establishes cross connects with 3rd
parties APNs
TRIUMF
Tier 1
UBC
Physics
UoVictoria Physics
Tier 2
UoToronto Physics
Tier 2
UA
Physics
UoT
Physics
CWDM
CWDM
Toronto
Vancouver
5G Tier 1 data
2G Tier 2 data
Carleton
Physics
UdM
Physics
Amsterdam
Edmonton
Victoria
To other physics users at
smaller universities
Note: Typical View on
TRIUMF UCLP GUI
1G HEPnet daisy chain
routed
Ottawa
CA*net 4
Optional
interfaces
New York
Geneav
Chicago
FERMI
Tier 1
Brookhaven
Tier 1
CERN
Tier 0
CANARIE provides APN to NRC
Edmonton
Saskatoon
Vancouver
Winnipeg
Victoria
Calgary
Regina
Seattle
Ottawa
Montreal
Toronto
Fredericton
Chicago
New York
CA*net 4 router
2G Lightpath WS
GbE interface WS
Halifax
NRC partitions APN
Edmonton
Saskatoon
Vancouver
Winnipeg
Victoria
Calgary
Seattle
Regina
Ottawa
Montreal
Toronto
Fredericton
Chicago
New York
Halifax
NRC logical view of APN
Edmonton
Saskatoon
Vancouver
Winnipeg
Ottawa
Regina
Victoria
Montreal
Toronto
Seattle
Fredericton
Chicago
New York
Halifax
UCLP intended for projects like
National LambdaRail
CAVEwave acquires a separate wavelength between
Seattle and Chicago and wants to manage it as part of its
network including add/drop, routing, partition etc
NLR Condominium
lambda network
Original
CAVEwave
Typical Large system today
VPN
USER
Internet
Security Web Services OGSA
DMAS
Process
Process
Process
Process
Process
SONET/DWDM
SONET/DWDM
Instrument Pod
Layer 3 switch/router
Layer 2 switch
Sensor
Sensor
Instrument
Instrument
Sensor
Service Oriented Architectures
HPC
VPN
WS*
WS*
CA*net 4
Lightpath
CA*net 4
Process
Data
Management
System
WS**
Process
WS**
Process
WS
Process
Process
LAN
WS
LAN
Web service
Interface
*CANARIE UCLP
Process
Instrument Pod
WS*
WS*
**New web services
Sensor
Sensor
WS
Instrument
Layer 2/3 switch
Instrument
Sensor
USER
Science user perspective
WS*
WS*
WS**
CANARIE UCLP
WS**
WS
AAA process
WS*
Lightpath
WS*
ONS15454
New Web service
New development
UDDI or
WSIL service registry
WS**
Log Archive Process 2
WS**
Log Archive Process 1
WS*
LAN
WS*
LAN
WS**
Sensor/Instrument
WS HPC
Process
NLR or CA*net 4
WS**
USER with
WSFL binding
software
DMAS
Science Pod
User defined
WSFL
bindings
Features
> All hardware (sensors -wireless and wired), software processes (Data
processing and HPC) and network elements (ORAN, CA*net 4)
expressed as WSDL web services
– Web services may be instantiations of orchestrations
> Hardware, software and network web services linked together by
science user with BPEL
– WSDL and BPEL provide for generic and open control plane
> Elimination of network made up of layers
– Every layer a web service that can communicate with other WS
> Hence all “science” processes use network data recursive
architectures
– Re use and replication of same modules for software, hardware and
network for each science project
Taverna Workflow graph
End to end choreography
3
2
Lightpath
WS
IP Flow
QoS
WS
Xconnect
WS
Lightpath
WS
OMNInet
Bandwidth
Reservation
WS
Xconnect
WS
1
2
LightPathConectionPT
LightPathConectionPT
5
BandwidthReservationPT
Neptune/
ORION
Instrument
WS
4
3
4
Visualization
WS
InstrumentNetworkServicePT
NeptuneInstrumentServicePT
1
Neptune admin orchestration
Super user orchestration
5
End user orchestration
1. E-gun & Linear
Accelerator
VESPERS Beamline at the
Canadian Light Source
 microanalysis with
unprecedented sensitivity
3. Storage Ring
4. Beamline End
Station
Current CLS Infrastructure
StorageRing
Gateway
Data Archive Server
Managed by I/T Group
Input Output Controller
Operator Interface
Beamline Hardware
Input Output Controller
Operator Interface
Managed by I/T Group
Input Output Controller
Operator Interface
MySql
Operator Interface
iMate
Beam Line Instrumentation
& Control System
Managed by IT Group
Alarm Handler
MySql
Proposed Infrastructure
StorageRing
Gateway
Data Archive Server
Managed by I/T Group
Input Output Controller
Web Service
Portal
Operator Interface
Beamline Hardware
Web Service
ESB
Input Output Controller
Operator Interface
Managed by I/T Group
Input Output Controller
Operator Interface
MySql
Operator Interface
iMate
Beam Line Instrumentation
& Control System
Managed by IT Group
Alarm Handler
MySql
Web Service
Other
Service or
Client
Web Service
Significance of UCLP v2
> Many power plants, water, sewage and process control SCADA
(System Control and Data Acquisition) are moving to TCP/IP so that
they can integrate process control with other eBusiness systems
> But this makes systems more vulnerable to DOS attacks, viruses, etc
> Impossible to fully protect with firewalls etc because too many back
doors
> Need to build “micro” firewalls around each SCADA sub-system with
web services and link them together with web services workflow