Transcript ppt 5.5MB - Star Tap

Service Oriented Architectures for R&E
networks
“Google Mashing everything”
Bill St. Arnaud
CANARIE Inc – www.canarie.ca
[email protected]
Google mashing
> Google as developed a web service for Google Maps
that allows users to overlay any geographical data
> A powerful example of SOA and web services
> No more using maps as GIFs or JPEGs, or using
proprietary mapping software
> Users can also create a workflow of their
geographical data overlaid onto Google Maps and
offer that as a web service to others
Today’s Network & OS
The network
is subservient
to the
computer
The application
is tightly bound
to the OS
Application
Network
Application
User
User
OS
OS
Data
The network is a
mechanism for
applications to
communicate
with each other
Data
SOA Network
Application and data exist on
the network and are uncoupled
from any specific machine or
location
SOA
SOA
Network
OS
The
computer is
subservient
to the
network
OS
Application and Data
SOA
SOA
SOA
SOA
OS
OS
OS
OS
Data
Data
Data
Data
SOA (Web 2) versus Web 1
> Web 1:
– HTML is the composition language of Web 1
• Its power is the ability to incorporate links to other web pages and in turn be
linked to by others
• Frontpage (and others) allow HTML editing
– Human grammar and sentences provides the semantic structure of a web
page between the various elements including hyberlinks
– Apache (and others) convert HTML script into working web page
accessible via HTTP
> Web 2: (SOA)
– XML is the composition language
• Its power is the ability to incorporate links to other web pages and in turn be
linked by others
– BPEL provides the “semantic” structure between various web services
• Resulting BPEL script is also a web service which can be linked to by others
– Apache/Axis (.Net, Wepshere) convert XML into working web services
accessible via SOAP (mostly via HTTP)
The big picture
Integrative Science
E-Science or E-Research
Cyber-infrastructure
SOA: (web services, workflow, security, etc)
Networks
HPC
Grids
Databases Instruments
Science drivers for SOA for
R&E networks
1. Big Science:
–
CERN, eVLBI, Ocean Observatories
2. Integrative Science:
–
Increasing interests by researchers into multi-disciplinary science as
opposed to reductionism
> Need to link sensors, instruments and databases from different
fields to extract new knowledge
> Examples:
–
–
York University is connecting smog sensors along freeways and
correlating with large population health data to predict consequence of
traffic congestion on public living near the freeway
Neptune undersea network to investigate algae blooms that precede
major undersea earthquakes
New Integrative Science
Source: Office of Integrative Activities NSF
More Diversity, New Devices,
New Applications
Picture of
earthquake
and bridge
Sensors
Personalized
Medicine
Picture of
digital sky
Wireless networks
Knowledge
from Data
Instruments
Source: Larry Smarr??
SOA and networks
GENI-Network Virtualization
Source: Network Virtualization web site
GENI + SOA = UCLP
Instrumen
t
WS
APN
Substrate
Router
Substrate
Switch
Parent
Lightpath
WS
GMPLS
Daemon WS
Virtual
Router
WS
Child Lightpath WS
(may run over IP
Ethernet, MPLS, etc
Timeslice
WS
Wireless Sensor
Network
GENI is a subset of UCLP
>
>
>
>
>
Parent or root lightpath = substrate link
Child lightpath (SONET, MPLS, IP tunnel) = virtual link
Router = substrate router
Virtual or blade router = virtual router
APN = virtual end to end system linking processes (time slices),
instruments, storage, etc
> No equivalency to switch or virtual switch in GENI
> SOA Web service can represent time slice, instrument or other
process
> UCLP allows user to configure their own APNs using BPEL
– Change topology, bandwidth etc
> APNs can be made up of layer 1 to 3 virtual links connecting
instruments, routers or switches
Extending the network into
the application
Single Computer or
WS instance of an orchestration
APN extends into
computer to specific
processes
zzzz:410:0:1
Instrument
Web service or
software process
User A
xxxx:410:0:1
xxxx:410:0:4
xxxx:410:0:2
Routing daemon
Web service
xxxx:410:0:3
Virtual
Router WS
xxxx:410:0:5
DWDM
Network
Web service or
software process
Interface Card or port
yyyy:410:0:1
VPN Links
User B
Similar initiatives at Cal-IT(2)
& UCSD
>
>
>
>
>
>
>
>
>
>
>
(Laboratory for the Ocean
Observatory
Knowledge Integration Grid)
Integrate Instruments & Sensors
(Real Time Data Sources)
Into a LambdaGrid
Computing Environment
With Web Services Interfaces
New OptIPuter Application Driver:
Gigabit Fibers on the Ocean Floor
• Goal: Prototype
Cyberinfrastructure for NSF ORION
www.neptune.washington.edu
A real-time data grid system
Multi-disciplinary data being
integrated
Multiple Sensor types being
adapted
Real-time data virtualization
enabled
Discovery & access through
metadata supported
APN Resource List Creation
View by CANARIE staff
Lightpath Object Creation
YEG
CANARIE ONS Network
Resources
1
YVR
YUL
ONS
OME Vancouver
BCnet
Pwave HDX
3
Chicago is hidden
ONS
New York
Chicago
Seattle
Victoria
2
MAN LAN HDX
4
Toronto
Vancouver
Montreal
SURFnet
APN
Halifax
resources advertised
to
Amsterdam
Ottawa
CANARIE
MAN LAN HDX
ONS
Toronto
STAR
ChicgaoLIGHT HDX
Edmonton
Edmonton
YYZ
TRIUMF
CANARIE OME YCG
Network Resources
Toronto
YOW
Winnipeg
STAR LIGHTOttawa
HDX
Edmonton
New York
Amsterdam
ONS
Montreal
To Fermi
New York
New APN Resource list composition
To Brookhaven
Geneva
5
Geneva
CANARIE provides APN
resource list to TRIUMF
1G Interface WS
URI: http://canarie_apns/triumf_apn.ws
5G Interface WS
10G Lightpath WS
1G Lightpath WS
Toronto
Ottawa
Vancouver
Victoria
Amsterdam
Edmonton
Montreal
To Fermi
New York
NOTE: This resource element is actually
an aggregation of several elements on
CANARIE network. The exposed WS
may actually be a BPEL composition of
the underlying WS elements
To Brookhaven
Geneva
TRIUMF GUI harvests other
APNs from UoVic, UoT, etc
TRIUMF
Tier 1
UBC
Physics
UoVictoria Physics
Tier 2
TRIUMF
APN
1G Interface WS
UoToronto Physics
Tier 2
UA
Physics
5G Interface WS
UoT
Physics
UoT
APN
Toronto
10G Lightpath WS
UdM
Physics
Carleton
Physics
External links or APNs
Amsterdam
Vancouver
Edmonton
Montreal
UoV
APN
Ottawa
Victoria
CA*net 4
New York
Geneav
Chicago
Note: Typical View on
TRIUMF UCLP GUI
FERMI
Tier 1
Brookhaven
Tier 1
CERN
Tier 0
TRIUMF/HEPnet Lightpath
Object Composition GUI
UBC Campus
CWDM Lightpath
Object
UoVic Campus
802.11 Lightpath
Object
TRIUMF APN
Toronto
Ottawa
Vancouver
Amsterdam
Edmonton
Montreal
To Fermi
Victoria
New York
UoVic
Vancouver
Victoria
Composition Window
TRIUMF
Lightpath Object for 2 Gbp
Tiier 2between TRIUMF and UoVic
To Brookhaven
Geneva
UoVic Physics UCLPv2 GUI or
workflow tool adds Router WS to
lightpath object
UoVic Physics router
resource
CLI interface exposed as
a WS
Resource Window
UoVic
TRIUMF
Vancouver
Victoria
Lightpath Object for 2 Gbp
Tiier 2between TRIUMF and UoVic
Created by TRIUMF/Hepnet
UoVic
TRIUMF
Vancouver
DRAC/UCLP Demo Network
Norte
l
DRA
C
The Power of Web services
Canarie
UCLP
Ottawa
Montreal
App
App
Toronto
Halifax
SOA Applications
CANARIE’s i-Infrastructure
program
> To adapt Service Oriented Architectures (SOA) to process
control, instrumentation systems and sensor networks
> Applications include manufacturing, oil and gas, power systems,
water, building management systems, environmental control
systems, etc
> Built upon CANARIE’s initial work on User Controlled LightPaths
(UCLP)
> Start with large science research facilities such as Neptune,
Canada Light Source and then expand into industrial
applications
> www.canarie.ca/ccip
Typical Large system today
VPN
USER
Internet
Firewall
DMAS
Process
Process
Process
Process
Process
SONET/DWDM
Instrument Pod
SONET/DWDM
Layer 3 switch/router
Layer 2 switch
Sensor
Sensor
Instrument
Instrument
Sensor
Service Oriented Architectures
HPC
VPN
WS*
WS*
CA*net 4
Lightpath
Process
Data
Management
System
WS**
Process
Process
WS**
Process
WS
Process
Process
LAN
WS
LAN
Web service
Interface
*CANARIE UCLP
CA*net 4
Instrument Pod
WS*
WS*
**New web services
Sensor
Sensor
WS
Instrument
Layer 2/3 switch
Instrument
Sensor
USER
Science user perspective
WS*
WS*
WS**
CANARIE UCLP
WS**
WS
AAA process
WS*
Lightpath
WS*
ONS15454
New Web service
New development
UDDI or
WSIL service registry
WS**
Log Archive Process 2
WS**
Log Archive Process 1
WS*
LAN
WS*
LAN
WS**
Sensor/Instrument
WS HPC
Process
WS**
NLR or CA*net 4
DMAS
USER with
WSFL
binding
software
Science Pod
User defined
WSFL
bindings
1. E-gun &
Linear Accelerator
VESPERS Beamline at the
Canadian Light Source
 microanalysis with
unprecedented sensitivity
3. Storage Ring
4. Beamline
End Station
UCLP-Enabled Virtual Design Studio
3D digital construction of the Salk Institute
Michael Jemtrud
Konstantin Privalov
James Hayes
Nicolas Valenzuela
Carleton Immersive Media Studio
Carleton University , School of Architecture, Ottawa (Canada)
SOA for Participatory Design Studio
– Service provides are
• network resources (UCLP)
• devices (cameras, displays, rendering computers)
• software (MAYA)
– Provisioning for a PDS session requires
• finding a configuration of network resources, devices and
software that meets the user’s needs
– SOA will monitor session
• Does not transport high definition signal
>
Demo illustrates how end users can establish UCLP
connections without knowing details
Other SOA Network Projects
> Design Service-Oriented Architecture (SOA) and
build Web Services for linking research data to
scholarly publications
> Web services control of undersea HDTV camera –
Neptue
> SOA for military real time simulation
Amateurs discover most
Supernovas
http://www.nytimes.com/2002/11/07/technology/circui
ts/07astr.html?todaysheadlines
“Nasa and amateur scientists nightly harvest about
1,000 images, which are shared with other amateur
astronomers over the Internet. Together, they analyze
the pictures for previously undiscovered supernovas,
the remains of collapsed stars. “
“Over 58 supernovas have been discovered”
“While most amateur astronomers use computers to
enhance a hobby, the advances in technology are also
blurring the distinctions between professionals and
sophisticated amateurs.”
Sloan Digital SkyServer
> http://skyserver.sdss.org/en/
> Large database of astronomical
data and images
> Available to scientists, students
and public
> XML and Java web services
interfaces
Conclusions
> SOA & Cyber-Infrastructure will fundamentally
transform science and IT
> Better get prepared and learn as much as possible and
learn about CI and SOA
–
–
–
–
–
Web services
Resource discovery and consumption
Publishing services
Workflow and orchestration
SOA platforms – OGSA, .NET,. Websphere
> Commercialization potentials of integrative science
and CI are significantly greater than with traditional
science