Middleware - Internet2

Download Report

Transcript Middleware - Internet2

Internet2
Ana Preston [email protected]
Program Manager, International Partnerships
Buenos Aires, Argentina
August 20, 2002
People on the Internet
350.0
300.0
250.0
Millions of
People
200.0
150.0
100.0
50.0
Slide 2
Internet 2 Overview- Buenos Aires, Argentina
05
20
00
20
99
19
98
19
97
19
96
19
Source:
Nua Internet Surveys
19
95
-
August 2002
Internet…today
•Internet: from thousands of users to millions of
users.
• Web, email, low-quality audio & video
• Interconnect personal computers and servers
• Applications adapt to underlying technology
While it can “accommodate” explosive growth
and enable convergence of information, mass
media and human collaboration, BUT
•Internet of the future will need to support billions of
users and devices and the convergence of today’s
applications with multimedia and ….
Slide 3
Internet 2 Overview- Buenos Aires, Argentina
August 2002
The new science: e-science
• Science used to about test tubes, wet labs and big
instruments
• But increasingly science is moving to networks and
computers
• Science is now longer bound by bricks and mortar or
geography
• Recognition that more and more science is network
and computationally based
• Examples….
Slide 4
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Cont.
• Peer to peer: the killer application?
• Distributed Computing:
• A problem is broken into many small
tasks
• Tasks are then distributed to thousands
of PCs world wide
• When PCs are not busy they work on
the distributed computation
• After some time the results are returned
to a central server
Slide 5
Internet 2 Overview- Buenos Aires, Argentina
August 2002
SETI@home
• Demonstrated that PC Internet Computing
Could Grow to Megacomputers
• Running on 500,000 PCs, ~1000 CPU Years per Day
• Over Half a Million CPU Years so far!
• 22 Teraflops sustained 24x7
• Sophisticated Data & Signal Processing Analysis
• Distributes Datasets from Arecibo Radio Telescope
Arecibo
Radio Telescope
Next StepAllen Telescope Array
Slide 6
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Folding@home
http://www.stanford.edu/group/pandegroup/Cosm/
http://members.ud.com/vypc/cancer/
• This "virtual supercomputer" uses
peer-to-peer technology to make
unprecedented amounts of
processing power available to
medical researchers to accelerate
the development of improved
treatments and drugs that could
potentially cure diseases.
• Rapid new discoveries in cancer
research
Slide 7
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Virtual Observatory
• www.voforum.org
• Discovery process will
rely on advanced
visualization and data
mining tools
• Not tied to a single brick
and mortar location
• Will cross correlate
existing multi-spectral
databases petabytes in
size
Slide 8
No new telescopes or radio dishes.
Just big networks interconnecting
large database
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Today’s Internet…
•Today’s Internet does NOT:
•reliable performance (end-to-end)
•Encourage cooperation on new
capabilities
•Allow testing of new technologies
•Support development of revolutionary
applications
• meet the unique needs of research and
education community
Slide 9
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Internet Development Spiral
Commercialization
Privatization
Today’s Internet
Research and
Development
Source:
Ivan Moura Campos
Slide 10
Internet2
Partnerships
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Research & Education
• Universities strive for qualitative and quantitative
improvements:
• In support of research
• In support of teaching and learning
• how to accelerate the change in technologies and
applications on the internet to support new demands for the
research and education community?
• how can new technologies be incorporated into the
existing Internet? (think back in when the Internet
started…)
•
•
•
•
Slide 11
Stanford -- the Internet protocols
NSFNet -- the scaled-up Internet
CERN -- the WWW protocols
University of Illinois -- the Web browser
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Attributes of Advanced Apps
• Provide qualitative and quantitative
improvements in how we conduct
research and engage in teaching and
learning
• Common attributes:
• Remote instrumentation and
interactive collaboration
• Distributed data storage and data
mining
• Large-scale, multi-site
computation
• Real-time access to remote
resources
• Dynamic data visualization
• Shared virtual reality
Slide 12
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Science and Engineering
• High Energy and Nuclear Physics
(HENP)
• Generating multi-petabyte
datasets, gigabytes per second
per experiment
• Cascading data storage model,
near-zero packet loss per data
stream, distributed database for
end-user data manipulation
• Each experiment requires input
from hundreds of researchers
around the world
Slide 13
Internet 2 Overview- Buenos Aires, Argentina
August 2002
What are Grids?
• Grids enable the new science
• Original motivation, and support, from high-end science and
engineering
• Enable communities (“virtual organizations”) to share resources as
they pursue common goals
• New applications enabled by the coordinated use of geographically
distributed resources
• E.g., distributed collaboration, data access and
analysis, distributed computing, instrumentation
• Persistent infrastructure for large scale computing problems
• Using distributed computing resources of schools,
universities and research centers
Slide 14
Internet 2 Overview- Buenos Aires, Argentina
August 2002
The Grid
Instruments
Libraries
Workstations
Data sets
Slide 15
People
Internet 2 Overview- Buenos Aires, Argentina
August 2002
GriPhyN iVDGL Map Circa 2002-2003
US, UK, Italy, France, Japan, Australia *
 International Virtual-Data Grid Laboratory
 Conduct Data Grid tests “at scale”
 Develop Common Grid infrastructure
 National, international scale Data Grid
tests, operations (GGOC)
 Components
 Tier1, Selected Tier2 and Tier3 Sites
 Distributed Terascale Facility (DTF)
 0.6 - 10 Gbps networks: US, Europe, transoceanic
http://www.ivdgl.org and http://igoc.iu.edu
Tier0/1
Tier2
facility
facility
Tier3 facility
10 Gbps link
2.5 Gbps
link
622 Mbps
link
Other link
Access Grid
www.accessgrid.org
Slide 17
Source: Argonne National Laboratory
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Remote Instrumentation
• Instrumentation must be
controllable without local
intervention
• Individual sites will have multiple
data sources streaming data that
will interact with the remote
instrument
• Data will be made available both in
real time and via storage
• Failsafe mechanisms must be in
place in addition to normal network
performance tests
VTC
System
Slide 18
Campus Network (out to Internet2)
Video
System
Cameras
Internet 2 Overview- Buenos Aires, Argentina
Locallymaintained
Storage
Video
System
NEES-POP
Cameras
Data
Acquisition
System
Hybrid
Control
System
Strain
gauge
Data
Acquisition
System
Strain
gauge
Strain
gauge
Accellerometer
Control
System
Actuator
Control
System
Shake
table
Actuator
Shared Memory Network
Data
Acquisition
System
Strain
gauge
Strain
gauge
Control
System
Actuator
Actuator
August 2002
• Advanced Networks: Latency, Loss and
Jitter (network quality) are more important
than pure bandwidth
• Provide wider access to limited
resource
• Improves teaching and learning
•Create a dynamic resource
• Share equipment
• Dynamically analyze data with
remote collaborators
• Enhance collaborative opportunities
Slide 19
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Example: Astronomy
• Data collection equipment is
located in extreme environments
• Collaborators are spread across
the globe
•
Mauna Kea, Hawaii
Cerro Pachon, Chile
• Observers do not need to have
physical contact with the
equipment
Slide 20
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Health Sciences
• 3D Brain Map
• Visualization of data: real-time MRI,
previously stored data, etc.
• Computational information transferred to
supercomputers and used to understand
brain functions in real time
• Very large multi-dimensional, multi-modal,
time-varying data sets
• Biomedical Informatics Research Network
(BIRN)
• Extremely large data sets and repositories
• Dynamically generate 3D visualizations
from medical records
• Generating 36Gbytes/day, so new models
for search, retrieval and analysis will be
necessary
Slide 21
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Telepresence environment
•
•Real-time
interactions
with very high quality
audio and MPEG-2
video
• as needed “meetings”
connecting faculty and
staff across the ocean
Slide 22
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Arts and Humanities
• University of Oklahoma Master Classes
• High fidelity video and audio via
MPEG2
• Optimized latency, audio/video
synchronization
• Connecting Oklahoma with the New
World Symphony in Miami, Florida
• Dancing Beyond Boundaries
• Distance Collaborative Dance
Performance at SC2001
• Hybrid performance combining local
and remote performances between
Florida, Minnesota, Denver and Brazil
• Synchronizing choreography across
the continent
Slide 23
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Example: Language/Cultural
Exchanges
Slide 24
Internet 2 Overview- Buenos Aires, Argentina
August 2002
ORGANIZATION
Internet2 Mission
• Develop and deploy advanced network
applications and technologies for research and
higher education, accelerating the creation of
tomorrow’s internet.
• Enable new generation of applications
• Create leading edge R&E network capability:
Supporting advanced service efforts
(multicast, IPv6, QoS, Measurement, Security)
• Transfer technology and experience to the
global production Internet
Slide 25
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Internet2: Collaborative
Partnership
•Organization:
• Not for profit (not commercial)
• Higher education leadership
•Abilities:
• Support applications developers and users
• Provide national-scope advanced networking
capabilities for universities, research institutes
•Goals:
• Spread availability of new networking
technology
Slide 26
Internet 2 Overview- Buenos Aires, Argentina
August 2002
ORGANIZATION
Internet2 Focus Areas
• Applications
• Engineering
• Middleware
• Network Infrastructure
• Partnerships
Slide 27
Internet 2 Overview- Buenos Aires, Argentina
August 2002
ORGANIZATION
Internet2 membership
• U.S. universities are eligible for membership
• Must commit to putting high-performance
network infrastructure in place on campus and
to other universities ~estimate $.5M/year
expense
• Commit to supporting advanced apps and
technology development
• Join Internet2 project with dues of
$25,000/year
• Maintain commercial Internet connection
• Maintain connection to Internet2 backbone:
Abilene
Slide 28
Internet 2 Overview- Buenos Aires, Argentina
August 2002
How Internet2 works
•Universities commit:
• Engineering lead: connect university to rest of
Internet2 community, deploy new technologies
• Applications lead: support apps development
on campus
• Middleware architect: work with I2MI to
implement middleware infrastructure
•Working groups:
• Of expert/interested individuals within
community
• Chaired by volunteer (sometimes by staff)
• Staff support
Slide 29
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Internet2 Members
200 universities (yellow dots)
70 corporations
40 non-profits and gov’t labs
Slide 30
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Relationship to Federal Govt.
• Separate but interdependent
• 1996: Federal Next Generation Internet Initiative
• NSF provides grant funding to universities for
connections to high performance networks (over 100
funded)
• Early 1997: Internet2 founded
• U.S. Large Scale Networking
• Led by Federal government
• Focused on Federal agency needs
• Internet2
• Led by higher education
• Focused on research and education needs
Slide 31
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Internet2 Focus Areas
• Advanced Applications
• Middleware
• Engineering
• Advanced Network Infrastructure
• Partnerships
Slide 32
Internet 2 Overview- Buenos Aires, Argentina
August 2002
ABILENE NETWORK
Internet2 Network Backbone
• Abilene
• The name of Internet2’s network
infrastructure
• Apr 1998: Project announced at White
House
• Jan 1999: Production status for network
• 15+ GigaPOPs around the country
• NOC located at Indiana University
Slide 33
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Typical Internet2 University
Network Connection
University Campus
University Campus
Internet2 Backbones
(2.4 Gbps)
155 Mbps –
2.4 Gbps
Department
155 Mbps –
2.4 Gbps
100 Mbps
Lab or Classroom
Regional Network
622 Mbps-2.4 Gbps
155 Mbps –
2.4 Gbps
University Campus
Slide 34
Internet 2 Overview- Buenos Aires, Argentina
August 2002
ABILENE NETWORK
Backbone Capacity
Partners: Qwest, Cisco, Nortel, Indiana University, Juniper
Seattle
Chicago
Cleveland
New York
Sacramento
Indianapolis
Washington, DC
Sunnyvale
Denver
Los Angeles
Kansas City
Los Angeles
Atlanta
OC 48
Houston
OC 12
-Today: OC48 (2.4gpbs) POS, multicast, IPv4 & IPv6, quality of service (DiffServ)
- Key international exchange points facilitated by Internet2 membership and the U.S.
scientific community
Slide 35
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Slide 36
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Future of Abilene
• Qwest has extended
commitment for another 5 years
– to October 2006
Sacra
ment
o
Los
Angele
s
• Upgrade of Abilene backbone to
optical transport capability
• 4 times increase in core
bandwidth, to 10
gigabits/second (OC 192)
• New wavelength capabilities
• IPv6 Native
Slide 37
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Internet2 Focus Areas
• Advanced Applications
• Middleware
• Engineering
• Advanced Network Infrastructure
• Partnerships
Slide 38
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Middleware
}
Applications
Advanced Network Services
(Distributed Network Middleware)
Authentication,
Identification,
Authorization,
Directories, Security
Advanced Physical Network Infrastructure
Slide 39
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Middleware
Slide 40
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Internet2 Middleware Initiative
•Focus on core middleware as infrastructure
•Interoperability
• 190 universities will never buy the same software
•Getting stuff implemented
• Best practices
•Integrate across applications
• Discourage ‘islands’ of middleware infrastructure
• E.g. core mware just for this grid project
•Enable community to share resources
• Grid, remote instruments, shared classes
Slide 41
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Internet2 Focus Areas
• Advanced Applications
• Middleware
• Engineering
• Advanced Network Infrastructure
• Partnerships
Slide 42
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Engineering
• Scalable IP Multicast
• http://www.internet2.edu/multicast/
• IPv6
• Quality of Service: QBone
• http://www.internet2.edu/qbone/
• Network Security
• Measurement
Slide 43
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Internet2 Focus Areas
• Advanced Applications
• Middleware
• Engineering
• Advanced Network Infrastructure
• Partnerships
Slide 44
Internet 2 Overview- Buenos Aires, Argentina
August 2002
ABILENE NETWORK
International Peering
STAR TAP/Star Light
Pacific Wave
AARNET,
APAN/TransPAC,
CA*net3,
TANET2
APAN/TransPAC, Ca*net3, CERN, CERnet, FASTnet,
GEMnet, IUCC, KOREN/KREONET2, NORDUnet,
RENATER, SURFnet, SingAREN, TAnet2
NYCM
SNVA
BELNET,
CA*net3,
Washington
HEANET,
JANET,
NORDUnet,
GEANT*
Sacrament
GEMNET,
SINET,
o
SingAREN, WIDE
LOSA
Los Angeles
UNINET
OC3-OC12
San Diego (CALREN2)
El Paso (UACJ-UT El Paso)
CUDI
CUDI
AMPATH
REUNA, RNP2
RETINA, ANSP
* ARNES, CARNET, CESnet, DFN, GRNET, RESTENA, SWITCH, HUNGARNET, GARR-B, POL-34, RCCN, RedIRIS
Slide 45
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Networks reachable via
Abilene – by country
Europe-Middle East
Asia-Pacific
Austria
Italy
Australia
Belgium
Latvia
China
Bulgaria
Lithuania
Hong Kong
Croatia
Luxembourg
Czech Republic Netherlands
Japan
Cyprus
Norway
Korea
Denmark
Poland
Singapore
Estonia
Portugal
Taiwan
Finland
Romania
Thailand
France
Slovakia
Germany
Greece
Hungary
Iceland
Ireland
Israel
Slide 46
Slovenia
Spain
Sweden
Switzerland
United Kingdom
*CERN
Americas
Argentina
Brazil
Canada
Chile
Mexico
United States
Abilene provides transit to vBNS and non-US peers
of Abilene
More information about reachable networks at
www.internet2.edu/abilene/peernetworks.html
Also, see www.startap.net
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Internet2 International Goals
•Ensure global interoperability
• of the next generation of Internet technologies
and applications
•Enable global collaboration
• in research and education providing/promoting
the development of an advanced networking
environment internationally Build effective
partnerships in other countries
•With organizations of similar goals/objectives and
similar constituencies
•Mechanism: Memoranda of Understanding
Slide 47
Internet 2 Overview- Buenos Aires, Argentina
August 2002
International MoU Partners
Europe-Middle East
ARNES (Slovenia)
BELNET (Belgium)
CARNET (Croatia)
CESnet (Czech Republic)
DANTE (Europe)
DFN-Verein (Germany)
GIP RENATER (France)
GRNET (Greece)
HEAnet (Ireland)
HUNGARNET (Hungary)
INFN-GARR (Italy)
Israel-IUCC (Israel)
NORDUnet (Nordic Countries)
POL-34 (Poland)
RCST (Portugal)
RedIRIS (Spain)
RESTENA (Luxembourg)
Stichting SURF (Netherlands)
SWITCH (Switzerland)
TERENA (Europe)
JISC, UKERNA (United Kingdom)
Slide 48
Asia-Pacific
AAIREP (Australia)
APAN (Asia-Pacific)
APAN-KR (Korea)
APRU (Asia-Pacific)
CERNET, CSTNET, NSFCNET (China)
JAIRC (Japan)
JUCC (Hong Kong)
NECTEC / UNINET (Thailand)
SingAREN (Singapore)
TAnet2 (Taiwan)
Internet 2 Overview- Buenos Aires, Argentina
Americas
CANARIE (Canada)
CRNET (Costa Rica)
CUDI (Mexico)
REUNA (Chile)
RETINA (Argentina)
RNP2/ANSP (Brazil)
SENACYT (Panama)
August 2002
Asia to US connectivity
(June 2002)
Country
Network
BW(mbps)
Interconnect
APAN/US
TransPAC
622
Tokyo to P. Wave
(NSF funded)
622
Tokyo to Star Light
Australia
AARNET
310
Pacific Wave
China
CERNET
10?
STAR TAP
Korea
KOREN/KREONET2 45
STAR TAP
Japan
SINET
155
Abilene, Sunnyvale
Japan
WIDE (ipv6 only)
155
Abilene, Sunnyvale
Japan
GEMNET
33
Ab/Sunny. – STAR TAP
Singapore
SingAREN
27
STAR TAP, Sunnyv.
Taiwan
TANET2
155
Pacific Wave
Thailand
UNINET
10?
Abilene, LA
Slide 49
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Europe to US connectivity
(June 2002)
Country
Network
BW(mbps)
Interconnect
CERN
CERN
622 + 2500
coming
Star Light/710 NLSD
France
RENATER
45
STAR TAP/AADS
Ireland
HEANET
465
NYC/STAR TAP
Netherlands
SURFnet
1244+
Star Light
Nordic
Countries
NORDUnet
622?
NYC/Star Light
U.K.
JANET
2500?
NYC
Russia
FASTnet (nee
MIRnet) (NSF
funded)
155
STAR TAP
Europe
GEANT
5000 + 2500
coming
NYC
Slide 50
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Americas Connectivity
(June 2002)
Country
Network
BW(mbps)
Interconnect
Canada
CA*net3
465+
S.T., Pacific Wave, NYC
Mexico
RED-CUDI
255
Tijuana-San Diego
(CALREN2), Juarez/El
Paso
Chile
REUNA
45
AmPATH
Brazil
RNP2
45
AmPATH
ANSP
45
AmPATH
Argentina
RETINA2
45
AmPATH
Gemini/NOAO
(funding from NSF)
10
SFGP
Puerto Rico
(Arecibo
Observatory)
To Abilene-U.S.
45
SFGP
Slide 51
(funding from NSF)
Internet 2 Overview- Buenos Aires, Argentina
August 2002
AmPATH
http://ampath.fiu.edu
• Florida International
University and Global
Crossing led
• Potential to connect 10
countries at 45mbps each
• Peering through Miami
(collocated with SFGP)
• Argentina, Chile, Brazil
Slide 52
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Latin America
•CLARA:
Consorcio Latino Americano
de Redes Avanzadas
Slide 53
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Global Terabit Research Network
http://www.gtrn.net
And coming up:
• Latin America (CLARA)
• Asia (APAN)
Slide 54
Internet 2 Overview- Buenos Aires, Argentina
August 2002
Contact Info / Q & A
• Ana Preston
[email protected]
• More Information
http://www.internet2.edu/
[email protected]
Applications
http://apps.internet2.edu
Slide 55
Internet 2 Overview- Buenos Aires, Argentina
August 2002
www.internet2.edu
Slide 56
Internet 2 Overview- Buenos Aires, Argentina
August 2002