Transcript No Slide Title

Linking U.S.-Russian Science,
Education, Research & Development
with High Performance Networking
Natasha Bulashova, Friends and Partners Foundation
Greg Cole, University of Tennessee
Joe Gipson, University of Tennessee
NSF HIGH PERFORMANCE INTERNATIONAL INTERNET SERVICES PROGRAM
MIRnet
•
•
•
•
NSF Cooperative Agreement (ANI9730330) to the University of
Tennessee with matching funds from
Russian Ministry of Science and
Technology to Russian partners
A 6 Mbps IP/ATM service between
STAR TAP in Chicago and the M9
switch in Moscow for purpose of
linking high performance science and
education networks in US and Russia
A program to encourage applications
of high performance networking for
US-Russian scientific collaboration
Network running reliably since July,
1999
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
Introduction
•
•
•
•
Connectivity
Peering
Management
Project Development
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
Connectivity
•
•
•
•
•
6 Mbps IP/ATM Service
U.S. Terminates at STAR TAP in Chicago
Russia Terminates at M9 switch in Moscow
US/Transatlantic transport - Teleglobe
Russian transport - RASCOM
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
Network Topology
NAP in Chicago is represented with router and
ATM switch connected to STAR TAP
NAP in Moscow is represented with router and
ATM switch connected to Internet Exchange in
M9 which is managed by Russian Institute of
Public Networks.
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
Grap
are
QuickTim
needed
hics e™
deco
toand
se
mpresso
eathis picture.
r
M IL (95O6)ther (4 04)
U.S. Users
N OA A (2,94 1)
• Traffic to U.S.
– 93% educational
– 7% .gov/.mil
N AS A (3,234 )
D OE (15,5
N IH (4,60 6)
Grap
are
QuickTim
needed
hics
e™
deco
toand
smp
eeress
aagency
thisor
picture.
US Government
use of MIRnet (megabytes
transferred since July, 2000)
M IL (8,993 )U SG S (2 ,8 86)
• Traffic from U.S.
– 92% educational
– 8% .gov/.mil
N OA A (1,668 )
D OE (43 ,
N AS A (39 ,63 2)
N IH (29 ,0 38)
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
Russian Users
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
International Traffic Flow to Russia
#7 Canada
3% (22 G)
#2 Sweden
#4 Finland
12% (99G)
4% (31G)
#6 U.K.
3% (24G)
#5 Netherlands
3% (27G)
#13 Japan
#1 U.S.
#3 France
63% (508 G)
4% (33G)
0.3% (2.8G)
#12 China
0.4% (3G)
Primary Country Providers of Traffic to Russia since July 1, 2000
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
Introduction
•
•
•
•
Connectivity
Peering
Management
Project Development
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
MIRnet Consortium
•
US Partners include:
–
–
–
–
–
•
University of Tennessee
STAR TAP
Indiana University
Funding provided by US National Science Foundation
Connectivity provided by Teleglobe
Russian Partners include:
–
–
–
–
–
–
Intro
Russian Institute of Public Networks
Friends and Partners Foundation
Moscow State University
Russian Academy of Science
Funding provided by Ministry of Science & Technology
Connectivity provided by RASCOM/Teleglobe
Statistics
Engineering
Outreach
Impact
Funding
Future
Budget
• NSF Funding
– $800K annually ($4.0
million total)
– $600K for transport
(Chicago - Denmark)
– $135K operations ($65K
overhead)
– $150K cost sharing (UT)
Intro
Statistics
Engineering
• Russian Ministry of Science
Funding
– $500K annually
– ~$300K for transport
(Denmark - Moscow)
Outreach
Impact
Funding
Future
The Russian Team
•
•
•
•
Friends & Partners Foundation
Russian Institute of Public Networking
Moscow State University
Russian Academy of Science
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
QuickTime™ and a
Photo - JPEG decompressor
are needed to see this picture.
Friends & Partners Foundation
• Originating member of
Russian MIRnet team
• Worked with US staff for 7
years on several US-Russian
networking projects
• Focus on developing
domestic Russian
infrastructure via CIVnet
program
Intro
Statistics
Engineering
Natasha Bulashova,
President, F&P
Outreach
Impact
Funding
Future
Russian Institute for
Public Networking
Alexei Platonov, Exec.
Director, RIPN
Russian Backbone Network (RBnet)
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
Moscow State University (MSU)
• Added late to original NSF
proposal
• ATM decision changed
leadership to MSU
• Recipient of Ministry Funds
• Controls Project in Russia
• Determines who in Russia is
routed across MIRnet
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
Russian Academy of Science
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
Introduction
•
•
•
•
Connectivity
Peering
Management
Project Development
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
Review
Oct ‘00
Teleglobe
Sep ‘00
Project Development
Demo
Jun ‘00
Demo
Feb 22 ‘00
Demo
Aug 8 ‘00 MADAS 2
Sep ‘00
Meeting
Nov ‘99
Launch
Sep ‘99
Moscow/
MASS
Nov’98
Announce
Sep’98
Cooperative
Agreement
Jul’98
F&P
Jan’94
Intro
KORRnet
Jun’94
Statistics
NATO
Sep’95
Engineering
IP Down
Jul ‘99
IP Up
Jun’99
MADAS 1.0
Sum’99
Revised
Proposal
Mar’98
CIVnet
Jan’97
Outreach
Impact
Newsletter
Sep ‘00
Teleglobe
Sep’98
Renegotiate
Fall/Winter
‘97
Proposal
Aug’97
NSF RFP
Jun’97
Funding
Future
Usage Statistics
• Usage Analysis
• MIRnet Administrative Data Analysis System
(MADAS)
Intro
Statistics
Statistics
Engineering
Outreach
Impact
Funding
Future
Usage Statistics
• More traffic has transited
MIRnet in the 4.5 months
since June 1, 2000 (1.2
terabytes) than in the 9
previous months (1.1
terabytes)
(total daily network throughput in gigabytes)
Intro
Statistics
Statistics
Engineering
Outreach
Impact
Funding
Future
Monthly Traffic Flow - destination country
400,000
350,000
300,000
250,000
France
Sweden
Finl and
200,000
Denmar k
USA
Russi a
150,000
100,000
50,000
1999-09
Intro
1999-10
Statistics
Statistics
1999-11
1999-12 2000-01
Engineering
2000-02
2000-03 2000-04
Outreach
2000-05
2000-06
Impact
2000-07 2000-08
2000-09
Funding
2000-10
Future
Monthly Traffic Flow - source country
400,000
350,000
300,000
250,000
Netherlands
France
200,000
Finl and
Sweden
Russi a
USA
150,000
100,000
50,000
0
1999-09 1999-10
Intro
Statistics
Statistics
1999-11 1999-12 2000-01
Engineering
2000-02 2000-03 2000-04
Outreach
2000-05 2000-06 2000-07 2000-08
Impact
2000-09 2000-10
Funding
Future
Russian Use by Institution (% total)
100%
80%
Other
60%
Ural State Univ
(Ekaterinbur g)
RU Space Science Inter net
MIRnet Multicast Ser vice
40%
Russi an Academy of
Science
MEPHI
FREEnet
20%
Chernog olovka
Moscow State Univ
0%
199909
Intro
199910
Statistics
Statistics
199911
199912
200001
200002
Engineering
200003
200004
200005
200006
Outreach
200007
200008
200009
Impact
200010
Funding
Future
U.S. Top 10 Institutions (% total)
100%
80%
USC
60%
Uni v of Wi sconsi n
Uni v of Chicag o
UW-Madison
Brown Uni v
UC Berkel y
40%
UIUC
Georg ia Tech
MIT
NLANR
20%
0%
199909
Intro
199910
Statistics
Statistics
199911
199912
200001
200002
Engineering
200003
200004
200005
Outreach
200006
200007
200008
Impact
200009
200010
Funding
Future
Russian Use by Protocol (% total)
100%
80%
60%
Other
ICMP
UDP- Other
TCP- WWW
TCP- FTP
40%
TCP- Other
20%
0%
1999-09
Intro
1999-10
1999-11
Statistics
Statistics
1999-12
2000-01
2000-02
Engineering
2000-03
2000-04
2000-05
Outreach
2000-06
2000-07
Impact
2000-08
2000-09
2000-10
Funding
Future
U.S. Use by Protocol (% total)
Intro
Statistics
Statistics
Engineering
Outreach
Impact
Funding
Future
MIRnet Administrative
Data Analysis System (MADAS)
• Tracks all MIRnet usage
• SQL database fed every 10
minutes from Cisco Netflow data
• All non-proprietary software tools
• Analysis by countries, domains,
hosts, protocols, time periods,
traffic volume
• Generates standard graphics and
allows user-based queries
• Supplements standard tools (mrtg,
etc.)
Intro
Statistics
Statistics
Engineering
Outreach
Impact
Funding
Future
Network Engineering
• Link Configuration
• MIRnet Access Scheduling System (MASS)
• NOC Services
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
Link Configuration
PVC for regular applications (PVCr), 4 Mbp/s
PVC for multicast applications (PVCm)
Router
CISCO7507
Chicago
Router
CISCO7507
Moscow
PVC for special application (PVCs)
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
MIRnet Access Scheduling System
• Proposed system to provide users mechanism for
registering themselves and their applications and to
reserve use of the network for certain applications and
time periods with reasonable assurance that resources
they need will be available.
• To provide management with mechanism for
implementing policy in an on-line database system
which, for the most part, will run unattended.
• To provide differentiated classes of services (via PVCs)
which can be reserved and which are managed in such a
way as to ensure reasonable network service
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
MIRnet Access Scheduling System
• The reservation system will involve a registry of users,
applications, and networks, and a reservation database
with which users can reserve service for specified dates
and times.
• The actual approval of request is to be policy driven as
much as possible and mostly automated so that users
receive immediate response.
• The database system will interact with the MIRnet end
point routers in Moscow and Chicago periodically
updating access control lists which govern which PVCs
the IP flows traverse.
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
MIRnet Access Scheduling System
• Through this system we can formalize the provision of
network services so that users can feel confident about
the network meeting their needs.
• System satisfies concerns of DOE for authorizing users
and applications - and for providing an audit trail of
actual use. Meets the same security concerns on the
Russian side.
• Use of the system should lead to an increased confidence
in the network and resulting increased use.
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
MIRnet Access Scheduling System
• Elements in place include:
– MIRnet administrative Data Analysis System (for
back-end monitoring and reporting)
– User/application registry
• Elements to be developed include:
– Network description component
– Calendar/scheduling component
– Policy component
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
MIRnet NOC Services
• Currently using public
domain software for
monitoring network
and contacting series
of pagers (24/7) if
problems found
• Transitioning to
arrangement with
Indiana University for
providing 24/7 NOC
services
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
Outreach Activities
• Presentations
• Demonstrations
• F&P Outreach
• Information Dissemination
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
Information Dissemination
• MIRnet Users Database
System
• 1000 US-Russian
Partnerships Described
• Partnerships Funded by NSF,
DOE, CRDF, NIH, IREX
• US Russian/NIS Language
Programs
• Searchable by Institution,
City, Investigator, Keyword
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
Information Dissemination
• Letter/Newsletter distributed
to over 500 US-Russian
partnerships
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
The MIRnet WWW Site
•
•
•
•
•
•
Bilingual
Database driven
Dynamic Page Construction
Browser independent
Mirrored in US, Russia
Content
–
–
–
–
–
Intro
Proposal
Project Information
Applications
Services
Usage Statistics
Statistics
Engineering
Outreach
Impact
Funding
Future
Impact
• Institutional Users
• Applications
• Benefits
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
Russian Institution Users
Megabytes transferred July 1 - October 14, 2000
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
US Institution Users
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
US-Russia Networking
Project: Web Cache for
Science and Education
Averaging nearly 1.2 gigabytes of total traffic per
day, the heaviest single application of MIRnet
during its first year has been between the U.S.
National Laboratory for Applied Network Research
(NLANR) web cache and the Russian academic web
cache located in Chernogolovka (scientific city
located 50 km northeast of Moscow). Managed by
the Theoretical Physics Institute, the goal of the
project is to study the properties of WWW traffic
and determine optimal path calculations for
receiving and sending information via the
distributed cache servers. The Cherogolovka web
cache functions as the root web-cache for the
Russian science and education community.
Intro
Statistics
Engineering
Outreach
.
Impact
Funding
Future
Telecommunications for
Technology Transfer and
Distributed Learning
The primary goal of the project is to
develop an advanced infrastructure able to
supply video conferencing (both point-topoint and multi-point) as a regular service
for institutions involved in US-Russia
research and academic collaboration and
the commercialization of technologies.
During the first year of MIRnet’s
operation, the two involved institutions
(the Zelinsky Institute and the University
of Missouri-Columbia) have engaged in
regular video-conferences supporting a
variety of programs - and have achieved
good results using very low bandwidth (64
kbps) H.323 and H.120 technologies.
Intro
Statistics
Engineering
.
Outreach
Impact
Funding
Future
Moscow State/Iowa State
University Cooperation in
Nuclear and High-Energy
Physics
The project is in support of cooperation between
three units of Moscow State University -- the
Institute of Nuclear Physics, the Department of
Theoretical High Energy Physics and Department of
Physics of Atomic Nucleus -- and the International
Institute of Theoretical and Applied Physics at Iowa
State University.
Intro
Statistics
Engineering
Outreach
MIRnet traffic between Iowa State University and Moscow
State University often exceeds 500 megabytes daily. The
graph above shows total traffic transiting MIRnet between the
two institutions since September, 1999.
.
Impact
Funding
Future
Nonproliferation and Arms
Control Projects in the FSU
Since February, 2000, MIRnet has been used by the
Oak Ridge National Laboratory to support its
various collaborations with the Kurchatov Institute
and other Russian research laboratories. In June,
2000, peering arrangements were put in place
enabling all DOE laboratories in the US to use
MIRnet. The primary applications discussed and
observed related to US-RF programs are in
nonproliferation and arms control. Several videoconferencing demonstrations have been held including with senior US government leaders - to
demonstrate the utility of high performance
networks in supporting existing US-RF
collaborative efforts. All of these demonstrations
have been coordinated with Oak Ridge National
Laboratory and the Kurchatov Institute.
Intro
Statistics
Engineering
Outreach
.
Oak Ridge Kurchatov
Institute
traffic from
February,
2000.
Impact
Funding
Future
Weapons Disposal: Reactor
Physics / Thermal hydraulics
Analyses for Plutonium
Disposition
The US and RF are engaged in a cooperative
program to dispose of weapons usable plutonium in
pressurized water reactors in both countries. While
plutonium fuels have been routinely used in western
pressurized water reactors (PWRs) in France and
Germany, such fuels have not been used in Russian
reactors (VVERs). For the past four years, ORNL
has been responsible for transferring technology for
mixed oxide (MOX) fuel to Russia and Kurchatov
Institute has been responsible for educating ORNL
staff as to the design and operation of VVERs.
Academician Ponimarev-Stepnoi (seated, on screen
from Moscow) of the Kurchatov Institute addresses the
June 13, 2000 video-conference involving participants
from Moscow, Washington, Argonne National Lab in
Chicago and Oak Ridge. Included was Howard Baker,
former US Senate Majority leader, heading up a Blue
Ribbon Panel observing US-Russian programs.
MIRnet has supported this cooperative program
through video-conferencing, ftp, use of the Centra
Symposium web-based teaching package,
whiteboard, and applications sharing.
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
US-Russia Materials
Protection, Control &
Accountability program
The objective of the lab-to-lab MPC&A Program is
to enhance, through U.S.-Russian technical
cooperation, the effectiveness of nuclear materials
protection, control, and accounting in Russian
nuclear facilities. The enhancements are
implemented by Russian institutes. The U.S.
laboratories provide funding for the Russian
institutes through laboratory-to-laboratory
contracts.
The two partnering institutions, the Oak Ridge
National Laboratory and the Kurchatov Institute in
Moscow, have used MIRnet since February, 2000 to
support a variety of applications - including videoconferencing (demonstrations, seminars, contract
negotiation), large database (200+ Mbytes) transfer,
radio propagation analysis, and application sharing.
Intro
Statistics
Engineering
Outreach
US participants interact with Dr. Evgenii Velikhov,
President of the Moscow Kurchatov Institute, and other
Russian academicians during the February 22 videoconference between Moscow, Washington, Knoxville
and Oak Ridge. In addition to the video-conferencing,
a demonstration was conducted of application sharing
for joint control of a radio propagation analysis
Impact
Funding
Future
NASA-Russian Space Science
Internet (RSSI) Collaboration
FTP dominates as the primary application between
hosts on NASA’s high performance NREN network
and the Russian Space Science Internet. With daily
flows occasionally reaching 500 megabytes or more,
MIRnet supports a wide variety of NASA-RSSI
programs and activities.
Traffic from NASA hosts to RSSI hosts is shown
above. The primary application is ftp which often
exceeds 256 Megabytes transferred daily.
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
US-Russian Military Officers
Training: Humanitarian Law
This program is in support of a new Russian
Federation Defense order which requires
humanitarian law training for all members of the
Russian Armed Forces. Working with the
University of Virginia Center for National Security
Law, the Russian Ministry of Defense will begin
utilizing MIRnet to support curriculum
development, transfer of training materials, and live
classroom training between sites in Moscow and
Charlottesville, Virginia. The initial demonstration
event is scheduled for November 30, 2000.
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
Sample Academic Partnerships Utilizing MIRnet
Services
•
•
Experimental High Energy Physics High
energy physicists in the Skobeltsyn Institute of
Nuclear Physics at Moscow State University use
MIRnet for collaborating with US partners at the
Fermi National Accelerator and the Stanford
Linear Accelerator. Data is shared and analyzed
from experiments performed in the particle
accelerators for the purpose of obtaining insight
into macroworld structures.
Investigation of Magnetospheric Perturbances
Moscow State University and the Space Physics
Research Laboratory at the University of
Michigan are using MIRnet in support of a joint
project involving a heavy computational
component and the creation/maintenance of a
shared cosmophysical information database
addressing experimental and theoretical research
in the area of magnetospheric and space physics.
Intro
Statistics
Engineering
•
Research of on-line collaboration methods in
distance learning technology development
Based on the collaboration of Ural State
University, Perm State University, and North
Caroline State University in the framework of
their 1997-2000 project “Collaboration in the
field of distance learning in the area of business
management” supported by the US State Dept.,
the project is exploring methods of remote
collaboration via video- and audio- data
exchange (mBONE and H.32x).
•
US-Russia Collaboration in Plasma
Astrophysics Project is multi-disciplinary,
involving specialists in numerical
magnetohydrodynamics, plasma physics, and
astrophysics. Russian scientists work at Cornell
during one-month visits, and the US scientists
visit Russia on a regular basis. Collaboration on
developing 2D computer codes between Keldysh
Institute and Cornell.
Outreach
Impact
Funding
Future
Benefits
• Increased network capacity for data sharing
• Some capacity available for richer communications
(video-conferencing)
• Spurring development of high performance
infrastructure in Russia
• Encouraging US and Russian partners to learn about
new network technologies
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
Funding
• US Potential
– NSF REU Supplement
– NASA, DOE, DOD
• Russian Reality
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
The Future
•
•
•
•
Applications
Capacity Expansion
Russian High Performance Network Expansion
Extension to other NIS countries
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
Application of Scientific
Visualization to Marine
Ecosystem Analysis
Center for Coastal Physical Oceanography at Old
Dominion Univ. with oceanographic colleagues in
Moscow and Vladivostok. MIRnet services for
visualization (fly-thrus of oceanographic models),
large data sets (ftp), video-conferencing, etc.
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
Radiation Epidemiology
Collaboration
The Radiation Epidemiology Branch of NCI
proposes to use MIRnet to cooperate with partners
in Russia, Kazahkstan, Ukraine and Belarus. Part of
the project focuses on epidemiological follow-up on
the Chernobyl disaster.
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
Distance Learning: International
Security in a Changing World
Stanford University will offer a course
"International Security in a Changing World" to
students at Yaroslavl State University and Southern
Ural State University. Both Russian universities are
now (recently) routed across MIRnet. Efforts focus
now on identifying mutually available technology to
be used for the coursework.
Intro
Statistics
Engineering
Outreach
IS/IDL, Institute for
International Studies,
Stanford University
Impact
Funding
Future
US-Russian Internet
Physics Olympiad
Saint Petersburg, Russia
Seattle, Washington
In April '00 high school students in Novosibirsk and
St.-Petersburg (Russia) combined with students in
Seattle and San Diego (America) to participate in an
internet-based science competition. Each of eight
teams were composed of four American and four
Russian students. Each pair of team halves were
linked with their own private chat and whiteboard
connection so they could consult in solving the
problems. They were presented with questions and
then submitted answers through an internet-based
platform which was controlled at a central site; the
system delivered each team's answers to separately
located panels of judges.
Novosibirsk, Siberia
San Diego, California
Sixty Four Students
And a Significant Number of Physicists
and Technologists!
Novosibirsk State University and Cornell University
propose to use MIRnet to enhance opportunities and
expand participation.
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
Collaboration on Spallation
Neutron Source (SNS), Oak
Ridge National Laboratory
Interest from and potential collaboration with
Kurchatov Institute, Obninsk, other Russian
scientific communities on the new Spallation
Neutron Source project being constructed at the Oak
Ridge National Laboratory.
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
Planned Capacity Expansion
• Negotiations with Teleglobe and Russian partners to
expand to 155 Mbps
• Link split between MIRnet (80 Mbps) and academic
commodity traffic (75 Mbps)
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
Russian High Performance Network Expansion
• Critical need to expand beyond Moscow region
• First priorities: St. Petersburg and Novosibirsk
• Success depends upon working with Russian academic
network partners (RBnet)
• Recent dramatic decrease in regional
telecommunications costs for non-profit purposes will
help
Intro
Statistics
Engineering
Outreach
Impact
Funding
Future
Extension to other NIS countries
• Conversations with Ukrainian and
Kazakh academic communities
• Interest from US side in Belarus
• Can happen only after MIRnet
upgrade
Intro
Statistics
Engineering
Outreach
Russia
Belarus
Ukraine
Impact
Kazakhstan
Funding
Future