Transcript International Partners - CIARA - Florida International University

National Science Foundation
International Research Network
Connections Program Kickoff
March 11, 2005
Julio Ibarra, PI
Heidi Alvarez, Co-PI
Chip Cox, Co-PI
John Silvester, Co-PI
Outline







The WHREN-LILA project
US - Latin America Connectivity
Links Interconnecting Latin America (LILA) year 1
The AtlanticWave Project
Monitoring and Measurement Activities
WHREN-LILA Year 1 Milestones
E-Science and Engineering Collaborations
2
The WHREN-LILA Project



Proposal submitted by Florida International
University (FIU) and the Corporation for
Education Network Initiatives in California
(CENIC) - Award# 0441095
Links Interconnecting Latin America (LILA)
aims to Improve connectivity in the Americas
through the establishment of new interregional links
Western-Hemisphere Research and
Education Networks (WHREN) is a
coordinating body of organizations from
across North and South America that aims to
leverage the network resources of
participating members to foster collaborative
research and advance education throughout
the Western Hemisphere
3
Project Goals





Improve network connectivity between North and
South America through the deployment,
operation and evolution of LILA links
Evolve the LILA links to their fullest capacities as
resources and economies permit
Foster collaborative research and advance
education throughout the Western Hemisphere
and other world regions
Support the evolving needs of US science and
engineering researchers
Foster new inter-regional and inter-disciplinary
communities of researchers and learners
4
WHREN - Coordination in the
Western Hemisphere




WHREN will establish a consortium of
participating western-hemisphere organizations
that will collectively oversee the assignment of
lightpaths across administrative domains
A Governance Committee (GC) will collectively
oversee the assignment and management of
lightpaths and provide coordination between
member organizations
A Research Advisory Committee will be formed
to advise the GC on program and network needs
for the broad research and education community
An Engineering Committee (EC) will be
comprised of engineering managers from the
various networks participating in WHREN
5
LILA Project Coordination

Participating Organizations
 FIU (Awardee)
 CUDI (Mexico)
 CENIC (Awardee)
 RNP (Brazil)
 ANSP (Sao Paulo)
 REUNA (Chile)
 CLARA (Latin America)

Project Steering Committee formed, with one member
from each participating organization, for project
implementation and operational decisions

Engineering Committee, comprised of network engineers
from each participation organization, to make network
engineering and operational recommendations to the
Steering Committee
6
US - Latin America
Connectivity before IRNC
Argentina, Brazil (national
and the State of Sao Paulo),
Chile, Panama and Venezuela
connections through Miami
 Mexico connections through
San Diego and El Paso
 Peerings with Internet2 and
other US R&E networks
through AMPATH, CalREN
and UTEP
 International and FedNet
peerings at
STARTAP/Starlight from
Miami provided by AMPATH

7
Regional Development






Cooperation of Latin American research networks (CLARA)
@LIS Alliance of the Internet Society funded program,
providing 10 Million Euros for interconnecting R&D
communities of Latin America and Europe
Creates a regional backbone in Latin America
Direct connectivity to Europe from Sao Paulo, Brazil
Intraregional connectivity between connected countries in
Latin America
3 DS3s from AMPATH to support CLARA initiative
Argentina (RETINA) Ecuador (CEDIA)
El Salvador
Brazil (RNP)
(RAICES)
Chile (REUNA)
Guatemala (RAGIE)
Costa Rica
Mexico (CUDI)
(CRNET)
Nicaragua (RENIE)
Panama (REDCYT)
Paraguay (ARANDU)
Peru (RAAP)
Uruguay (RAU)
Venezuela
(REACCIUN)
(NRENs in formation indicated in RED)
8
Expected CLARA network topology
Network Characteristics:
• 155 Mbps backbone
ring
• 622 Mbps
connection to Europe
• local traffic remains
within the region
• 10 to 45 Mbps spur
links
• 4Mbps satellite link
to Cuba
• Network to be
operated by CLARA
(through CUDI and
RNP)
9
RedCLARA Routed
Network
10
Current US - Latin America
Topology
RedCLARA network starts
operating in August 2004
 Brazil/RNP and Chile/REUNA
today transit CLARA, then
GEANT to reach US R&E
networks
 NSF CHEPREO project and
collaboration with Sao Paulo
R&E community establishes
STM-4 link between US and Brazil
 ITN services and transit to
FedNets through Abilene
 Argentina, Panama and
Venezuela maintaining direct
connections to US through
AMPATH
 Mexico has direct connection to
US through UTEP

11
Links Interconnecting Latin
America (LILA) Year 1
Increases Miami - Sao
Paulo link from 622Mbps
to 1.2Gbps

 Q2 2005
 Evolving to 2.5Gbps
Establishes a dark fiber
segment between San
Diego and Tijuana for a
1Gbps link

 May 2005
Enables interregional
peerings through east
and west coasts

12
LILA Miami - Sao Paulo link
design
Abilene
Provides dedicated Gig-E
interface to ANSP
Provides shared Gig-E
interface to CLARA and
RNP
Support planned for
lightpath provisioning and
deterministic transport
services through
AtlanticWave
Peering with Internet2’s
Abilene and other R&E
networks through AMPATH

NAP of the Americas
Miami
AtlanticWave
AMPATH 1/10 GigE
Switch (Foundry FastIron400)
GigE
AMPATH Router
(Cisco GSR 12012)
GigE
LILA-Miami Optical Mux
(Cisco ONS 15454)
OC192
2 x VC4-4C (2 * 622Mbps = 1.2Gbps)
LILA-Brasil Optical Mux
(Cisco ONS 15454)
GigE
ANSP
router
COTIA
Sao Paulo
GigE
Ethernet switch
GigE
GigE
POP
RedCLARA
POP
RNP
USP
13
LILA San Diego - Tijuana Link

Provides dedicated Gig-E interface to CLARA

Provides dedicated Gig-E interface to CUDI

Growth across border possible through purchase
of additional Gig-Es up to maximum of 6


Connections are to CENIC’s CalREN/HPR routed
network
Peering through CalREN to Internet2 and other
R&E networks
14
LILA San Diego - Tijuana link
design
Physical Diagram
CENIC at
UCSD/SDSC
Logical Diagram
CalREN/HPR
switch
CalREN/HPR
GX POP @ 3180 University
switch
CLARA
switch
switch
CLARA router
CUDI router
Cisco 7206 VXR
CLARA @ BESTEL
in Tijuana
CUDI @ Telnor
in Tijuana
CUDI
CUDI Provided Equipment/fiber
CLARA Provided
WHREN-LILA Provided
15
US - Latin America Year 1
Topology
LILA links reestablish direct
connectivity to South America
from east and west coasts
 Reduces delay reaching
sites in Chile and Brazil from
the US and Asia-Pacific
 Introduces an infrastructure
to develop a distributed
international exchange and
peering

Leverages network
resources to provide route
diversity and high-availability
production services

16
AtlanticWave

AtlanticWave is an International Peering Fabric
 US, Canada, Europe, South America
 Distributed IP peering points:
 NYC, WDC, ATL, MIA, SPB



SURA, FIU-AMPATH-CHEPREO, the IEEAF, MAX,
SoX/SLR, MANLAN, and in partnership with the
Academic Network of Sao Paulo (ANSP) are
combining efforts to establish AtlanticWave
Described as an integral component of the
WHREN-LILA proposal to extend LILA on the
Atlantic side to MANLAN in NYC
Complements the PacificWave distributed
peering facility on the west coast
17
AtlanticWave Topology
A-Wave provides multilayer/multi-protocol services
between participating networks

 Layer 3 peering services
over ethernet
 GLIF “light path” services
 Others TBD
A-Wave will to provide a Layer
3 distributed exchange
capability

 Ethernet based
 Best effort packet
exchange
 Linear topology –
unprotected (NLR based)
 1 GE, 10GE LAN, 10GE
WAN client access
 Jumbo frame support
18
AtlanticWave Design
Initial East Coast US
A-Wave Backbone
Future backbone
Extensions within NA & EU
To
South America
To
Europe &
Canada,
MIA
ATL
Miami, FL
Atlanta, GA
WDC
Washington, DC
NYC
New York City, NY
Sonet services
Prepared by Jerry Sobieski
Ethernet services
19
Generic A-Wave Node Architecture
(using separate switching fabrics)
NLR
Node
A-Wave Backbone OC192c
Sonet
switch
Ethernet WAN PHY
Regional ethernet handoff:
10Gbs LAN or 1Gbs
Prepared by Jerry Sobieski
Regional sonet handoff:
OC192c or OC48c
Payload agnostic
Ethernet
switch
20
Deployment Plans & Timeline

Phase 1: Deploy backbone OC192c
Sept 05
 Between MIA-ATL, ATL-WDC, WDC-NYC
 10Gbs WAN PHY ethernet over NLR wave initially.
 Migration of existing exchange switches/networks
 Regional backhaul
 Reconfiguration of existing exchange services and networks

Phase 2: Sonet switch deployment
Dec 05
 Map IP/Ethernet Peering Fabric across “appropriate” sized VCG (GFPF & VCAT)
 Engineer and deploy GLIF Common Services in conjunction with other
GLIF domains


Phase 3: Deploy dynamic light path services
Phase 4: Expansion
Mar 06
Aug 06 ->
 Integrate links between A-Wave, P-Wave, Northern Tier, etc
21
Monitoring and Measurement
Activities



NSF REU Distributed Network
Monitoring using NetFlow and
MonALISA project
An integrated networking monitoring
system using Cisco Netflow,
MonALISA and NLANR PMA/AMP
tools
PingER and NLANR AMP active
measurement resources in service
for links to Latin America
22
Distributed Network monitoring
using Netflow and MonALISA







Development project that integrates NetFlow
monitoring data with the MonALISA
framework
Collaboration between FIU, Caltech and CERN
Builds a lightweight, scalable and
customizable utility that enables viewing
flows based on source-destination pairs
Allows for a historical trend analysis of
network behavior as well as a close-torealtime look at flow data
Builds a framework for an Integrated Passive
Flow Measurement Toolkit (next slide)
Support from NSF REU Award SCI-0231844
REU Report available at
http://www.ampath.net/publications.htm
23
Integrated Passive Flow
Measurement Toolkit






A real-world deployable network monitoring
toolkit that improves the functionality of
MonALISA by integrating NetFlow and NLANR
PMA
Cisco University Research Program (URP) Award
to Caltech and FIU
Leverages NSF REU project that integrates
NetFlow into MonALISA
Integrates MonALISA, Cisco NetFlow and NLANR
PMA tools to facilitate efficient network planning
and operation for the at large networking
community
Being deployed to monitor traffic flows for
CHEPREO between the US and Brazil
Toolkit will be available by Sept. 2005
24
Measurement and Monitoring Plan



Active measurement
 SLAC PingER (deployed and available, a Telnet server
and a PingER collector for delay/loss information from/to
AMPATH)
Passive measurement
 NLANR PMA (now taking a 90-second trace every hour,
tunable upon request)
 NetFlow (available via the MonALISA service module and
SNMP/MRTG graphs)
Implementation and Deployment
 Service discovery and service integration based on
MonALISA
 Modular design to allow flexible and robust deployment
and extensibility
25
Year 1 Milestones





Implement LILA links
Implement interregional
peering through CalREN
and AMPATH
Establish Coordination
and Control mechanisms
for service management
Deploy AtlanticWave
OC192c backbone
Deploy Next-Gen SONET
switches
May 05
June 05
Sept. 05
Sept. 05
Dec. 05
26
E-Science and Engineering
Collaborations
27
Global LHC Data Grid
Hierarchy
~10s of Petabytes/yr by 2007-8
CMS Experiment
~1000 Petabytes in < 10 yrs?
Online
System
Tier 0
Tier 1
0.1 - 1.5 GBytes/s
10-40 Gb/s
USA
CERN Computer
Center
Mexico
Brazil
Argentina
>10 Gb/s
UF
Tier 2
Caltech
USP
2.5-10 Gb/s
Tier 3
Tier 4
Physics caches
FIU
PCs
UBA
UNAM
28
Grand Challenge Research:CHEPREO



An interregional grid-enabled Center for HighEnergy Physics Research and Educational Outreach
(CHEPREO)
Fosters an integrated program of research, network
infrastructure development, and education and
outreach
 Collaboration with FIU, Caltech, University of
Florida, Florida State University, the State
University of Rio de Janeiro, University of Sao
Paulo
 Augments bandwidth capacity to Brazil
Joint funding by U.S. NSF (MPS-0312038) and State
of Sao Paulo Research Foundation (FAPESP)
29
 Caltech, UF,
UMich,
SLAC,FNAL,
CERN, FIU,
NLR, CENIC,
UCAID,
Translight,
UKLight,
Netherlight,
UvA,
UCLondon,
KEK,
Taiwan, KNU
(Korea),
UERJ (Rio),
USP (Sao
Paolo)
 Cisco



UltraLight Collaboration:
http://ultralight.caltech.edu
Integrated hybrid experimental network, leveraging Transatlantic
R&D network partnerships; packet-switched + dynamic optical paths
 10 GbE across US and the Atlantic: NLR, LHCNet, NetherLight,
UKLight, etc.; Extensions to Korea, Brazil, Taiwan
End-to-end monitoring; Realtime tracking and optimization;
Dynamic bandwidth provisioning
Agent-based services spanning all layers of the system, from the
30
optical cross-connects to the applications.
Grid3  Open Science Grid

Build on Grid3 experience
 Persistent, production-quality Grid, national +
international scope

Ensure U.S. leading role in international science
 Grid infrastructure for large-scale collaborative
scientific research

Create large computing infrastructure
 Combine resources at DOE labs and universities to
effectively become a single national computing
infrastructure for science

Provide opportunities for educators and students
 Participate in building and exploiting this grid
infrastructure
 Develop and train scientific and technical workforce
 Transform the integration of education and research at
all levels
http://www.opensciencegrid.org
31
32
Source: Cindy Zheng
Grand Challenge Science
Instruments
Gemini-South Optical
Observatory
NRAO telescopes
La Serrena, Chile
Atacama Large
Millimeter Array
(ALMA)
Atacama plains in
Chile
33
Traditional VLBI
The Very-Long
Baseline
Interferometry (VLBI)
Technique
(with traditional data
recording)
The Global VLBI Array
(up to ~20 stations can be
used simultaneously)
34
Pan-American Advanced Studies Institute
• NSF sponsored program to offer a series of
lectures at the advanced graduate and
postgraduate level involving domain researchers,
students and practitioners. Award# 0418366, OISE
Americas Program
• Aims to disseminate advanced scientific and
engineering knowledge, stimulate collaborative
Mendoza Argentina
learning and cooperation among the research
communities of the Americas
• CIARA, along with collaborators from the U.S., Argentina and Brazil, is
organizing a PASI to offer a series of lectures on the role of Grid Computing
and Advanced Networking for High-Energy Physics and Astronomy
•Our PASI is planned for May 15-20, 2005 in Mendoza, Argentina
•Approximately 40 students from the Americas will learn of the major
experiments, Grid and advanced networking technologies and how the
growing interdependence between the science and the technologies are 35
forming global collaborations
Thank You!

WHREN-LILA, AMPATH infrastructure,
CHEPREO, science application support,
education, outreach and community
building efforts are made possible by
funding and support from:
National Science Foundation (NSF) awards STI0231844, MPS-0312038, OISE-0418366 and SCI0441095
Florida International University
Latin American Research and Education
community
The many national and international
collaborators who support our efforts
36