Transcript Digital Divide and PingER

Digital Divide and PingER
Prepared by Les Cottrell for the ICFA meeting, August
15, 2003
www.slac.stanford.edu/grp/scs/net/talk03/icfaaug03.html
Partially funded by DOE/MICS Field Work Proposal on
Internet End-to-end Performance Monitoring (IEPM), also
supported by IUPAP
PingER Benefits
• Measures analyzes & reports round-trip
times, losses, availability, throughput ...
– Uses ubiquitous ping, no special host, or
software to install/configure at remote
sites
– Low impact on network << 100bits/s,
important for many DD sites
– Covers 75+ countries (99% of Internet
connected population)
• Provides quantitative historical (> 8yrs)
and near real-time information
– Aggregate by regions, affiliations etc.
– How bad is performance to various
regions, rank countries?
– Trends: who is catching up, falling behind,
is progress being made?
– Compare vs. economic, development
indicators etc.
• Use for trouble shooting setting
expectations, presenting to policy
makers, funding bodies
Countries Monitored
Country
Used to monitor
Only 1 host
Need > 1 host to
reduce anomalies
Host
s
Country
Host
s
Country
Host
s
Country
Host
s
Argentina
6
Estonia
1
Latvia
1
Slovakia
2
Armenia
2
Finland
1
Lithuania
1
Slovenia
1
Australia
4
France
11
Macedonia
2
S Africa
3
Austria
2
Georgia
1
Malaysia
3
Spain
6
Azerbaijan
2
Germany
Mexico
5
Sweden
4
Bangladesh
1
Ghana
1
Moldova
2
Switzerland
8
Belarus
2
Greece
1
Mongolia
1
Taiwan
1
Belgium
3
Guatemala
2
Netherlands
12
Thailand
1
Hungary
5
New-Zealand
4
Turkey
2
Iceland
3
Nigeria
1
Uganda
1
10
Norway
2
Ukraine
2
Brazil
21
Bulgaria
1
Canada
11
India
13
Chile
4
Indonesia
3
Pakistan
1
UK
36
China
6
Iran
4
Peru
1
US
208
Colombia
4
Ireland
2
Poland
4
Uruguay
3
Costa-Rica
1
Israel
5
Portugal
2
Uzbekistan
2
Croatia
5
Italy
13
Romania
1
Venezuela
2
Cuba
2
Japan
11
Russia
12
Vietnam
1
Czech-Rep
3
Jordan
1
Saudi Arabia
1
Albania
0
Denmark
1
Kazakhstan
2
Serbia & Montenegro
2
Philippines
0
Egypt
1
Korea
2
Singapore
1
Recent additions
• Contacts
– New contacts in Vietnam, the Philippines,
Serbia/Montenegro, Belarus, Macedonia, Albania,
Turkey, and Tunisia
– Looking for contacts in Cuba, Kenya, Algeria and
South Africa, Uganda
• Added hosts in Macedonia, Serbia/Montenegro,
Belarus, Turkey, Armenia, Mexico and
Azerbaijan.
• Increased hosts monitored from CERN to give
better European view
– Now monitoring 60 countries
Current State – June ‘03
(throughput)
• Within region performance better
– E.g. Ca|US-NA, Hu-SE Eu, Eu-Eu, Jp-E Asia, Au-Au, Ru-Ru
• Africa, Caucasus, Central & S. Asia all bad
Bad < 200kbits/s < DSL
Acceptable > 200, < 1000kbits/s
Good > 1000kbits/s
Trends
S.E. Europe, Russia: catching up
Latin Am., Mid East, China: keeping up
India, Africa: falling behind
Africa shown for only
Uganda seen from SLAC,
since adding new countries
with very different
throughputs distorts result
Loss Comparisons with
Development (UNDP)
Weak
correlation
with Human
Development
or GDP
Even
weaker with
education &
literacy
Albania
Moldova,
Ukraine
Georgia
Romania
Estonia
Lithuania
Iran, Islamic
Slovenia
Turkey
Belgium
Greece
Iceland
Poland
Ireland
Croatia
Italy
Denmark
Slovakia
Switzerland
Spain
Austria
Hungary
Finland
Netherlands
Czech
United States
80
60
40
10K
GDP per Capita (PPP US$)
100
Source: UN
0
NREN Core Network Size (Mbps-km)
10M
2000
2001
1M
100K
Source: From slide prepared by Harvey Newman, presented by David
Williams ICFA/SCIC talk on Serenate report. Data from the TERENA
Compendium
Europe
Albania
Moldova,
Ukraine
Georgia
Romania
Estonia
Lithuania
Iran, Islamic
Slovenia
Turkey
Belgium
Greece
Iceland
Poland
Ireland
Croatia
Italy
Denmark
Slovakia
Switzerland
Spain
Austria
Hungary
Finland
Netherlands
Czech
United States
HDI
120
40000
Human Development Index (HDI) Rank
35000
GDP per capita
Source: UN
30000
25000
20000
15000
20
10000
5000
0
Leading
Advanced
In transition
Lagging
1K
100
Derived throughput~MSS/(RTT*sqrt(loss))
Network Readiness
A&R focus
• NRI from Center for International Development, Harvard U.
http://www.cid.harvard.edu/cr/pdf/gitrr2002_ch02.pdf
– Using derived throughput ~ MSS / (RTT * sqrt(loss))
– Fit to exponential
Internet for all focus
• Improved correlation (0.21 => 0.41) by:
Collaborations & Funding
• 35+ monitoring sites in 15 countries
– Plan to add ICTP Trieste if funded
– Other projects used toolkit, e.g. XIWT
• SLAC with help from FNAL
• Digital Divide collaboration (MOU) with ICTP, Trieste
– eJDS
– They are looking for a EU grant for eJDS and PingER
• Need funding for coming year:
– Working with DoE, NSF, Pew Charitable Foundation …
– Tasks:
• (0.5 FTE) ongoing maintain data collection, explain needs, reopen
connections, open firewall blocks, find replacement hosts, make
limited special analyses, prepare & make presentations, respond to
questions
• (+ 0.5 FTE) extend the code for new environment (more countries,
more data collections), fix known non-critical bugs, improve
visualization, automate reports generated by hand today, find new
country site contacts, add route histories and visualization, automate
alarms, update web site for better navigation, add more DD monitoring
sites/countries, improve code portability
• Also looking for small grants for helpers in developing countries
• ICFA: show importance to policy makers, funding agencies,
identify sympathetic contacts at agencies, get support
Summary
• Performance is improving all over
• Performance to developed countries are orders of
magnitude better than to developing countries
• Poorer regions 5-10 years behind
• Poorest regions Africa, Caucasus, Central & S. Asia
• Some regions are:
– catching up (SE Europe, Russia),
– keeping up (Latin America, Mid East, China),
– falling further behind (e.g. India, Africa)
More Information
• PingER:
– www-iepm.slac.stanford.edu/pinger/
• eJDS
– www.ejds.org/
• ICFA/SCIC Network Monitoring report, Jan03
– www.slac.stanford.edu/xorg/icfa/icfa-net-paper-dec02
• Monitoring the Digital Divide, CHEP03 paper
– http://arxiv.org/ftp/physics/papers/0305/0305016.pdf
• Human Development Index
– www.undp.org/hdr2003/pdf/hdr03_backmatter_2.pdf
• Network Readiness Index
– www.weforum.org/site/homepublic.nsf/Content/Initiatives+subhome
EXtras
Netherlands
Canada
Sweden
Japan
Venezuela
Mexico
Slovakia