Transcript 20060426-PerfUpdate-boyd

Performance Update
Eric L. Boyd
Director of Performance Architecture and
Technologies
Internet2
Vision: Performance Information is …
• Available
• People can find it (Discovery)
• “Community of trust” allows access across
administrative domain boundaries (AA)
• Ubiquitous
• Widely deployed (Paths of interest covered)
• Reliable (Consistently configured correctly)
• Valuable
• Actionable (Analysis suggests course of action)
• Automatable (Applications act on data)
2
Eric L. Boyd
Getting There: Build & Empower the
Community
Decouple the Problem Space:
•Analysis and Visualization
•Performance Data Sharing
•Performance Data Generation
Grow the Footprint:
•Clean APIs between each layer
•Widespread deployment of
measurement infrastructure
•Widespread deployment of
common performance
measurement tools
3
Analysis &
Visualization
Analysis &
Visualization
API
Measurement
Infrastructure
Measurement
Infrastructure
API
Performance
Tools
Performance
Tools
Eric L. Boyd
Result: No more mystery …
• Increase network awareness
• Set user expectations accurately
• Reduce diagnostic costs
• Performance problems noticed early
• Performance problems addressed efficiently
• Network engineers can see & act outside their turf
• Transform application design
• Incorporate network intuition into application
behavior
4
Eric L. Boyd
BWCTL (Bandwidth Controller)
• What is it?
A resource allocation and scheduling daemon for
arbitration of iperf tests
• Typical Solution
• Run “iperf” or similar tool on two endpoints and
hosts on intermediate paths
• Typical road blocks
• Need permissions on all systems involved
• Need to coordinate testing with others
• Need to run software on both sides with specified
test parameters
5
Eric L. Boyd
BWCTL: 3-Party Flow Diagram
initia
l
conn
ectio
n
bwctl
client
ure
reso ts
es
requ
req
ue
res sts/
ults
t s/
ues
req sults
re
bwctld
(request broker)
bwctld
(request broker)
bwctld
(peer agent)
iperf
(test process)
6
bwctld
resource broker
(master daemon)
initial
tion
connec
re
re sou
q u rc
es e
ts
bwctld
resource broker
(master daemon)
verify time/
return results
test
stream
bwctld
(peer agent)
iperf
(test process)
Eric L. Boyd
NDT: Network Diagnostic Tool
• Web100 enhanced server handles testing and
diagnostic services
• Java based and command line clients allows
testing from any client (local or remote)
• Performance and configuration faults reported
back to client
• Drill-down functions provide more details &
error reporting capabilities
• Grant from NIH/NLM to explore duplex
mismatch detection
7
Eric L. Boyd
NDT Flow Diagram
Well Known
NDT Server
NDT - Server
Client
Web
Web
Server
Web Page Request
Browser
Web page response
Testing
Engine
Test Request
Java
Applet
Spawn child
Child
Test Engine
8
Eric L. Boyd
OWAMP: One-Way Active Measurement
Protocol
• What is it?
• Measures one-way latency: 1-way ping
• Control connection used to broker test
request based upon policy restrictions and
available resources. (Bandwidth/disk limits)
• Specification
• http://tools.ietf.org/wg/ippm/draft-ietf-ippmowdp/draft-ietf-ippm-owdp-14.txt
9
Eric L. Boyd
OWAMP Flow Diagram
Server
owampd
[Resource Broker]
Client
Initial
connection
owping
client
[Control]
/
sts
e
u
q
Re sults
Re
owampd
[Control]
OWD Test
Endpoint
10
sts/
Reque s
t
Resul
OWD Test
Endpoint
Eric L. Boyd
Thrulay Overview
• Network capacity and delay tester
• Same class of tools as iperf, netperf, nettest, nuttcp,
ttcp, etc.
• Unique features not found in other tools:
• TCP: measures round-trip delay along with goodput
• UDP: measures:
•
•
•
•
One-way delay, with quantiles
Packet loss
Packet duplication
Reordering
• UDP: ability to send precisely positioned true Poisson
streams (microsecond errors in sending times)
• Human and machine-readable (ready to be fed to gnuplot)
11
Eric L. Boyd
Thrulay Update
•
•
•
•
•
•
•
•
•
New release v0.8
Tests with multiple TCP streams
Set DSCP (a.k.a. first 6 bits of the TOS byte)
Report MTU and/or MSS (whichever the OS makes available)
More UDP statistics: duplication, reordering, quantiles of delay
SPARC/Solaris support
Mac OS X support
IPv6 support
Non-busy-waiting UDP mode (less precise, but can run more
concurrent tests)
• Documentation: manual pages have been added
• Basic client authorization based on IP address
• Integration of TSC timekeeping projects for faster and more
precise timestamping
12
Eric L. Boyd
Bulk Transport
• Build a library / tool for bulk transport that does
not require kernel level modifications yet
achieves the performance of such
• VFER library
• Congestion control hooks
• Implements loss-based congestion control
• Working on delay-based version
• File transfer utility
• An initial version demoed
13
Eric L. Boyd
How can you use them?
• Tools are open source, supported, welldocumented
• BWCTL/Iperf, OWAMP, NDT are
deployed across Abilene backbone and
at many partners
• You can:
• See ongoing measurement results at the
Abilene Observatory
• Test to/from the Abilene backbone
14
Eric L. Boyd
Network Performance Measurement
Workshops
• Example Course Materials:
• http://e2epi.internet2.edu/npw/presentations.html
Goals:
• Grow installed base of BWCTL/Iperf, OWAMP, and
NDT at GigaPoP and regional campuses.
• http://e2epi.internet2.edu/pipes/pmp/pmp-dir.html
• Begin integration into IT support processes.
• Create an installed base for perfSONAR
deployment.
• Give each participant tool-specific cookbooks.
15
Eric L. Boyd
Network Performance Measurement
Workshop Locations and Dates
•Completed
•
•
•
•
•
•
•
•
•
•
16
SOX / GaTech (03/05)
CENIC / UCLA (06/05)
JT – Vancouver (07/05)
OARNet / OSU (09/05)
MAGPI / FMM (09/05)
MAX / College Park
(12/05)
APAN (01/06)
JT - Albuquerque (02/06)
MERIT (02/06)
Columbia / NYSERNet
(04/06)
•Planned
• University of Virginia
(04/06)
•Under Consideration
• Wisconsin, Alaska, …
Eric L. Boyd
Additional Outreach
• National Library of Medicine
• Presentation on end-user tools at NLMcentric Network Performance Monitoring
Pilot-project Workshop (March 2006)
• New World Symphony
• Presentation on end-user tools at NWS
Master Class Workshop (January 2006)
• On-going dialog on end-user needs
17
Eric L. Boyd
Collaboration
• Working Groups
• Bulk Transport (transport.internet2.edu)
• GGF Network Measurement (nmwg.internet2.edu)
• perfSONAR (www.perfsonar.net)
• Funded Research
• “Bridging the Gap” (NSF)
• Network Measurement for International Connections
• Google Summer of Code
• 2005 very successful
• 2006 planned
18
Eric L. Boyd
perfSONAR Overview
• What: Measurement infrastructure for exchanging data under
development
• How: Webservices network performance framework
•
•
•
•
•
Network measurement tools
Network measurement archives
Distributed scheduling/authorization
Multi-domain policy
Common language (GGF NMWG Schema)
• Where: Deployed / to be deployed across:
• Network Backbones (Abilene, ESNet, GÉANT)
• Regional Networks (NRENs, RONs, Gigapops)
• Universities
• When: First product release early summer ‘06
19
Eric L. Boyd
perfSONAR Credits
•perfSONAR is a joint effort:
•
•
•
•
•
ESnet
Fermilab
GÉANT2 JRA1
Internet2
RNP
•Internet2 includes:
• University of Delaware
• Georgia Tech
• Internet2 staff
20
•GÉANT2 JRA1 includes:
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Arnes
Belnet
Carnet
Cesnet
DANTE
DFN
FCCN
GRNet
ISTF
PSNC
Nordunet (Uninett)
Renater
RedIRIS
Surfnet
SWITCH
Eric L. Boyd
How can you use it?
• perfSONAR Link Utilization and Capacity
data available from Abilene, ESnet,
GÉANT (prototype)
• Build your own components to integrate
into open source framework
21
Eric L. Boyd
perfSONAR: Project Activity Meter
•
•
•
•
22
1-2 conf calls/week
1 new service/month (accelerating)
3-4 development workshops/year
3-4 paper submissions/year
Eric L. Boyd
perfSONAR: System Description
•Domains represented
by a set of services
•Each domain can
deploy services
important to the
domain
•Analysis clients
interact with service
across multiple
domains
23
Eric L. Boyd
perfSONAR: Services (1)
• Lookup Service
• Allows the client to discover the existing services and other
LS services.
• Dynamic: services registration themselves to the LS and
mention their capabilities, they can also leave or be removed
if a service gets down.
• AuthN/Z Service
• Internet2 MAT, GN2-JRA5 (eduGAIN)
• Authorization functionality for the framework
• Users can have several roles, the authorisation is done based
on the user role.
• Trust relationships defined between users affiliated with
different administrative domains.
24
Eric L. Boyd
perfSONAR Services (2)
• Transformation Service
• Transform the data (aggregation, concatenation, correlation,
translation, etc).
• Topology Service
• Make the network topology information available to the
framework.
• Find the closest MP, provide topology information for
visualisation tools
• Resource protector
• Arbitrate the consumption of limited resources between
multiple services.
25
Eric L. Boyd
Inter-domain perfSonar example
Useful graph
interaction
Client
Token MA
Here
is who I am, Token
I’d likeMB
to access MA B
Here is who
I’d likeA,toMA
access
a,b,cI am,
: Network
A, AAMA
A A
Where Link utilisation along - Path a,b,c?
you go
Get Link utilisation a,b,c Get link Here
utilisation
c,d,e,fAA B
AA A
Here
you
a,b,c:
go
Network
A
–
LS
A,
Where Link utilisation along - Path a,b,c,d,e,f?
c,d,e,f : Network B, MA B, AA B
LS A
a
MA A
b
Network A
MA B
f
e
c
26
LS B
d
Network B
Eric L. Boyd
perfSONAR: Status Update
• Production release of base package expected
by June (code freeze next week)
• Will include:
• Single domain LS solution
• RRD MA
• (no AS)
• Additional services and client applications
supporting this version will soon follow:
• BWCTL MP
• perfSONAR UI
27
Eric L. Boyd
perfSONAR: Hot Topics
• Multi-domain hierarchical LS
• AuthN/Z development plan with JRA-5
(eduGAIN)
• SSH MP (LookingGlass) service
• Topology Services
• L2 specific MA service
28
Eric L. Boyd
perfSONAR: Current Developments
•MPs
• SSH/Telnet (Looking
Glass)
• ABW (bandwidth packet
capture cards)
• BWCTL
• NMS (SDH status)
• SNMP
• Command line (OWAMP,
Ping, Traceroute)
29
•MAs
•
•
•
•
•
•
RRD
SQL
TopS
BWCTL
Hades (owd, jitter, owpl)
Flow replicator
•Visualization Clients
•
•
•
•
CNM
perfSONAR UI
Visual perfsonar
Looking glass
Eric L. Boyd
Questions?
30
Eric L. Boyd
perfSONAR: authN/Z plans
• perfSONAR(JRA-1)/JRA-5 sub-group
• Group tasked with determining how to
leverage JRA-5 authentication system
(eduGAIN) in perfSONAR infrastructure
• Jeff Boote (Internet2)
• Diego Lopez (RedIRIS)
• Maurizio Molina (Dante)
• Andreas Solberg (Uninett)
31
Eric L. Boyd
perfSONAR: Background
• Designed with Federated authentication
in mind
• AS becomes a ‘proxy’ for Authorization
requests
32
Eric L. Boyd
eduGAIN: Background
•JRA-5 provided authentication “interface”
•Provides “bridging” to other
authentication systems
• Shibboleth
• PAPI
• Others…
•Designed mostly with web-browser
interaction in mind
33
Eric L. Boyd
Current Status
• Group has come to general consensus
on how this should work
• Paper is currently underway describing
interaction of perfSONAR with eduGAIN
API
34
Eric L. Boyd
perfSONAR: Trust relationship entities
•Client
•idP (identity provider)
•pSR (perfSONAR
resource “service”)
•AS (perfSONAR AS
service)
•HLS (Home Location
Service)
35
Eric L. Boyd
Automated Client Interaction
36
Eric L. Boyd
Normal User Interaction
37
Eric L. Boyd
Implications for JRA-5
• Future extensibility for multiple X.509
root CA certificates
• Non-web profile for authN attribute
request
• Current identity provider servers
(attribute stores) may need to hold
attributes for non-human clients
• Others???
38
Eric L. Boyd
Implications for JRA-1
•AS has slightly different role
• Clients never directly interact with AS
• AS is effectively a ‘proxy’ between services and the eduGAIN
‘bridging elements’
•Attribute requests from services to RP’s and from RP’s
to AS need to be made in a ‘boolean’ fashion to protect
the privacy of clients
•Automated clients MUST have X.509 client certificates
39
Eric L. Boyd
Questions/Concerns
• Let us know if you would like a copy of
the ‘document’ when it is complete
• Please feel free to send further
questions/comments to Maurizio and Jeff
[email protected]
[email protected]
40
Eric L. Boyd
41
Eric L. Boyd
Deployment
• Network Performance Workshops
• Hands-on tool deployment training
• GigaPoP/campus involvement
• 250+ participants/11 Workshops
• Global Deployments
• Infrastructure (GÉANT2, RNP, Internet2, & ESnet)
• Individual Tools (e2epi.internet2.edu/pipes/pmp/pmpdir.html)
42
Eric L. Boyd
Performance Tools (1)
• OWAMP: One-Way Active Measurement
Protocol
• One-way Delay
• BWCTL: Bandwidth Control
• Wraps NLANR / DAST-created Iperf
• Measures throughput
43
Eric L. Boyd
Performance Tools (2)
• NDT: Network Diagnostic Tool
• Diagnoses common performance problems
between a server and your laptop
• Downloaded java applet from the web runs the
tests
• Thrulay
• Network capacity and delay tester
• TCP: measures round-trip delay along with goodput
• UDP: measures: one-way delay, with quantiles;
packet loss; packet duplication; reordering
44
Eric L. Boyd