Transcript Slide 1
Monitoring JANET: from photons to flows Demands - Architectures - Regulation Steve Williams JANET • Demands: •From researchers •From NOCs/institutions/’power’ users Monitoring JANET from photons to flows Requirements •Layer 1, 2, 3 … metrics •Routing (BGP/ISIS) – updates/full feed •Packet capture data (up to 40Gbps) •Flow data •Legal requirements •RIPA, DPA, private data, ethical behaviour The SuperJANET5 5th Objective Network Visibility •Indivudual vs institutional data & summary vs detail data •Research topics in the UK •Visualization •Signature analysis / DPI •Anomaly processing •Optical networks/switching •Issues: •Standards in measurements •Standard approach across measurement types Steve Williams [email protected] •Interchange of data between systems •Hard to compare measures directly •What is a ‘good’ link? 2 Monitoring JANET from photons to flows JANET and Research • Aim to support and encourage research and assist where possible by providing bandwidth and services that help researchers • Assist network research by providing access to the network • Need to balance: – operational vs research requirements… – legal vs research requirements Monitoring is research driven 3 Technology Innovation Network Science Applications UKLIGHT ‘network’ projects ESLEA Applications and the Network MASTS Analysis at All Scales in Time & Space Real-time Monitoring Towards Next Generation Networks 46PaQ Protocol Innovation Behaviour And Performance For QoS and Control Data Acquisition, Storage & Archiving Compression (Model Free & Model Dependant) Data Analysis and Traffic Modelling Front End Enhancements: Advanced Protocols SuperJANET and UKLIGHT Research Activities and Projects Example: Research at ESSEX University TRIUMPH Develop switching node for: - Bit-rate adaptation - Multiwavelength regen LUCIFER Control plane and network resource provisioning for Grid and eScience Label Switching Routers Modelling end to end QoS across heterogeneous nets SONET/SDH Collector ring Edge OPS HIPNET UPC Optical Transport Network Networking with ultra-short pulses: -OTDM transmission -OTDM switching -Time-Slot Interchange OXC Core OPS OB S OPORON ephoton/ephoton+ OPSnet UFORIC PROTAGON 40G all-optical burst Rx MUFINS Hardware based CBR with optical impairments Monitoring JANET from photons to flows - LHC - JIVE - DEISA -Layer 0 network -UKLight STM/GE circuits 6 FaTMAN UHI Monitoring JANET Glasgow NIRAN from photons to flows Clydenet C&NLMAN EaStMAN AbMAN NorMAN Overall Network: - 5,815km New Dark Fibre - 112 optical nodes/sites -746Gbps operationa capacity -60 x 10G plus 2.5, 1 Core Network: - 8 nodes - 2,290Km fibre - 20 Terminal systems, 23 Amp/OADM - Longest un-regen – 554km - Longest span – 243.6km (51.2db) Regional Network access: - 3,561km Fibre - 24 optical networks - 73 sites - 36x10G, 26xSTM16,16GE and an STM1 Dublin (HEANET) YHMAN NNW Leeds Warrington EastNe MidMAN EMMAN T-City T-House London Reading TVN LMN WREN Kentish MAN SWERN LeNSE 7 Bristol Monitoring JANET from photons to flows Graphic removed 8 Private network Probe/Measure traffic Inst-meas-1 RN Measurement probes Inst-meas-1 Core MP-1 SuperJANET4/5 RN Monitoring JANET from photons to flows Inst-meas-1 Firewall Extreme 450 1000Mbps/TX - IP-SLA Ping SNMP Perl 3TB V480 •Performance •RTT •OWD •Loss SD/DS •HTTP •DNS •TCP Connect •HTTP transfer •Total time •DNS •Response time •VoIP •MOS •Connect •NTP •Time V240 V240 Cisco 35xx 9 The JANET Measurement System Monitoring JANET from photons to flows 10 Monitoring JANET from photons to flows 11 Monitoring JANET from photons to flows - Traffic types Top talkers Incident tracking Anomaly detection Signature analysis etc - Challenges: - >70k flows/sec at 10:1 sample rate - T640’s not good at sampling 12 Monitoring JANET from photons to flows Multicast 13 Monitoring JANET from photons to flows Multicast AG conference@5mbps Add soton screen shots 14 Monitoring JANET from photons to flows Beyond IP JANET IP JANET Lightpath Optical Transmission (DWDM) 15 Optical NE data: Alerts - Light on/off Ciena/VzB - SNMP traps Nortel via SNMP Monitoring JANET from photons to flows JANET Optical Core DWDM Juniper T640 Flow data: SuperJANET5 – Optical monitoring: Feed to Optical Switch and Optical monitoring equipment Packet data to content level: Incident/Anomaly detection, Signature analysis Traffic types Incident detection Packet headers only Sampled 16 Monitoring JANET from photons to flows Optical layer packet capture Production SJ5 fibres 1 – 40Gbps Anomaly detectiion Incident tracking Packet signature analysis Encrypted signatures 17 Monitoring JANET from photons to flows What was that about sniffing packets Isn’t that interception? 18 Monitoring JANET from photons to flows • JANET is a private network – No public/walk in access – Only access to staff/students/bona fide visitors – Breach of RIP by network operations staff is civil case not criminal – Breach by non-operations staff is still criminal (student hackers etc…) – http://www.ja.net/development/legisl ation/laws.html 19 • Principle of ‘least disclosure’ Monitoring JANET from photons to flows Research access to data – No access to data not required – Use anonymisation where possible – Access to full data only in cases where proven case presented – No access to header and payload data – Payload summary data/signatures • Researchers agree to and sign policy – Non-disclosure of data – Maintain privacy – Scope of research work • This policy works only because JANET is a private network. 20 Tape Backup JANET Measurement Systems Data Throughput Manager Data Gatherers Measurement Database and Central Controller Standby Database External Databases Delivery Sub-systems Users Web Alerts NRG ... Gridmon Flow monitoring CDF ... Measurement System Measurement system application NTP Ping ... ... Data timeslices Data timeslices Data timeslices Web service API Measurement controller Data Gatherers Meas’ment job configuration file Monitoring JANET from photons to flows Key issues • Architecture of monitoring is key • Interchange of data between sytems • Stability and comparability of data between locations and across time • The legal framework cannot be ignored – Some researchers try… – Some countries have less stringent laws 23 Monitoring JANET from photons to flows 24