Transcript NOC Services and Management

NOC Services and
Applications
Sunday Folayan
NOC Services and Applications
1
What is Network Management?
“In order to operate a reliable service, the network
must be managed according to a determined
discipline, using a coherent structure of information
management.”
Geoff Huston, ISP Survival Guide
NOC Services and Applications
2
How do I manage my network?

Which tools should I use? What do I really
need?
• Keep it simple!
• Need to consider engineers working remotely
• Don’t want to spend too much time maintaining the
tool (it should be helping you!)
• Different tools for NOC and engineers
• Different tools for statistics
• RELIABILITY!
NOC Services and Applications
3
Network Management - Components
Parts of Network Management
•
•
•
•
Configuration/Change management
Performance/Accounting management
Fault management
Security management
NOC Services and Applications
4
Configuration Management
Maintaining information relating to the design of the
network and its current configuration

Network State
• Record of network topology
– Static
what is deployed
where it is deployed
how it is attached
Who is responsible for it
How do I contact them
– Dynamic
operational status of the network elements
NOC Services and Applications
5
Configuration Management

inventory management
• database of network elements
• history of changes & problems

directory maintenance
• all hosts & applications
• nameserver database

host and service naming coordination
• "Information is not information if you can't find it"
NOC Services and Applications
6
Configuration Management
Operational Control of network
 Start/stop individual components
 Alter configuration of devices
 Load and save config versions
 Hardware/Software upgrades
 Methods of access
• SNMPGet / SNMPSet
• Out-of-Band access
NOC Services and Applications
7
What is SNMP?
Simple Network Management Protocol
 query - response system
• can obtain status from a device
• standard queries, enterprise specific

query routers for:
• in and out bytes per second
• CPU load, uptime
• BGP peer session status

query hosts for:
• network status
• Message queues
NOC Services
• Web traffic, Squid proxy
loadand Applications
8
Configuration Management
SNMP driven display
wjh12
mghgw
generali
husc6
harvard
talcott
wjhgw1
harvisr
huelings
geo
pitirium
nnhvd
nngw
oitgw1
sphgw1
lmagw1
dfch
NOC Services and Applications
tch
tch
9
Performance Management
A Consistent level of network performance
 Data collection
– interface stats
– throughput
– error rates
– usage
– percent availability
Data analysis for performance metrics and trends
 Establishment of performance thresholds
 Capacity planning and deployment

NOC Services and Applications
10
MRTG
System:
bb-rtr.ws.afnog.org in
Maintainer:
Description: FastEthernet0/0.67-802.1Q-vLAN-subif Upstream Link
ifType:
Layer 2 Virtual LAN using 802.1Q (135)
ifName:
Fa0/0.67
Max Speed: 12.5 MBytes/s
Ip:
196.216.67.254 ()
NOC Services and Applications
11
Accounting Management

What do you account for?
• Use of the network and the services it provides

Types of accounting data
• RADIUS/TACACS accounting data from Access
servers
• Interface statistics
• Protocol statistics

Accounting Data affects Business Models
• Bill on usage?
• Flat-rate billing?
NOC Services and Applications
12
Fault Management

Identify the fault
• Regular polling of network elements

Isolate the fault
• Diagnosis of the network components

Respond to the fault
• Allocate resources to resolve the fault
• Priority scheduling
• Technical/management escalation

Resolve the fault
• notification
NOC Services and Applications
13
Fault Management - Fault Detection
How can you tell if there is a problem with the
network?
• Network Monitoring Tools
– common utilities
ping
Traceroute
Ethereal
Snmp
– Monitoring Systems
NOCol
Big Brother
Nagios etc…
• Report state or unreachability
– detect node down
– routing problems
NOC Services and Applications
14
Fault Management:Ticket System

system provides for:
•
•
•
•
•
•
short term memory & communication
scheduling and work assignment
referrals and dispatching
oversight
statistical analysis
long term accountability
NOC Services and Applications
15
Fault Management - Ticket Usage
create a ticket on ALL calls
 create a ticket on ALL problems
 create a ticket for ALL scheduled events
 copy of ticket mailed to reporter and mailing
list(s)
 all milestones in resolution of problem maintain
the same ticket #
 ticket stays "open" until problem resolved
 Ticket reporter determines that ticket should be
closed.

NOC Services and Applications
16
Security Management: Do’s & Don’t’s







Dont’ leave things that are likely to be interesting to mice lying
on the kitchen table overnight
Plug the holes that mice are using to get into the house
Don’t provide places within the house for mice to build nests
Set traps along walls where you often see mice out of the corner
of your eye
Check the traps daily to rebait them and to dispose of squashed
mice. Full traps don’t catch mice, and they smell
Avoid using commercial bait-and-kill poisons. Traditional snap
traps are best.
Get a cat!
NOC Services and Applications
17
Security Management - Tools

security tools
•
•
•
•
•

cops - host configuration checker (www.cert.org)
swatch - email reports of activity on machine
Tcpwrappers – log connections, restrict access
ssh/skey – crypto authentication and communications
Tripwire – monitor changes to system files
Keep up to date with security information
• bug reports
– CERT advisories mailing list:
http://www.cert.org./contact_cert/certmaillist.html
• bug fixes
• intruder alerts
NOC Services and Applications
18
Security Management – Good Practice

reporting procedure for security events
• e.g. break-ins
• abuse email address for customers to report
complaints ([email protected])

control internal and external gateways
• control firewalls (external and internal)

security log management
• centralized logging host
• Stealth logger, so it cannot be compromised
NOC Services and Applications
19
References
http://www.merit.edu/ipma/docs/isp.html
 http://www.nanog.org
 http://www.caida.org
 http://www.nlanr.net
 http://www.cisco.com
 http://www.amazing.com/internet/
 http://www.isp-resource.com/
 http://www.merit.edu/ipma
 http://www.ripe.net

NOC Services and Applications
20