Transcript Architectural & Design Overview & Considerations

Wireless InterOp Architecture
and Design
Robert Burchard
Agenda
 Smart Grid Concepts
 Use Cases
 Architectural & Design
Overview &
Considerations
 Network Overview (BH, WWAN,
WLAN, WHAN)
 Coverage and Capacity
 Equipment Specifications
 Indicative Build-outs
 Solution Components
 Overview
 Service Delivery
 Design & Implementation
 Network Management
 Industrial Radios & Carriergrade Equipment
 Application Solutions &
Profiles
 Equipment Mapping to
Applications
2
© 2007 Arcadian Networks. All rights reserved.
Smart Grid Communications
 The U.S. Department of Energy assigns the following
characteristics to smart grid:







Self-healing from power disturbance events
Enabling active participation by consumers in demand response
Operating resiliently against physical and cyber attack
Providing power quality for 21st century needs
Accommodating all generation and storage options
Enabling new products, services, and markets
Optimizing assets and operating efficiently
 Communications to accomplish
 Secure
 Two-way
 High-speed communications
3
© 2007 Arcadian Networks. All rights reserved.
Smart Grid Solutions
 Grid Virtualization








AMI/AMR
Distribution Automation
Substation Automation (Last Mile)
Secure SCADA / DCS / Telemetry
Demand Response / Management
Condition-Based Maintenance
Physical Security and Access Management
Workforce Empowerment & Mobility
 VOIP / Internet
 TMR / AVL / GIS
 Governance & Compliance
 NERC, FERC, 2005 EPA, DHS-NIMS, CPNI
Increased throughput, resiliency and response
* Source Chartwell
4
© 2007 Arcadian Networks. All rights reserved.
Focus on Performance
 Design goals
 Flexibility
 Today's needs
 Growth
 Standards applied
 Visibility
 Network ‘At a glance’
 Performance ‘At a glance’
 M2M, M2P
 Interoperability
 Legacy needs
 Industry trends
 Enable emerging applications
5
© 2007 Arcadian Networks. All rights reserved.
Use Cases
Connexus Energy
Crow Wing Power
Connexus Energy
 Challenge
 Converted from 900MHz substation communications due to reliability and
interference challenges. Moved 900MHz resources to point applications in the field.
 Approach
 Began installation of Arcadian 700MHz for distribution substation communications
in Q1 2007. Deployment ongoing.
 Application
 Supporting SCADA/RTU comms and critical peak load control voltage management
program with GRE.
 Expanded use for 2-way advanced metering back-haul.
 Deployed remote control capability for utility managed generators on customer
premises.
 Enabled VOIP connectivity in substations.
 Results
 20 substations live with ongoing roll out underway as substation data concentrator
and SCADA upgrades occur across system.
 Communication reliability improved from mid 80’s to 99.9%.
Content approved by Connexus Energy
© 2007 Arcadian Networks. All rights reserved.
Crow Wing Power
 Challenge
 Install a cost-effective broadband network connectivity to substations across a wide
geographic service territory.
 Support reliable and dedicated connectivity for two-way advanced metering power
line carrier communication backhaul and load control applications.
 Approach
 Began installation of Arcadian 700MHz modems for distribution substation
communications in Q3 2007. Deployment ongoing.
 Application
 Supporting high speed comms for critical peak load control voltage management
program with GRE.
 Expanded capability and reliability for 2-way advanced metering back-haul and
Landis+Gyr PLC AMI application.
 Results
 Zero weather related outages: Improved reliability and connectivity even during
Winter 2008 blizzard snow storm conditions.
 Communications foundation for additional smart grid applications planned.
Content Approved By Crow Wing Power
© 2007 Arcadian Networks. All rights reserved.
Architectural & Design Overview & Considerations
Network Overview (BH, WWAN, WLAN, WHAN)
Corporate HQ
Generation
Station
Transmission
Lines
WBH
Transmission
Substation
Distribution
Station
Local
Distribution
WWAN
WHAN
WLAN
Arcadian
Networks
Operations
Center (NOC)
Fiber or
700MHz
Microwave
Backhaul
VOIP
Energy
Management
System
9
700 MHz
Pt-Multi-Pt
Basestation
700 MHz
Pt-Multi-Pt Mesh
AVL / GIS
Transmission
Automation
Direct
Customer
Substation
Automation
700 MHz
Pt-Multi-Pt CPE
700 MHz
Pt-Multi-Pt CPE
Workorder
Management
TMR
Distribution
Automation
AMI
© 2007 Arcadian Networks. All rights reserved.
Smart Grid Interoperability Advantages
Storage
Terminals
700 MHz
Pt-Multi-Pt
CPE
?
VSAT
Backhaul
WWAN
Headquarters
?
WLAN
Oil
Platforms
700 MHz
Pt-Multi-Pt Repeater/
Mesh CPEs
700 MHz
Pt-Multi-Pt
Basestation
?
WLAN
Transmission /
Distribution
Automation
10
Oil Well
AMR
700 MHz Broadband
WiFi equivalent Mesh
Fiber or
Microwave
Backhaul
Arcadian
Networks
Operations
Center (NOC)
End–to-end interoperability
© 2007 Arcadian Networks. All rights reserved.
Spectrum Management
 Supports
 Standards Based
 PtMP (Point-to-Multipoint)







Broadband IP/SCADA
Serial SCADA
Dedicated Channels
Shared Channels
Mesh/Repeater
Data privacy
Layered security
AMR / Asset Management
PTT Voice / Mobile Data
AMI / SCADA Mesh / Nomadic
12.5 kHz
12.5 kHz
25 kHz
25 kHz
25 kHz
50 kHz
50 kHz
100 to 330 kHz
100 to 330 kHz
100 to 330 kHz
50 kHz
50 kHz
25 kHz
25 kHz
25 kHz
12.5 kHz
12.5 kHz
M2M Broadband Fixed / Nomadic
757 – 758 MHz
•Mesh
11
•Serial
•Broadband IP - Up to 2.4 Mbs
•Serial •Mesh
© 2007 Arcadian Networks. All rights reserved.
IP Foundation
 IP Enables
 Flat Network
 Intranet end-to-end
 IT and Communications – now same language
 Standards now deployable
 Collected Data
 Payload - Use/needs specific delivery
 Network statistics - Use/needs specific delivery
 Backup duplication in Real-Time
 Interoperability
 Legacy needs
 Industry trends
 Enable emerging applications
 Seamless delivery of Company-Wide Security policies
12
© 2007 Arcadian Networks. All rights reserved.
Smart Grid Zoned Security – IP Addressing & VLANs
Corporate HQ
Transmission
Lines
Customer Owned
Transmission
Local
Distribution
Transformer
Station
Municipal
Station
Local
Distribution Center
Direct
Customer
Generation
Station
IT / Admin / Security
Customer Service
Transmission
Distribution
Engineering
AN Network Management
•Options: logical IP segregation by Region or Technology
:VLAN segregation by “network”: security, users, network management
13
© 2007 Arcadian Networks. All rights reserved.
Security Advantages
Typical, Weak Network
Security
Arcadian Networks End-to-End
Network Security
VPN Server
HQ / Operations
VPN Server
HQ / Operations
Backhaul
VPN Tunnel / VLAN /
Leased Line
WWAN
Wireless
Encryption
Backhaul
3-foot Problem
Un-encrypted
WWAN to
Backhaul
Link
CPE
Modem
14
End-to-End Security
End-to-End:
- VPN
- VLAN
- Encryption
WWAN
CPE
Modem
© 2007 Arcadian Networks. All rights reserved.
Application Solutions &
Profiles
Integrated IP Network Consolidation
 Consolidation leads to:
 Lower total cost of ownership
 Reduced complexity
 Increased service level availability
 Grouping by application types/use
 Greater reliance on individual systems
Mobile Asset
Mgt.
Secure Wi-Fi Hot
Zones
Field Force Mobility
Mission Critical
Mobile Data
Command
& Control
Gas
Distribution
Transformers
Regulators
Capacitor Banks
Fault Indicators
Reclosers
OMS/DMS
AMI
SCADA
Asset Management
Concentrator
Backhaul
Secure 700MHz Wireless Platform
Customer Requirements
16
© 2007 Arcadian Networks. All rights reserved.
Data Integration
Example
 SCADA RTUs
 Meters
 MV90 and real time
 SEL 2030 interface to relays
 VoIP Phone
 WiFi Access Point
 Load management transmitters (where the transmitter is not on the
communications backbone)
 AMR/AMI Backhaul – PLC, wireless
 Remote Generators (customer premises)
 Security (video, card key access – future)
17
•Courtesy of Great River Energy
© 2007 Arcadian Networks. All rights reserved.
Architectural & Design Overview & Considerations
Indicative Build-outs
18
© 2007 Arcadian Networks. All rights reserved.
Architectural & Design Overview & Considerations
Indicative Build-outs
19
© 2007 Arcadian Networks. All rights reserved.
Architectural & Design Overview & Considerations
Indicative Build-outs
20
© 2007 Arcadian Networks. All rights reserved.
Architectural & Design Overview & Considerations
Indicative Build-outs
21
© 2007 Arcadian Networks. All rights reserved.
Application Solutions – Electric Utilities
Corporate, Industrial & Agricultural AMI for Load and Outage Management
1
Meter can be connected directly to radio or via a
2 concentrator for bi-directional communications
 Equipment can be placed in NEMA enclosure if it requires
protection from the elements
3
Radio or concentrator connects to broadband network
4
Data is routed via private 700MHz backhaul WWAN
1
22
2
3
4
© 2007 Arcadian Networks. All rights reserved.
Estimating & Planning
Project Management:
Four-Phase Iterative Methodology
Definition
Execution
Conception
Operations
24
© 2007 Arcadian Networks. All rights reserved.
Architectural & Design Overview & Considerations
Coverage & Capacity
 Coverage
 Base station Antenna Height
 Coverage Area
 ROM
 Coverage Simulation
 Site Visits
 CPE End-point Antenna Height
 Frequency
 700MHz, 2.4GHz, 3.65GHz,
5.8GHz
 Noise-floor
 dB, determines power CPE endpoint radio needs to “hear” a
base station at the given base
station power and antenna height
25
 Capacity
 Application Requirements
 # of Intelligent End Devices
 Reading intervals
 # of Bytes per read
 Maximum Latency Tolerable
 Equipment Capabilities
 # of Base stations / Sectors




Payload
Duty Cycle
Bits/hertz
Serial / Ethernet
 Maximum radios per channel
© 2007 Arcadian Networks. All rights reserved.
ROM Decision Points
 Coverage and capacity concepts are relevant for all
technologies
 Bandwidth, range, channel size, data rate
 Private
 Consumer
 IP or Serial
 Attributes/symptoms differ by technology
 Consumer networks are more difficult to model due to
limited visibility and control over components and
inputs
26
© 2007 Arcadian Networks. All rights reserved.
Architectural & Design Overview & Considerations
Equipment Specifications
 Specifications
 Channel Bandwidth (kHz): spectrum available & frequency planning
 Modulation: defines bit/hz, data rate potential, and performance thresholds
 Data rate / channel (kb/s)
 Combined with bandwidth defines receiver (Tx) sensitivity
 Duplex:
 Frequency division: Tx and Rx simultaneously – requires more spectrum for data rate
 Time Division: Tx and RX share time – use caution when co-locating devices
 Power: combined with Rx sensitivity gives link budget and range potential
 Data Interface: serial, Ethernet, OEM, etc.
 Radios/BTS architecture:
 Point-to-point, Point-to-multipoint, Mesh/Repeater
 Transaction / time
 Influences latency
27
© 2007 Arcadian Networks. All rights reserved.
RF Design – CelPlan Example
Radio Frequency Design Antenna Height Optimization
•High Resolution Terrain
•Multi-factor Clutter
•Signal Testing & Model Tuning
28
© 2007 Arcadian Networks. All rights reserved.
Diagnostics & Lessons Learned

Asset location information


Actual vs. location of record
Continual feedback to the design team

Integrity of as-built information

Aptitude of design support personnel


Future training needs
Integrity of deployment closeout packages


Existing processes may be insufficient for current projects
Methods, thresholds and scope

Network touch versus performance failures

Measurement granularity aligned with application profiles

RF environmental factors

A positive mindset approach to deployment



New technology deployment identifies improvement opportunities for related business and technology
systems
Benefits and opportunities transcend technologies
Project Management Areas Impacted:
1. Project planning and network design
2. Asset information and logistics
3. Spectrum integrity
4. Core network deployment and testing
5. Application cutover
6. Ongoing Operations
29
© 2007 Arcadian Networks. All rights reserved.
Managed Services
Network Operations Center (NOC) Capabilities
 Network Awareness
 Tailor NMS for individual customer
needs and SLA performance
requirements
 Alarm notification and correlation
 SMS
 eMail
 Visual Map with News and Weather
feed
 NMS Alarm Summary Page
 Auto-Generated Incident Ticket
 Troubleshooting
 Methodical, NERC-CIP
troubleshooting techniques and
methodology
 Converged realtime and historical,
performance & RF, statistics
 Incident Resolution
 Tailored for customer needs based
on SLA MTTR requirements with
custom escalation policies
 Technician oriented and proactive
 Root cause
 Steps to be taken
 Site access information and location
 Network and HelpDesk Reporting
 Fully customizable reports
 Customer site performance
 Customer SLA reporting
 MTTR
 Availability
 RF statistical reports for proactive
optimization
 Informative customer ticket
summaries
30
© 2007 Arcadian Networks. All rights reserved.
3rd Party Network
Management System
Integration
Network Awareness
 Network awareness continues with the
actual alarm notifications






SMS
Email
Geographical Asset Map
Hierarchical Network Dependencies
NMS Alarm Summary Page
Auto-Generated Incident Ticket
Basestation
Router
Basestation
Switch
UPS
WMTS
MMU
Modems
32
© 2007 Arcadian Networks. All rights reserved.
We keep an eye on the weather too!
33
© 2007 Arcadian Networks. All rights reserved.
34
© 2007 Arcadian Networks. All rights reserved.
35
© 2007 Arcadian Networks. All rights reserved.
36
© 2007 Arcadian Networks. All rights reserved.
37
© 2007 Arcadian Networks. All rights reserved.