Transcript cisco nx-os

Deploying OpenStack with Cisco
Compute, Network and Storage
Duane DeCapite, OpenStack Product Management
Ashok Rajagopalan, UCS Product Management
November 2013
© 2013 Cisco and/or its affiliates. All rights reserved.
1
COMMUNITY PARTICIPATION
• Code Contributions and blueprints across Core services
• Networking model, Compute Service and
Dashboard, HA, Scheduling,
• OpenStack Foundation Board member
CISCO OPENSTACK ENGINEERING
OpenStack
@ Cisco
• Automation (Puppet) and architectures (HA) for
production deployment and operational support
• Quantum/Neutron/Nova Plug-ins for Cisco
product lines
• UCS, Nexus, CSR1000V
• Scalable networking services
• FWaaS, LBaaS, VPNaaS
CUSTOMERS
• Private, Public
• Extend cloud model for rapid provisioning of network
services, bare-metal, intelligent workload placement
• Drive innovation through real-world use cases
© 2013 Cisco and/or its affiliates. All rights reserved.
2
Innovation in Cloud Computing through OpenStack’s Network
Service and Cisco’s Open Network Environment (SDN)
Applications each see
their own logical DC
API-driven
Open Cloud Platform
VM
VM
VM
VM
VM
VM
OpenStack
Compute
OpenStack
Networking
OpenStack
Storage
(Nova)
(Neutron)
(Swift, Cinder, CEPH)
Platform
APIs
Programmable
Infrastructure
One Platform Kit (onePK)
on ISR G2, ASR 1K
© 2013 Cisco and/or its affiliates. All rights reserved.
VM
a
Controllers
and Agents
Cisco ONE Controller SW
Openflow Agents
Virtual
Overlays
VXLAN Gateway, Openstack,
Service Chaining
CSR 1KV
3
• Comprehensive Cisco Integrated Solution for
OpenStack
• Operational efficiency with UCS and
networking integrations with OpenStack
• Pre-defined reference configurations and
performance optimized solutions
• SaaS applications and GRID scaleout
applications
© 2013 Cisco and/or its affiliates. All rights reserved.
4
© 2013 Cisco and/or its affiliates. All rights reserved.
5

As of Q3FY13 UCS revenue reached a $2B annualized run rate.

In Q3FY13, Data Center revenue was 515M growing 77% Y/Y

As of May 2013, there are over 23,000 unique UCS customers which
represents 89% Y/Y growth

More than half of all Fortune 500 customers have invested in UCS

Over 500 customers have booked over 1 Million in UCS solutions
and over 1,200 have booked over $500,000

Over 3,400 Channel Partners are actively selling UCS worldwide and
over 1700 UCS specialized partners in the channel world wide

As of CY12 Q4 Cisco is one of the Top 5 Server Vendors, #2 in Blade
servers based on Worldwide Revenue Share1

73 World Record Performance Benchmarks to date
Source: 1 IDC Worldwide Quarterly Server Tracker, Q1 2013, May 2013, Revenue Share
© 2013 Cisco and/or its affiliates. All rights reserved.
6
Performance Optimized for Bare Metal, Virtualized, and Cloud Applications
Cisco UCS: Many Server Form Factors, One System
Blade
Rack
Scale Out
Industry-Leading Compute Without Compromise
Enterprise
Intensive / Mission Critical
Performance
UCS C240 M3
UCS C24 M3
Entry, Expandable Rack
Server for Storage
Intensive Workloads
Ideal Platform for Big Data,
ERP, and Database
Applications
UCS C22 M3
UCS C220 M3
Entry Rack Server for
Distributed and Web
Infrastructure Applications
Versatile, General Purpose
Enterprise Infrastructure, and
Application Server
UCS B22 M3
UCS B200 M3
Entry Blade Server for IT
Infrastructure and Web
Applications
Optimal Choice for VDI,
Private Cloud, or Dense
Virtualization/
Consolidation Workloads
UCS C420 M3
Enterprise Class, 4-Socket
Server for Large, MemoryIntensive Bare Metal, and
Virtualized Applications
UCS C460 M2
UCS C260 M2
Mission-Critical, 4-Socket
Server for Large, CPUIntensive Applications
Mission-Critical, 2-Socket
Extended Memory Server for
Large, Memory-Intensive
Applications
UCS B440 M2
UCS B420 M3
Mission-Critical, 4-Socket
Enterprise Class, 4-Socket
Blade for Large, CPUBlade for Large, MemoryIntensive Bare Metal
Intensive Bare Metal
UCS B230 M2
and Virtualized Applications
and Virtualized Applications
Density-optimized CPU and
Memory-Intensive 2-Socket
Blade for Bare Metal and
Virtualized Applications
© 2013 Cisco and/or its affiliates. All rights reserved.
7
Blade and Rack Servers Managed a Cohesive Resource Pool
UCS Manager
UNIFIED MANAGEMENT
A SINGLE UNIFIED SYSTEM FOR
BLADE AND RACK SERVERS
ServiceService
Profile: HR_App1
UCS
Profile
C-Series Rack
Optimized Servers
A Major Market
Transformation in Unified
Server Management
© 2013 Cisco and/or its affiliates. All rights reserved.
VNIC1
Unified Device Management
MAC: 08:00:69:02:01:2E
HR_WEB_VLAN (ID=50)
Network Policy
VNIC2
MAC: 08:00:69:02:01:2F
HR_DB_VLAN (ID=210)
Policy
HBAStorage
1 and 2
WWN: 5080020000075740
WWN: 5080020000075741
Server
VSAN
ID: 12 Policy
Boot Order: SAN
BIOS Settings:
Turbo On
HyperThreading On
Benefits of UCS Manager and
Service Profiles for Both Blade
and Rack-Optimized Servers
B-Series
Blade Servers
Add Capacity
Without Complexity
8
L2/L3 Switching
Single Rack 16
servers
Single Domain
Up to 10 racks, 160 servers
UCS Manager
© 2013 Cisco and/or its affiliates. All rights reserved.
Multiple Domains, up to 10K nodes
9
Cisco UCS OpenStack Solution Accelerator Paks
Compute-intensive
(2) UCS 96-Port 6296 Fabric
Interconnect
(2) Nexus 2232 PP
(6) UCS C220 M3 Servers w/
dual Intel Xeon E5-2665 2.4
GHz Processors, 192GB of
Memory, Mega RAID, 4 x
900GB 10K SAS HDDs
© 2013 Cisco and/or its affiliates. All rights reserved.
Mixed-use
(2) UCS 96-Port 6296 Fabric
Interconnect
(2) Nexus 2232 PP
(6) UCS C220 M3 Servers w/
dual Xeon E5-2665 2.7 GHz
Proc, 192GB of Memory, Mega
RAID, 4 x 600GB 10K SAS
HDDs
(2) UCS C240 M3 Servers w/
dual Intel Xeon E5-2665 2.4
GHz Proc, 192GB of Memory, 1
x Mega RAID, 24 x 900GB 10K
SAS HDDs
Storage-intensive
(2) UCS 96-Port 6296 Fabric
Interconnect
(2) Nexus 2232 PP
(8) UCS C240 M3 Servers w/
dual Intel Xeon E5-2665 2.4
GHz Proc, 192GB of Memory, 1
x Mega RAID, 24 x 900GB 10K
SAS HDDs
10
High-Density
2 Control Nodes
C220-M3s
2 Compute Nodes
C220-M3s
nova-api
keystone-api
glance-api
cinder-api
horizon-UI
nova-api
quantum-api
cinder-api
Network Node
quantum-api
CEPH
MON/MDS/RAD
OS
KVM Hypervisor
© 2013 Cisco and/or its affiliates. All rights reserved.
2 Storage Nodes
C220-M3s
cinder-api
CEPH Deploy
CEPH Object
Storage Devices
11
Mixed-Workload
2 Control Nodes
C220-M3s
4 Compute Nodes
C220-M3s
nova-api
keystone-api
glance-api
cinder-api
horizon-UI
nova-api
quantum-api
cinder-api
Network Node
quantum-api
CEPH
MON/MDS/RAD
OS
KVM Hypervisor
© 2013 Cisco and/or its affiliates. All rights reserved.
2 Storage Nodes
C240-M3s
cinder-api
CEPH Deploy
CEPH Object
Storage Devices
12
Storage-intensive
2 Control/Storage Nodes
C240-M3s
nova-api
keystone-api
glance-api
cinder-api
horizon-UI
Network Node
quantum-api
CEPH
MON/MDS/RAD
OS
© 2013 Cisco and/or its affiliates. All rights reserved.
6 Compute/Storage Nodes
C240-M3s
nova-api
quantum-api
cinder-api
KVM Hypervisor
CEPH Deploy
CEPH Object
Storage Devices
13
Client
API
calls
Compute
(Nova)
1
Infrastructure
Hypervisors
nova-api
4
Bare-metal
Nodes
nova-compute
nova-volume
2
(will be replaced by
Cinder)
nova-network
(will be replaced by
Neutron)
3
nova-schedule
© 2013 Cisco and/or its affiliates. All rights reserved.
14
Client
API
calls
Compute
(Nova)
1
Infrastructure
Hypervisors
nova-api
6
Bare-metal
Nodes
nova-compute
nova-volume
2
4
(will be replaced by
Cinder)
nova-network
(will be replaced by
Neutron)
5
UCS Manager
Creates Server Profile
based on request
parameters
nova-schedule
UCS Edition
3
Returns identity for
storage in OS DB
© 2013 Cisco and/or its affiliates. All rights reserved.
15
© 2013 Cisco and/or its affiliates. All rights reserved.
16
Cisco Unified Fabric
Continuous Market Leadership
DC TECHNOLOGY LEADER
40,000+
11M+
Cisco NX-OS
Customers
10GE Ports
Shipped
Cisco FabricPath
Customers
Cisco FEX
Customers
1,500+
11,000+
DATA CENTER SWITCHING LEADER
#
Market share by revenue
in Q3 2012 for DC Ethernet
Switching at 71.7%*
1
#
Market share by revenue
in Q3 2012 for FCoE SAN
Switching at 87.3%**
1
*Source: Infonetics, Q3 2012 DC Network Equipment Report, December 2012 **Source: Dell’Oro, SAN Switching, November 2012
Data
current
of December
Cisco Confidential
© 2011 Cisco
and/or itsas
affiliates.
All rights reserved. 2012. Subject to change without notice.
17
LAN
LAN/SAN
Cisco
Cisco
Cisco
Nexus
5000
Nexus 3000 Nexus 4000
Cisco Nexus ® 1010
Cisco
Cisco
Nexus 7000
Nexus 6000
Cisco
Nexus 2000
Cisco Nexus 1000V
CISCO NX-OS: From Hypervisor to Core CISCO DCNM: Single Pane of Management
DELIVERING TO YOUR DATA CENTER NEEDS
Resilient, High
Performance,
Scalable Fabric
© 2011 Cisco and/or its affiliates. All rights reserved.
Workload
Mobility Within/
Across DCs
Secure
Separation/
Multitenancy
LAN+SAN
Convergence
Operational Efficiency
Cisco Confidential
18
http://docwiki.cisco.com/wiki/OpenStack:Grizzly-Nexus-Plugin
© 2013 Cisco and/or its affiliates. All rights reserved.
19
• Automated VLAN Provisioning
Configure VLANs on the Nexus switch
• Layer 3 Gateway
Map Nexus Switch Virtual Interface (SVI) to tenant VLAN
Scalability with Top of Rack (ToR) Nexus as default Layer 3 Gateway
Eliminates configuration and bottleneck of host-based software L3 forwarding Agent
• Multi-Homed Host Deployments
Virtual Port Channel (vPC) for High Availability (HA) and link optimization to multiple Nexus switches
• Hardware and Software-based Networking
Performance benefits of hardware-based ToR switch (Nexus 3000, 5000, 6000, 7000)
Flexibility of software-defined Networking with Nexus 1000V
© 2013 Cisco and/or its affiliates. All rights reserved.
20
Management Network
nova-compute
nova-compute
nova-compute
nova-compute
*-plugin-agent
*-plugin-agent
*-plugin-agent
*-plugin-agent
dhcp-agent
• Flat Networking Traffic
• VLAN Traffic across Nodes
• GRE or VXLAN tunnels across Nodes
*-plugin-agent
Network Node
Compute
Node
L2B/OVS
Compute
Node
Compute Node
Compute Node
Data Network
• Removes bottleneck of generic
server-based network node
with Linux IP tables
© 2013 Cisco and/or its affiliates. All rights reserved.
nova-scheduler
neutron-server
keystone
L2B/OVS
L2B/OVS
• SVI configured on Nexus for L3
forwarding and external
Gateway
nova-api
mysql, rabbit...
Nexus PI
Cloud Controller
Node
API Network
External Network
Internet
API Network is
typically routable to
enable public access
21
•
Foundation of Virtual Services Architecture
• vPath Service Insertion/Chaining
• VXLAN Overlay Networking
Management Network
dhcp-agent
dhcp-agent
dhcp-agent
*-plugin-agent
*-plugin-agent
*-plugin-agent
l3-agent
l3-agent
l3-agent
nova-compute
nova-compute
nova-compute
nova-compute
*-plugin-agent
*-plugin-agent
*-plugin-agent
*-plugin-agent
VSM/N1000V
Network
NetworkNode
Node
Network Node
Compute
Node
N1000V
Compute
Node
Compute Node
Compute Node
nova-api
nova-scheduler
neutron-server
keystone
Data Network
mysql, rabbit...
Cloud Controller
Node
API Network
External Network
Internet
© 2013 Cisco and/or its affiliates. All rights reserved.
API Network is
typically routable to
enable public access
22
Management Network
Network or Compute node(s) hosts CSR
nova-compute
nova-compute
nova-compute
nova-compute
*-plugin-agent
*-plugin-agent
*-plugin-agent
*-plugin-agent
dhcp-agent
CSR Provides per tenant
isolation and full IOS
capabilities including VPN,
BGP, OSFP, MPLS, etc.
*-plugin-agent
nova-api
nova-scheduler
quantum-server
keystone
CSR 1000V
VSM/N1000V
Network Node
Compute
Node
N1000V
Compute
Node
Compute Node
Compute Node
Data Network
mysql, rabbit...
Cloud Controller
Node
API Network
External Network
Internet
© 2013 Cisco and/or its affiliates. All rights reserved.
API Network is
typically routable to
enable public access
23
New OpenStack Services from Cisco Advanced Services
Portfolio
Strategy and
Assessment
(Available Now)
Validation
(Available Now)
Design &
Deployment
(December 2013)
Optimization
(December 2013)
Problems Solved
Key Deliverables
 Is OpenStack the correct
platform for my business
 What are my key requirements
for OpenStack?
 Strategy Assessment high
level roadmap and
architecture
 Prioritization of use cases
 Pre-defined design
 Rapid installation & Test
 Lack of OpenStack skillsets
 Pre-defined design
 Test plan
 Knowledge Transfer
 How to create or add
production safety, availability
and scale to my openstack
deployment.
 Custom application assistance
 Topology and requirements
evolution
© 2013 Cisco and/or its affiliates. All rights reserved.
 Network Scale and High
availability design
 Storage Integration
 Cell deployment design
 Design review
 Software Upgrade procedures
 Day 2 Support for Customized
deployments
Key Benefits
 Understand role of
OpenStack in your DC/Cloud
strategy
 Experiment with OpenStack
installation in your data center
environment
 Accelerate production
readiness
 Optimally deployed on Cisco
hardware
 Ensure deployment evolution
 Targeted support expertise for
your customized solution
24
© 2013 Cisco and/or its affiliates. All rights reserved.
25
To run the install script, copy and paste the following on your command line (as root with your proxy set if necessary as above):
curl -s -k -B https://raw.github.com/CiscoSystems/grizzly-manifests/multi-node/install_os_puppet | /bin/bash
With a proxy, use:
https_proxy=http://proxy.example.com:80/ curl -s -k -B https://raw.github.com/CiscoSystems/grizzly-manifests/multinode/install_os_puppet > install_os_puppet
chmod +x install_os_puppet
./install_os_puppet -p http://proxy.example.com:80/
The Cisco OpenStack High-Availability Guide differs from the OpenStack High Availability Guide by
providing an active/active, highly scalable model for OpenStack deployments. The architecture
consists of the following components used to provide high-availability to OpenStack services
Galera Cluster for MySQL ,RabbitMQ Clustering, RabbitMQ Mirrored Queues, HAProxy,
Keepalived
http://docwiki.cisco.com/wiki/COE_Grizzly_Release:_High-Availability_Manual_Installation_Guide
© 2013 Cisco and/or its affiliates. All rights reserved.
27
Cisco offers a complete Compute, Networking and Storage Solution for OpenStack
Cisco provides Advanced and Technical Services to help migrate from Pilot to Production
Please let us know how we can help you with OpenStack by contacting us at [email protected]
More information can be found at www.cisco.com/go/OpenStack
Back Up
© 2010 Cisco and/or its affiliates. All rights reserved.
©
2013 Cisco and/or its affiliates. All rights reserved.
29
Pre-configure UCS
Provision UCS Servers
Hostname / IP address
Chassis/Server Discovery
Logical credentials
Service Profile Association
Resource allocation preferences
PXE boot devices deployed
Register Nodes
Cobbler database update
Only Point of User Touch
Event Listener
Host OS Install
Updates the newly added node
info in puppet
PXE boot for initial OS install
Puppet apply
RHEL 6.4 installation on bare-metal
servers
Add hosts/system in OpenStack
Sync all the plugins from Puppet
Master
OpenStack Handover
Inventory of nova nodes on
controller
VM Provisioning
OpenStack Services Deployment
Build Node
1. Read conf file
2. Apply policies
3. Update Puppet/Cobbler DB
5. Puppet sync
4. PXE Boot
Control
Node
(glance, scheduler,
API-deamons)
Compute Nodes (novacompute, libvirtd)
© 2013 Cisco and/or its affiliates. All rights reserved.
32
© 2013 Cisco and/or its affiliates. All rights reserved.
33
Clients
© 2013 Cisco and/or its affiliates. All rights reserved.
Neutron (Formerly Quantum) Service
Networks
34
OpenStack Module Structure
/neutron/plugins/cisco/ - Contains the Network Plugin Framework
/client - CLI module for core and extensions API
/common - Modules common to the entire plugin
/conf - All configuration files
/db - Persistence framework
/models - Class(es) which tie the logical abstractions to the physical topology
/nexus - Nexus-specific modules
/test/nexus - A fake Nexus driver for testing the plugin
https://wiki.openstack.org/wiki/Cisco-quantum
© 2013 Cisco and/or its affiliates. All rights reserved.
35
core_plugin = neutron.plugins.cisco.network_plugin.PluginV2
[keystone_authtoken]
auth_host = <authorization host's IP address>
auth_port = 35357
auth_protocol = http
admin_tenant_name = service
admin_user = <keystone admin name>
admin_password = <keystone admin password>
https://wiki.openstack.org/wiki/Cisco-quantum
© 2013 Cisco and/or its affiliates. All rights reserved.
36
/neutron/plugins/cisco/cisco_plugins.ini file
mysql -u<mysqlusername> -p<mysqlpassword> -e "create database neutron_l2network”
vswitch_plugin=neutron.plugins.openvswitch.ovs_neutron_plugin.OVSNeutronPluginV2
/neutron/plugins/openvswitch/ovs_neutron_plugin.ini
[OVS]
bridge_mappings = physnet1:br-eth1
network_vlan_ranges = physnet1:1000:1100
Tenant_network_type = vlan
https://wiki.openstack.org/wiki/Cisco-quantum
© 2013 Cisco and/or its affiliates. All rights reserved.
37
/neutron/plugins/cisco/cisco_plugins.ini file
[NEXUS_SWITCH:1.1.1.1]
# Hostname and port used of the node
compute-1=1/1
# Hostname and port used of the node
compute-2=1/2
# Port number where the SSH will be running at the Nexus Switch, e.g.: 22 (Default)
ssh_port=22
# Provide the Nexus credentials, if you are using Nexus switches. If not this will be ignored.
username=admin
password=mySecretPasswordForNexus
https://wiki.openstack.org/wiki/Cisco-quantum
© 2013 Cisco and/or its affiliates. All rights reserved.
38