Transcript Software Defined Datacenter – from Vision to Solution

Software Defined
Datacenter – from
Vision to Solution
Gorazd Šemrov
Datacenter Solution Architect
Microsoft WW Modern
Datacenter Center of Excellence
Don’t Turn off your mobile, but please
keep it on silent 
Thank you.
Session Takeaways
Understanding what is Software defined Datacenter and what are
the benefits that can bring to the business.
Vision of Software Defined Datacenter and how Datacenter future
looks like.
How Software Defined Datacenter will change your jobs.
Understanding technical details and concepts of solution by
example.
3
Agenda
Introduction – WHAT?
Definition of Software Defined Datacenter (SDD)
What are the components of the SDD
What are the goals of SDD
Vision – WHY?
What is Infrastructure Vision and why you should care about
What are the benefits of SDD
Solution – HOW?
Software Defined Storage
Software Defined Networking
Q/A and Open Discussion
4
What is Software Defined
Datacenter?
What defines SDD?
Abstraction
Decoupling of a resource from the consumer of the resource (also commonly referred to as virtualization when talking
about compute resources). This is a powerful foundation as the virtualization of these resources should enable us to define
‘models’ of infrastructure elements that can be managed without requiring management of every element
individually.
Instrumentation
Opening up of the decoupled infrastructure elements with programmatic interfaces (typically XML-based RESTful APIs).
Automation
Using these APIs, wiring up the exposed elements using scripts and other automation tools to remove “human
middleware” from the equation. This is an area where traditional information security tools are woefully inadequate.
Orchestration
Beyond script-based automation, automating the provisioning of data center infrastructure through linkages to policy driven orchestration systems where the provisioning of compute, networking, storage, security and so on is driven by
business policies such as SLAs, compliance, cost and availability. This is where infrastructure meets the business.
6
What are the goals of SDD?
Agility
Speed to respond human middleware, speeding the ability of infrastructure to be provisioned.
Adaptability
Ability to change infrastructure usage to dynamic meet dynamically changing requirements and changing context –
such as location, sensitivity of the data being handled and so on. Also ability to adapt to changes in the infrastructure
elements underneath without changing the models being managed (new hardware, new vendors, etc.)
Accuracy
By removing the human middleware component, reducing the chance for misconfiguration and mistakes by making
infrastructure “programmable” and tying this into automation systems.
Assurance
Confidence that what is deployed accurately meets your policy and compliance requirements
7
Why should you care
about Software Defined
Datacenter?
Infrastructure-as-a-Service Vision
Dramatically lowering the costs and
effort of delivering Infrastructure services
Turn key solutions.
Disaggregated compute, storage and
network
Compute Clusters
SMB
Independent manage and scale at each layer
Industry standard servers,
networking and storage
Scale-Out File Server Clusters
Storage Spaces Virtualization and Resiliency
Inexpensive networks
Inexpensive shared JBOD storage
Commodity hardware
Shared JBOD
Storage
9
Impact to the business
10
How should I implement
Software Defined
Datacenter?
Steps to building cloud solution
Tools are not capabilities or skills
Prioritize stack integration over high end features… whatever you don't buy, you'll end up
building, and supporting
You will need more skills not less… Prioritize PEOPLE
A lot more Statistics, Quality Assurance, Service Definition and Business Architecture is a good
thing
Step 1
Extreme
Standardization
Step 2
Step 3
Step 4
Step 5
Step 6
Step 7
Base lining / Health
Management
SLA
Service
Management
Process Engineering
& Pre-Production
Automation &
Orchestration
Change Control
Self Service
12
Deployment models
Unsupported
Design
Recommended
Cost
Practices
Product Line
Architectures
Office 365 /
Azure
(Public
Cloud)
13
Complexity
Custom Design
Software Defined Compute – Hyper-V
Virtualized compute, memory, devices
Isolation of tenants
Containerized storage (VHDX)
QOS limits on networking, storage
Live migration
Transparent servicing of hardware
Dynamically load balance compute
Host based backup and replication
Comprehensive automation – pervasive powershell
support
14
Software Defined Networking - NVGRE
Network resources are carved out
from a common pool
Seamless migration to the cloud
Move n-tier topology to the cloud
Preserve policies, VM settings, IP addresses
Automated resource deployment with
flexibility to place VMs across any
cloud
Private Cloud datacenter consolidation and efficiencies
Extension of datacenter into hybrid cloud
Incremental integration of acquired company network infrastructure
Technology Investments
Hyper-V Switch as the policy edge
Hyper-V Network Virtualization for tenant network overlays
Multi-tenant gateways for hybrid connectivity
Automated physical switch management with OMI and Powershell
SCVMM and Windows Azure Pack for automation
15
Software Defined Storage – Scale Out File Server
10Gb-E
RDMA Port
10Gb-E
RDMA Port
Node Chassis
Scale-Out File Server
SMB3 Service
10Gb-E
RDMA Port
10Gb-E
RDMA Port
Scale-Out File Server
SMB3 Service
10Gb-E
RDMA Port
10Gb-E
RDMA Port
Scale-Out File Server
SMB3 Service
10Gb-E
RDMA Port
10Gb-E
RDMA Port
Scale-Out File Server
Build upon “dumb storage”
•
•
•
SMB3 Service
CSV v2 + CSV Cache
Failover
File System
Clustering
File System
Storage Spaces
Storage Spaces
asd
File System
s
File System
Storage Spaces
Storage Spaces
Storage Pool(s)
SAS HBA
SAS SAS SAS
Port Port Port
SAS
Exp
SAS HBA
SAS HBA
SAS
Port
SAS
Exp
SAS SAS SAS
Port Port Port
SAS
Port
SAS SAS SAS
Port Port Port
SAS
Exp
SAS
Exp
SAS
Exp
Mix of HDD and SSD housed in JBOD
Multiple JBODs
Multi-path IO to JBODs/disks
SAS HBA
SAS
Port
SAS SAS SAS
Port Port Port
SAS
Port
SAS
Exp
SAS
Exp
SAS
Exp
SAS JBOD Chassis with
two Expanders
(2 in/out ports each)
SAS JBOD Chassis with
two Expanders
(2 in/out ports each)
SAS JBOD Chassis with
two Expanders
(2 in/out ports each)
SAS JBOD Chassis with
two Expanders
(2 in/out ports each)
Dual Port SAS Disks
Dual Port SAS Disks
Dual Port SAS Disks
Dual Port SAS Disks
Software virtualizes, makes reliable,
continuously available
•
•
•
•
•
•
•
•
NOTE: Each JBOD Chassis Expander has 4 SAS links – 2 links used to connect to Nodes, and
two links to provide MPIO connectivity in the case of a SAS expander failure.
16
Storage Pools
Storage Spaces (mirrored, parity)
Write Back Cache
Tiered storage (SSD/HDD)
Volume Snapshots
Clustered Storage (CSVFS)
Continuously Available Storage (SMB3)
Storage Migration
SDS design
Hardware
Bez.
HCK Certification
Intel Chassis
2x CPU
Hyper-V (1)
iDRAC
Intel 1G
(Teamed)
1
1
1GE
1GE
Hyper-V (2)
Intel 10G
(Teamed)
2
1
Mellanox
(RDMA)
2
1
iDRAC
2
1
Intel 1G
(Teamed)
1
Intel 10G
(Teamed)
1 2
2
Hyper-V (n)
Mellanox
(RDMA)
1 2
iDRAC
Intel 1G
(Teamed)
1
1
128GB RAM
Intel 10G
(Teamed)
1 2
2
Mellanox
(RDMA)
1 2
10GE
10GE
VM Traffic (NVGRE capable)
2x10GE
Configuration
2xCSVs configured on cluster
Network
Switch – S4810
2xStorage Spaces with Tiering (SSD-Tier:12xSSD – HDD-Tier: 48xDisks – 5 Columns – 3way Mirror)
RDMA SMB 3.0 Storage
2x10GE
VLAN X / VLAN Y
SSD-Tier: 12x SSDs – HDD-Tier: 48x Disks – 3way-Mirror
2x Scaleout File-Servers configured, 1CSV assigned to each, RDMA enabled
Management
VLAN
Management LAN switch
S55
10GE
10GE
1
1
2
2
1
Hardware
DELL R720
1GE
1GE
2
2x CPU
1
Mellanox Mellanox INTEL 1G
RDMA
Teamed
RDMA
1
1
iDRAC
iDRAC
File Server 1
2
1
1
2
Intel E5
128 GB RAM
2
INTEL 1G Mellanox Mellanox
RDMA
Teamed
RDMA
2x 200GB SSD RAID1 for OS
Intel S3500
File Server 2
2x 2P Mellanox ConnectX3 10Gbps
2x 1Gb INTEL
2x SAS LSI 9207-8e HBA
LSI 9207-8e
LSI 9207-8e
LSI 9207-8e
LSI 9207-8e
4
4
1
1
3
2
1
3
2
1
2
3
4
2
3
4
Hardware
1
2
SAS IN
PowerVault MD3060e
SAS IN
1
2
1
2
2
1
2
Storage Spaces 1
12x SSDs
48x NLSAS
Storage Spaces 2
12x SSDs
48x NLSAS
SAS OUT
1
PowerVault MD3060e
1
2
SAS OUT
1
SSD
1
SSD
2
SSD
9
NLSAS
1
NLSAS
2
NLSAS
3
NLSAS
4
NLSAS
5
NLSAS
6
NLSAS
7
NLSAS
8
NLSAS
9
NLSAS
10
NLSAS
11
NLSAS
12
SSD
3
SSD
4
SSD
10
NLSAS
13
NLSAS
14
NLSAS
15
NLSAS
16
NLSAS
17
NLSAS
18
NLSAS
19
NLSAS
20
NLSAS
21
NLSAS
22
NLSAS
23
NLSAS
24
SSD
5
SSD
6
SSD
11
NLSAS
25
NLSAS
26
NLSAS
27
NLSAS
28
NLSAS
29
NLSAS
30
NLSAS
31
NLSAS
32
NLSAS
33
NLSAS
34
NLSAS
35
NLSAS
36
SSD
7
SSD
8
SSD
12
NLSAS
37
NLSAS
38
NLSAS
39
NLSAS
40
NLSAS
41
NLSAS
42
NLSAS
43
NLSAS
44
NLSAS
45
NLSAS
46
NLSAS
47
NLSAS
48
SSD
1
SSD
2
SSD
9
NLSAS
1
NLSAS
2
NLSAS
3
NLSAS
4
NLSAS
5
NLSAS
6
NLSAS
7
NLSAS
8
NLSAS
9
NLSAS
10
NLSAS
11
NLSAS
12
SSD
3
SSD
4
SSD
10
NLSAS
13
NLSAS
14
NLSAS
15
NLSAS
16
NLSAS
17
NLSAS
18
NLSAS
19
NLSAS
20
NLSAS
21
NLSAS
22
NLSAS
23
NLSAS
24
SSD
5
SSD
6
SSD
11
NLSAS
25
NLSAS
26
NLSAS
27
NLSAS
28
NLSAS
29
NLSAS
30
NLSAS
31
NLSAS
32
NLSAS
33
NLSAS
34
NLSAS
35
NLSAS
36
SSD
7
SSD
8
SSD
12
NLSAS
37
NLSAS
38
NLSAS
39
NLSAS
40
NLSAS
41
NLSAS
42
NLSAS
43
NLSAS
44
NLSAS
45
NLSAS
46
NLSAS
47
NLSAS
48
SSD
1
SSD
2
SSD
9
NLSAS
1
NLSAS
2
NLSAS
3
NLSAS
4
NLSAS
5
NLSAS
6
NLSAS
7
NLSAS
8
NLSAS
9
NLSAS
10
NLSAS
11
NLSAS
12
SSD
3
SSD
4
SSD
10
NLSAS
13
NLSAS
14
NLSAS
15
NLSAS
16
NLSAS
17
NLSAS
18
NLSAS
19
NLSAS
20
NLSAS
21
NLSAS
22
NLSAS
23
NLSAS
24
SSD
5
SSD
6
SSD
11
NLSAS
25
NLSAS
26
NLSAS
27
NLSAS
28
NLSAS
29
NLSAS
30
NLSAS
31
NLSAS
32
NLSAS
33
NLSAS
34
NLSAS
35
NLSAS
36
SSD
7
SSD
8
SSD
12
NLSAS
37
NLSAS
38
NLSAS
39
NLSAS
40
NLSAS
41
NLSAS
42
NLSAS
43
NLSAS
44
NLSAS
45
NLSAS
46
NLSAS
47
NLSAS
48
2
SAS IN
SAS IN
4 Ports
2
PowerVault MD3060e
1
6 Gbps SAS
1 Chassis enclosure per JBOD
48x SAS 4TB
SAS IN
SAS IN
DELL PowerVault MD3060e
Dual Path
12x SAS SSD 400/800 GB
SAS OUT
1
60-Bay JBOD
2
17
Q&A.