411_-_Scaling_out_SSAS_-_Cambridge.ppsx

Download Report

Transcript 411_-_Scaling_out_SSAS_-_Cambridge.ppsx

Stick around for SWAG! (Prize drawing at 5.00 p.m)
 All our volunteers and organisers do not get paid for running SPS SQLSaturday Cambridge
and do it because they believe in the power of community (or are just plain nuts).
Please show your gratitude for making this possible by:
 Giving them a hug
 Shaking their hand
 Saying thank you
 Coming back next year
 Consider getting your company to pay for a precon next year
 Speading the word
 Getting involved yourself
 But most of all, by enjoying the day!
 Don’t forget to thank the sponsors for their support
 Thank the speakers for donating their time, energy and expenses
SQLCloud — XBox One!!! (make sure you know how to play the Jet Set Willy vendor competition!)
SQLCloud—Dark Side Of The Moon, The Wall and Wish You Were Here
Microsoft — MCP Voucher
Data Idols — Supercar Driving Experience
Profisee — Signed MDS Book and £50 Amazon Voucher
SQLSentry — Plan Explorer PRO License
Pyramid Analytics—Coffee Machine
Effektor — Lego Big Ben
Rencore — SPCAF Professional License (valued at $2099!)
Axioworks — Amazon Fire TV and £75 Amazon Voucher
DELL — Beats by Dr Dre Headphones
Redgate — DLM Workshop
Pluralsight — Annual Plus subscriptions
All Your Base Conference — 3 x Conference Tickets
VisualSP—Annual training subscription
Loads of books and much much more!!!
 WHAT
 INTRODUCTION
 FROM THE TRENCHES
 SETUP
 WHAT’S NEXT
 INFRASTRUCTURE
 PLATFORM
 FROM THE TRENCHES
 Q&A
 Jens Vestergaard
 Maersk Line IT – MSBI – Engineering
 @vestergaardj
 http://www.t-sql.dk / [email protected]
 $5.200.000.000 GROUP PROFIT 2014 – One Pink Floyd song comes to mind…
 3.000.000 CONTAINERS
 300.000 REFRIGURATED (REEFERS)
 25.000 LAND BASED EMPL.
 7.000 AT SEA
 600 VESSELS (20 TRIPPLE-E’S) (11 EVEN BIGGER ONES TO COME)
 90+ COUNTRIES
 1 BI/MDM DEPARTMENT
 PLAN
 BUILD
 RUN
 DEV -> TEST -> PREPROD -> PROD
 <IMAGINE SOUND OF RECORD NEEDLE SCRATCHING>
 MSBI = (DEV/TEST) + (DEV/PROD) + (ADL+PREPROD)
 TODAY (AND FOR THE LAST 3,5 YRS)
 SSIS 2008 R2
 SSRS 2008 R2
 SSAS 2012
 SHAREPOINT 2010
 TFS 2010
 290 GB SINGLE PROJECT
 40 GB NEXT SIGNIFICANT PROJECT
 1 X LOAD BALANCER (F5)
 2 X 2 WEB APPLICATION
 2 X 2 SHAREPOINT APPLICATION
 1 X ASLB (CODEPLEX)
 4 X SSAS QUERY
 3 X SSAS PROCESSING
 1 X SQL AGENT/SSIS
 1 x TEAM FOUNDATION SERVER
 WHAT did we try?
 Classic Setup
 SAN Read-Only
 A read-only LUN can be shared between multiple servers, and hence enables you to use more than
query server on the same physical disk.
 Dedicated Processing Architecture
 WHAT did we NOT do?
 Client Load Balancing – Every Client Connects to a Specific Target Query Server
 Query/Processing Flipping Architecture
 Say What one more Time…
Ref: https://anoopsihag.wordpress.com/2012/01/21/analysis-services-scale-out-processing-architecture/
Ref: https://anoopsihag.wordpress.com/2012/01/21/analysis-services-scale-out-processing-architecture/
 Initial requirement was to add redundnacy to SPOF
 Improved initial active / passive setup to active / active
 Better use of hardware
 Scale-out enabled
 Two possible solutions
 Hardware load bancing (F5)
 Software load balancing (ASLB)
 Opted for software load balancing
 Based on ASLB from Microsoft (SQL CAT team). Open source.
 Pros
 Flexibility. Configuration per solution.
 Control. Software load balancing based on metadata.
 We can build a configuration interface – and we have
 Cons
 Known issue with PerformancePoint where we see intermittent errors. Have not
troubleshooted this yet.
 Complex kerberos delegation paths
 HTTP connector. Some overhead when moving large amounts of data
 Web front-ends
 Connection strings point here.
 E.g. http://msbi-preprod-as.apmoller.net/FBR_ProfitAndLoss
 Web front-ends are actually load balanced, but only for redundancy (active / passive)
 Analysis Services
 Each instance has the HTTP connector configured
 Meta data
 Web front-end checks meta data and HTTP redirects user
 Round robin and observing”enabled / disabled” (server or database), server avail and CPU load
 SQL Agent jobs validate server availability and CPU load and updates meta tables
 Deploy new database
 Done by updating the meta data in the ASLB database
 When a new entry has been added to dbo.Databases
 http://msb-preprod-as.apmoller.net/<<name from
ASLB.dbo.Databases>>
 http://msb-preprod-as.apmoller.net/<<name from
ASLB.dbo.Databases>>
 Enable / disable a database
 Done from SharePoint web interface.
 Operations Manager
 Orchestrator
 Virtual Machine Manager
 Advocating Hardware Load Balancing
https://twitter.com/Gavin592/status/539524567098982400
&
 BLOG: https://anoopsihag.wordpress.com/2012/01/21/analysis-services-scale-out-
processing-architecture/
 ASLB: http://www.microsoft.com/en-us/download/details.aspx?id=10556
 MSDMPUMP: https://msdn.microsoft.com/en-us/library/gg492140.aspx
 SYNC: https://msdn.microsoft.com/en-us/library/ms174928.aspx
 SCOM: http://www.microsoft.com/en-us/server-cloud/products/system-center-
2012-r2/Components.aspx