Transcript Trove Intro - OpenStack Toronto - March 30 2016

Intro to OpenStack Trove &
Database as a Service
OpenStack Toronto Meetup
Doug Shelley, VP Product Development, Tesora
March 30, 2016
A word about our sponsors
•
•
•
Tesora, the Trove company
Leading contributor to Trove
Makers of Tesora “DBaaS Platform”
–
–
–
–
•
Enterprise product based on Trove
Additional capabilities
Additional datastores
Support and Services
Located in Boston and Toronto
– We’re hiring
3/30/2016
Intro to OpenStack Trove & DBaaS
OpenStack Toronto Meetup
2
Today’s Database Challenges
“I need a NoSQL DB
for my app to scale”
“I need my environment
NOW”
“I have to release it
next month or else”
“I only need it for
a couple of weeks”
“I’ll just use AWS”
Developer
3/30/2016
“I just don’t
understand these
developers...”
Intro to OpenStack Trove & DBaaS –
OpenStack Toronto Meetup
IT Guy
3
Today’s Database Challenges
“These Ops guys
don’t get it...”
“My budget
and team aren’t getting
any bigger”
“Why can’t they
just use Oracle?”
“We need time to
do it right”
Developer
3/30/2016
“We have no idea what
they are putting on the
public cloud”
“I know that
they are putting our
customer data at risk”
IT Guy
Intro to OpenStack Trove & DBaaS –
OpenStack Toronto Meetup
4
Transformation of Cloud Data Management
Traditional IT
Cloud
•
•
•
Provisioning by admins
Database management by
specialists
Waterfall development
Few large machines /
bare metal
Oracle Enterprise licenses
•
Captive audience
•
•
•
•
•
3/30/2016
•
•
•
Self Service Provisioning
Developers manage their own
databases
Agile development
Many small machines /
virtualization
Many data management
technologies
Competition with AWS
Intro to OpenStack Trove & DBaaS
OpenStack Toronto Meetup
5
The Solution: Database as a Service
•
The delivery of database software &
related storage “as-a-service”
•
Available on-demand, without any
hardware or software installation
or configuration
•
A fully managed service maintained &
administered by the service provider
3/30/2016
Intro to OpenStack Trove & DBaaS
OpenStack Toronto Meetup
6
Amazon is demonstrating the importance of DBaaS
•
DynamoDB was the fastest growing service in AWS history in 2012
– Werner Vogels, Amazon CTO, AWS Blog June 2012
•
Redshift is now the fastest growing AWS service ever
– Werner Vogels, Amazon CTO, The Register, April 2015
•
45% of Amazon customers have implemented and are expanding use of RDS
– Jeffrey Hammond, Forrester Blog, September 2013
•
AWS database business currently on a $1 billion revenue run rate
– Andy Jassy, the SVP of AWS - TechCrunch, October 2015
•
Amazon’s #1 hiring focus – 84 open positions in DBaaS in November 2015
– Deutsche Bank Markets Research - NetworkWorld, November 2015
3/30/2016
Intro to OpenStack Trove & DBaaS –
OpenStack Toronto Meetup
7
What is Trove? RDS for OpenStack
…and DynamoDB …and RedShift
Amazon AWS
DynamoDB
RedShift
OpenStack
NoSQL
RDS
EC2
…
3/30/2016
Trove
…and API’s
for DevOPs
DW
RDBMS
S3
Nova
…
EBS
Intro to OpenStack Trove & DBaaS
OpenStack Toronto Meetup
Swift
Cinder
8
OpenStack Trove Mission Statement
The OpenStack Open Source Database as a Service Mission:
To provide scalable and reliable Cloud Database as a Service
provisioning functionality for both relational and nonrelational database engines, and to continue to improve its
fully-featured and extensible open source framework.
https://wiki.openstack.org/wiki/Trove
3/30/2016
Intro to OpenStack Trove & DBaaS –
OpenStack Toronto Meetup
9
What is OpenStack Trove?
•
Provisioning
– Launching a new database instance
•
Complex Database Topologies
– Clustering, Replication
•
Automation
– Backup & Restore, Failover, Resizing, Cluster Scaling
•
Multiple Database Technologies, Common API’s
– Relational, Non-Relational, … (mostly FOSS)
•
Management Interface
– CLI, REST API, Web based UI
3/30/2016
Intro to OpenStack Trove & DBaaS –
OpenStack Toronto Meetup
10
Complete Database Lifecycle Management
Provision
Secure
• On demand
• Wide DB selection
• Clusters & single
instances
• Users/permissions
• Restricted root access
Manage
Tune
• Manage schemas
• Create replicas for
scale & availability
• Backup/restore
• Manage log files
• API’s to tune fleets of servers,
not just single instances
• Sane defaults
3/30/2016
Intro to OpenStack Trove & DBaaS
OpenStack Toronto Meetup
11
The Trove Architecture
Trove API
Trove Guest Agent
Application
Database
Software
Storage
Swift
Operating System
Nova
Nova Instance
Cinder
Trove Guest Agent
Database Software
Operating System
Guest Image
Glance Storage
3/30/2016
Trove Task Manager
Keystone
Neutron
Trove Conductor
Glance
Trove
Intro to OpenStack Trove & DBaaS –
OpenStack Toronto Meetup
12
The data plane and the management plane
3/30/2016
Intro to OpenStack Trove & DBaaS –
OpenStack Toronto Meetup
13
Trove Multi-Datastore Architecture
Datastore-agnostic code in Trove
Controller and Dashboard
Datastore specific code isolated
to guest agents
Guest Agent
Guest Agent
Guest Agent
Guest
Agent
Guest
Agent
Guest
Agent
Guest Agent
Guest Agent
Guest Agent
API
Task
Manager
Trove
Dashboard
(Horizon)
3/30/2016
Conductor
Trove
Controller
Intro to OpenStack Trove & DBaaS
OpenStack Toronto Meetup
14
Multi-database – support for 13 different databases
SQL
3/30/2016
NoSQL
Intro to OpenStack Trove & DBaaS
OpenStack Toronto Meetup
15
What’s new in Mitaka
•
•
•
•
•
•
•
•
•
3/30/2016
Cassandra clustering, backup & restore, configuration groups, user
functions
CouchDB backup and restore, user functions
DB2 backup and restore
Improvements to Mongo Cluster grow/shrink support
Extend MySQL replication to include MariaDB GTID replication
Percona XtraDB Cluster grow/shrink support, root enable
Vertica configuration groups, cluster grow/shrink
Improved Ceilometer notifications
Bug fixes
Intro to OpenStack Trove & DBaaS –
OpenStack Toronto Meetup
16
What’s on deck for Newton
• Here are some projects currently under consideration
–
–
–
–
–
–
–
Guest upgrade support
Support for anti-affinity of replica/cluster nodes
Extend persistent storage to include more than Cinder/Ephemeral
Python 3 support
Management client for Trove, use the OpenStack client
Filter available volume types by datastore
Guest improvements
• Incremental backup, streaming replication for PostgreSQL
• Clustering for Couchbase
3/30/2016
Intro to OpenStack Trove & DBaaS –
OpenStack Toronto Meetup
17
Let’s see a demo…
3/30/2016
Intro to OpenStack Trove & DBaaS –
OpenStack Toronto Meetup
18
Learn More about Trove
•
•
•
Trove Wiki – https://wiki.openstack.org/wiki/Trove
Trove Source – https://git.openstack.org/cgit/openstack/trove
On IRC - #openstack-trove
•
Getting Started Videos – http://tesora.com/videos/
•
•
Download Tesora Platform - http://tesora.com/downloads
Contact information
Trove Day
– http://tesora.com/troveday
– http://slideshare.net/tesoracorp
•
3/30/2016
LinkedIn - OpenStack Trove Group
Contact Tesora
[email protected]
www.tesora.com
@tesoracorp
Intro to OpenStack Trove & DBaaS –
OpenStack Toronto Meetup
Contact Doug
[email protected]
www.tesora.com
@dougshelley66
IRC: dougshelley66
19
OpenStack East – August 23-24 - New York City
•
•
•
Official OpenStack event
Community-driven
Focus on enterprise users
• Retail
• Financial services
• Telecom
More at OpenStackEast.com
3/30/2016
Intro to OpenStack Trove & DBaaS –
OpenStack Toronto Meetup
20