Transcript AWS services overview 101

AWS 101
Oron Adam
CTO
Emind Cloud Experts
Platform Breadth & Depth
A broad and deep platform helps
build sophisticated, scalable applications
Global deals
engine
Product prototyping
Hotel booking
engine
Video streaming
App streaming
SIM card credit
News
distribution
Firmware
upgrades
& design
Mobile music
discovery
Audience
management &
creative design
Biological
data research
Mobile games
AWS Rapid Pace of Innovation
Amazon EC2
Container Service
Since inception AWS has:
• Released 1111 new services and features
• Introduced over 40 major new services
• Announced 49 price reductions
AWS Lambda
AWS Service
Catalog
Amazon
AppStream
Amazon EC2
GovCloud
AWS Import
& Export
Amazon EC2
AWS Identity
& Access
Management
Amazon EBS
Amazon SNS
2008
2009
Amazon
CloudSearch
Amazon Elastic
Transcoder
Amazon Kinesis
Amazon
Dynamo DB
AWS OpsWorks
Elastic Load
Balancing
AWS Direct
Connect
Amazon Glacier
Auto Scaling
AWS Elastic
Beanstalk
Amazon
CloudHSM
Amazon Redshift
Amazon RDS
AWS
CloudFormation
Amazon
CloudTrail
Amazon Route 53
Amazon EMR
Amazon
ElastiCache
Amazon
CloudWatch
AWS Storage
Gateway
Amazon SES
Amazon SWF
Amazon VPC
2010
2011
2012
AWS Config
AWS CodeDeploy
AWS CodeCommit
AWS CodePipeline
AWS Key
Management Service
Amazon RDS
for Aurora
Amazon Cognito
Amazon Mobile
Analytics
AWS Data
Pipeline
AWS Zocalo
Amazon
WorkSpaces
AWS Directory
Service
2013
2014
TECHNICAL &
BUSINESS
SUPPORT
Support
AWS
MARKETPLACE
Big Data
& HPC
MANAGEMENT
TOOLS
PLATFORM
SERVICES
Analytics
Business
Apps
Security
Containers
Hadoop
Identity
Source
Code
Functions
Streaming
Push
Notifications
Build
Tools
Identity
Data
Pipelines
Mobile
Analytics
Deploymen
t
Data Store
Machine
Learning
Mobile
Backend
DevOps
Real-time
HYBRID CLOUD
MANAGEMENT
Virtual
Desktops
Direct
Connect
Sharing &
Collaboration
Identity
Federation
Email &
Calendaring
Deployment
Directories
Backups
Storage
Gateway
Integrated
Management
Development
Email
Account
Management
Backup
Solutions
Architects
Databases
Security
& Pricing
Reports
Mobile
& Web
Front-end
Notifications
Orchestration
Training &
Certification
App
Sync
Search
Partner
Ecosystem
Development
Queuing
Data
Warehousing
Professional
Services
Mobile
ENTERPRISE
APPS
SECURITY &
MANAGEMENT
Virtual Private
Networks
Identity &
Access
Encryption
Keys
Configuration
Monitoring
Dedicated
INFRASTRUCTURE
SERVICES
Industry
Solutions
Storage
Regions
Availability
Zones
Compute
O b j e c t s
,
B l o c k s ,
F i l e s
Databases
SQL, NoSQL,
Caching
Networking
CDN
Compute
and Networking
Amazon EC2
(Amazon Elastic Compute Cloud)
Virtual servers in the Amazon Cloud
Amazon EC2
Virtual servers
hosted in the
Amazon Cloud
Scale up or down
quickly, as needed
Pay for what
you use
Familiar operating
systems
Amazon EC2 is Easy to Use
Root access control
Ability to stop or re-start remotely
Easy to use console and API’s
Mobile access
Amazon EC2 is Elastic
Automatically scale servers up or down
Simplify operations
Improve resiliency
Run applications securely
Run any application globally
Reduce costs
Amazon EC2 is Reliable
Easily build highly available applications
Use multiple Availability Zones (AZs)
AWS Elastic Load Balancing distributes load
Auto Scaling helps ensure availability and scale
6
Instance Count
5
4
3
2
1
0
0
1
2
3
4
5
6
7
8
9
10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Day of Month
6
Instance Count
5
4
3
2
1
Elastic Capacity
0
0
1
2
3
4
5
6
7
8
9
10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Day of Month
6
Instance Count
5
4
75% Savings
3
2
1
Elastic Capacity
0
0
1
2
3
4
5
6
7
8
9
10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Day of Month
Amazon EC2 is Secure and Compliant
Secure access
Dedicated connection option
Unique users
Perfect Forward Secrecy
Multi-factor authentication
Security logs
Private Subnets
Centralized key management
Encrypted data storage
Amazon EC2 is Cost Effective
Low cost computing capacity
Pay as you go pricing
Flexible pricing models
Amazon EC2 is Feature Rich
AWS Marketplace AMI’s
Ecosystem of partners and ISV’s
Familiar Operating Systems
3rd party integration
Analytics, deployment and enterprise applications services
Amazon EC2 is Flexible
Operating systems
Languages and Libraries
Storage options
Instance types
Amazon EC2 Instance Types
Instances to suit your application needs
Micro
Storage Optimized
General Purpose
GPU Optimized
Compute Optimized
Memory Optimized
Amazon VPC
(Amazon Virtual Private Cloud)
Isolated Cloud Resources
Amazon Virtual Private Cloud (VPC)
Provision a logically isolated section of the AWS cloud
Control your virtual networking environment
•
•
•
•
Subnets
Route Tables
Security Groups
Network ACLs
Connect to your on-premises network via hardware VPN
Control if and how your instances access the Internet
Internet
Internet Gateway
VPC Subnet
10.0.0.5
VPC Subnet
VPC Subnet
10.0.1.5
10.0.1.6
10.0.3.5
10.0.0.6
10.0.1.25
10.0.1.8
10.0.3.17
Virtual Private Gateway
Availability Zone 1a
VPN Connection
Customer
Data
Center
Customer Gateway
Availability Zone 1b
Amazon EC2 Container Service
Run and Manage Docker Containers
Amazon EC2 Container Service
Run Docker containers in EC2 cluster
API controlled
Support Images from private Docker repositories
Compatible with other services and features, security
groups,
Amazon Elastic Beanstalk
Run and Manage Web Apps
Amazon Elastic Beanstalk
Deploy and scale web applications easily
Languages: Java, .NET, PHP, Node.js, Python, Ruby, Docker
Servers: Apache, Nginx, Phusion Passenger, IIS
Simply upload your code; AWS handles:
Deployment
Auto scaling
Capacity Provisioning
Health Monitoring
Load balancing
Amazon Lambda
Run Code in Response to Events
Amazon Lambda: Event-Driven Compute
Runs stateless, request-driven code called Lambda functions: NodeJS Java &
Python (new)
Triggered by events (state transitions) in other AWS services
Pay only for the requests served and the compute time
Focus on business logic, not infrastructure.
Just upload your code; AWS Lambda handles:
Capacity
Monitoring
Scaling
Logging
Deployment
Web service front end
Fault tolerance
Security patching
Storage
AWS Storage Options
Scalable Object Storage
Inexpensive archive storage
Persistent Block Storage
Turn-key gateway solution
Amazon S3
Simple Storage Service
Amazon S3
Object storage
Store anything: 1 byte – 5 TB in size
Scalable
Performance
99.999999999% durability
Infrequent Access option
Amazon S3: buckets and objects
Amazon S3: hosting static content for a website
Amazon Glacier
Archive Storage in the Cloud
Amazon Glacier
Archive storage and backup
Secure and durable: 99.999999999% durability
Infrequent access
Retrieval time: 3-5 hours
Extremely low cost – 0.01$ per GB/month – 120$ per TB/year
Amazon EBS
Persistent Block Storage
Amazon EBS
Persistent Block Storage for Amazon EC2
Reliable: Automatically replicated within its Availability Zone
Secure: Encryption
Scalable: Easy to change the size
Performance: depending on the volume type
Snapshots to S3: Easy backup
Amazon EBS: Volume types
Price
Performance
Latency
Business impact
Magnetic
General Purpose
Provisioned IOPS
Use Cases
Infrequent data access
Boot volumes
Small to Med DBs
Dev and Test
I/O intensive
Relational DBs
NoSQL DBs
Storage Media
Magnetic disk-backed
SSD-backed
SSD-backed
Performance
100 IOPS on average.
Ability to burst to
hundreds of IOPS
Burst to 3,000 IOPS
maximum, with a base
performance of 3 IOPS/GiB
Consistently performs at
provisioned level, 4000
IOPS maximum
$.05/GB - Month
$.05/million I/O
$.10/GB – Month
$.125/GB - Month
$.065/provisioned IOPS
Price
Amazon Storage Gateway
Integrates On-Premises IT Environments with Cloud Storage
Amazon Storage Gateway
Your on-ramp to AWS cloud storage:
• Backup into Amazon S3
• DR on Amazon EC2
• Archive into Amazon Glacier
• Frequently access data on-premises
• iSCSI based block storage
Database
AWS Database Options
1. Self-Managed in Amazon
EC2
2. Use one of our Managed DB
Services
Why managed database
services?
If you host your databases on-premises
App optimization
Scaling
High availability
Database backups
DB s/w patches
DB s/w installs
OS patches
OS installation
Server maintenance
Rack & stack
Power, HVAC, net
you
If you host your databases on-premises
App optimization
Scaling
High availability
Database backups
DB s/w patches
DB s/w installs
OS patches
OS installation
Server maintenance
Rack & stack
Power, HVAC, net
you
If you host your databases in Amazon EC2
App optimization
Scaling
High availability
Database backups
DB s/w patches
DB s/w installs
OS patches
you
OS installation
Server maintenance
Rack & stack
Power, HVAC, net
If you host your databases in
Amazon EC2
App optimization
Scaling
High availability
Database backups
DB s/w patches
DB s/w installs
OS patches
you
OS installation
Server maintenance
Rack & stack
Power, HVAC, net
If you choose a managed DB service
Scaling
High availability
Database backups
DB s/w patches
DB s/w installs
OS patches
OS installation
Server maintenance
Rack & stack
App optimization
you
Power, HVAC, net
The self-managed vs. AWS-managed decision
Self-managed database
AWS-managed database
You have full responsibility for
upgrades and backup
AWS provides upgrades, backup, and
failover as a service
You have full responsibility for security
AWS provides high infrastructure
security, certifications; gives you tools
to ensure DB security
Full control over parameters of server,
OS, and database
Database is a managed appliance, so
you can easily automate
Replication is expensive, complex,
and requires a lot of engineering
AWS provides failover as a packaged
service
A managed service for each major DB type
Amazon
DynamoDB
Amazon
RDS
Amazon
ElastiCache
Amazon
Redshift
Document
and keyvalue store
SQL
database
engines
In-memory
cache
Data
warehouse
Amazon DynamoDB
Predictable and Scalable NoSQL Data Store
Amazon DynamoDB
NoSQL Database
Document and key-value store
Fast, consistent performance: Single digit millisecond latency
Seamless scalability
Zero administration
Amazon RDS
Managed Relational Database Service
Amazon RDS
Simple and fast to deploy
• Simple and fast to scale
• AWS handles patching, backups, replication
Compatible with your applications
• Choose among MySQL, PostgreSQL,
Oracle, SQL Server, Aurora, MariaDB (new)
Fast, predictable performance
No cost to get started; pay only for what you consume
Amazon Elasticache
In-Memory Cache
Amazon Elasticache
Improve performance of applications
Speed your application by bypassing database access and
disk storage
Supports two engines:
• Memcached
• Redis
Amazon Redshift
In-Memory Cache
Amazon Redshift
Columnar Relational data warehouse
Massively parallel
Petabyte scale
$1,000/TB/year
Use existing BI tools
based on PostgreSQL 8.0.2
Analytics
Amazon EMR
(Amazon Elastic MapReduce)
Managed Hadoop Framework
Amazon EMR
Hadoop/HDFS or Spark clusters
Hive, Pig, Impala, HBase
Easy to use; fully managed
On-demand and spot pricing
Tight integration with S3, DynamoDB, and Kinesis
Amazon Kinesis
Real-time Processing of Streaming Big Data
Amazon Kinesis
Real-time processing
High throughput; elastic
Easy to use
EMR, S3, Redshift, DynamoDB Integrations
Amazon Machine Learning
Build Smart Applications Quickly and Easily
Amazon Machine Learning
Easy to use, managed machine learning
service built for developers
Robust, powerful machine learning
technology based on Amazon’s internal
systems
Create models using your data already
stored in the AWS cloud
Deploy models to production in seconds
And lots of other Services (I)
And lots of other Services (II)
Example 3-tier Web App architecture
Questions?
Oron Adam - @oronoa