AW S A c a d e m y C l o u d F o u n d a t i o n s
Module 7: Storage
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Module overview
Topics Demos
• Amazon Elastic Block Store (Amazon • Amazon EBS console
EBS) • Amazon S3 console
• Amazon Simple Storage Service • Amazon EFS console
(Amazon S3)
• Amazon S3 Glacier console
• Amazon Elastic File System (Amazon
EFS) Lab
• Amazon Simple Storage Service Glacier • Working with Amazon EBS
Activities
• Storage solution case study
Knowledge check
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 2
Module objectives
After completing this module, you should be able to:
• Identify the different types of storage
• Explain Amazon S3
• Identify the functionality in Amazon S3
• Explain Amazon EBS
• Identify the functionality in Amazon EBS
• Perform functions in Amazon EBS to build an Amazon EC2 storage solution
• Explain Amazon EFS
• Identify the functionality in Amazon EFS
• Explain Amazon S3 Glacier
• Identify the functionality in Amazon S3 Glacier
• Differentiate between Amazon EBS, Amazon S3, Amazon EFS, and Amazon S3 Glacier
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 3
Core AWS services
Amazon S3 Amazon
EBS
Amazon Amazon S3
EFS Glacier
Amazon Virtual Amazon Elastic AWS Identity and
Private Cloud Compute Cloud Storage Access Management
(Amazon VPC) (Amazon EC2) (IAM)
Amazon Relational Amazon
Database Service DynamoDB
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Database 4
Module 7: Storage
Section 1: Amazon Elastic Block Store (Amazon EBS)
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Storage
Amazon Elastic Block Store
(Amazon EBS)
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 6
AWS storage options: Block storage versus
object storage
What if you want to change one character in a 1-GB file?
Block storage Object storage
Change one block (piece of the file) Entire file must be updated
that contains the character
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 7
Amazon EBS
Amazon EBS enables you to create individual storage volumes and attach
them to an Amazon EC2 instance:
• Amazon EBS offers block-level storage.
• Volumes are automatically replicated within its Availability Zone.
• It can be backed up automatically to Amazon S3 through snapshots.
• Uses include –
• Boot volumes and storage for Amazon Elastic Compute Cloud (Amazon EC2)
instances
• Data storage with a file system
• Database hosts
• Enterprise applications
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 8
Amazon EBS volume types
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 9
Amazon EBS volume type use cases
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 10
Amazon EBS features
• Snapshots –
• Point-in-time snapshots
• Recreate a new volume at any time
• Encryption –
• Encrypted Amazon EBS volumes
• No additional cost
• Elasticity –
• Increase capacity
• Change to different types
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 11
Amazon EBS: Volumes, IOPS, and pricing
1. Volumes –
• Amazon EBS volumes persist independently from the instance.
• All volume types are charged by the amount that is provisioned per month.
2. IOPS –
• General Purpose SSD:
• Charged by the amount that you provision in GB per month until storage is released.
• Magnetic:
• Charged by the number of requests to the volume.
• Provisioned IOPS SSD:
• Charged by the amount that you provision in IOPS (multiplied by the percentage of
days that you provision for the month).
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 12
Amazon EBS: Snapshots and data transfer
3. Snapshots –
• Added cost of Amazon EBS snapshots to Amazon S3 is per GB-month
of data stored.
4. Data transfer –
• Inbound data transfer is free.
• Outbound data transfer across Regions incurs charges.
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 13
Amazon EBS features:
Section 1 key
• Persistent and customizable block
takeaways storage for Amazon EC2
• HDD and SSD types
• Replicated in the same Availability
Zone
• Easy and transparent encryption
• Elastic volumes
• Back up by using snapshots
14 © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Recorded demo:
Amazon Elastic
Block Store
15 © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Lab 4:
Working with
Amazon EBS
16 © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Lab 4: Scenario
This lab is designed to show you how to create an Amazon EBS volume.
After you create the volume, you will attach the volume to an Amazon EC2
instance, configure the instance to use a virtual disk, create a snapshot and
then restore from the snapshot.
Attached Created
Amazon Amazon Snapshot
EC2 EBS
instance
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 17
Lab 4: Final product
Attached Created
Amazon Amazon Snapshot
EC2 EBS
instance
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 18
Lab 4: Working with Amazon EBS
~ 30 minutes
Begin Lab 4: Working
with Amazon EBS
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 19
Lab debrief:
Key takeaways
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 20
Module 7: Storage
Section 2: Amazon Simple Storage Service
(Amazon S3)
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Storage
Amazon Simple Storage Service
(Amazon S3)
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 22
Amazon S3 overview
• Data is stored as objects in buckets
• Virtually unlimited storage
• Single object is limited to 5 TB
• Designed for 11 9s of durability
• Granular access to bucket and objects
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 23
Amazon S3 storage classes
Amazon S3 offers a range of object-level storage classes that are
designed for different use cases:
• Amazon S3 Standard
• Amazon S3 Intelligent-Tiering
• Amazon S3 Standard-Infrequent Access (Amazon S3 Standard-IA)
• Amazon S3 One Zone-Infrequent Access (Amazon S3 One Zone-IA)
• Amazon S3 Glacier
• Amazon S3 Glacier Deep Archive
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 24
Amazon S3 bucket URLs (two styles)
Amazon S3
To upload your data:
1. Create a bucket in an AWS Region.
2. Upload almost any number of objects to the bucket.
Bucket path-style URL endpoint:
[bucket name] [Link]
Region code Bucket name
Bucket virtual hosted-style URL endpoint:
Preview2.mp4 https:// [Link]
Tokyo Region (ap-
northeast-1) Bucket name Region code
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 25
Data is redundantly stored in the Region
media/welcome.mp4
Facility 1 Facility 2 Facility 3
my-bucket-name
Region
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 26
Designed for seamless scaling
media/welcome.mp4 prod2.mp4 prod3.mp4 prod4.mp4
prod5.mp4 prod6.mp4 prod7.mp4 prod8.mp4
my-bucket-name
prod9.mp4 prod10.mp4 prod11.mp4 prod12.mp4
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 27
Access the data anywhere
AWS Management
AWS Command Line SDK
Console
Interface
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 28
Common use cases
• Storing application assets
• Static web hosting
• Backup and disaster recovery (DR)
• Staging area for big data
• Many more….
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 29
Amazon S3 common scenarios
• Backup and storage
• Application hosting
• Media hosting Amazon S3 buckets
• Software delivery
Corporate
data center
Amazon
EC2
instances
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 30
Amazon S3 pricing
• Pay only for what you use, including –
• GBs per month
• Transfer OUT to other Regions
• PUT, COPY, POST, LIST, and GET requests
• You do not pay for –
• Transfers IN to Amazon S3
• Transfers OUT from Amazon S3 to Amazon CloudFront or Amazon EC2 in the
same Region
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 31
Amazon S3: Storage pricing
To estimate Amazon S3 costs, consider the following:
1. Storage class type –
• Standard storage is designed for:
• 11 9s of durability
• Four 9s of availability
• S3 Standard-Infrequent Access (S-IA) is designed for:
• 11 9s of durability
• Three 9s of availability
2. Amount of storage –
• The number and size of objects
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 32
Amazon S3: Storage pricing
3. Requests –
• The number and type of requests (GET, PUT, COPY)
• Type of requests:
• Different rates for GET requests than other requests.
4. Data transfer –
• Pricing is based on the amount of data that is transferred out of the
Amazon S3 Region
• Data transfer in is free, but you incur charges for data that is transferred out.
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 33
• Amazon S3 is a fully managed cloud
Section 2 key storage service.
takeaways • You can store a virtually unlimited
number of objects.
• You pay for only what you use.
• You can access Amazon S3 at any
time from anywhere through a URL.
• Amazon S3 offers rich security
controls.
34 © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Recorded demo:
Amazon Simple
Storage System
35 © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Module 7: Storage
Section 3: Amazon Elastic File System (Amazon EFS)
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Storage
Amazon Elastic File
System (Amazon EFS)
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 37
Amazon EFS features
• File storage in the AWS Cloud
• Works well for big data and analytics, media processing workflows,
content management, web serving, and home directories
• Petabyte-scale, low-latency file system
• Shared storage
• Elastic capacity
• Supports Network File System (NFS) versions 4.0 and 4.1 (NFSv4)
• Compatible with all Linux-based AMIs for Amazon EC2
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 38
Amazon EFS architecture
VPC
Availability Zone A Availability Zone B Availability Zone C
Private subnet Private subnet Private subnet
Network Network Network
Interface Interface Interface
Private subnet
Network Network
Network
Interface Interface
Interface
Mount target Mount target Mount target
Elastic File System
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 39
Amazon EFS implementation
1 Create your Amazon EC2 resources and launch your Amazon EC2 instance.
2 Create your Amazon EFS file system.
3 Create your mount targets in the appropriate subnets.
4 Connect your Amazon EC2 instances to the mount targets.
5 Verify the resources and protection of your AWS account.
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 40
Amazon EFS resources
File system
• Mount target
• Subnet ID
• Security groups
• One or more per file system
• Create in a VPC subnet
• One per Availability Zone
• Must be in the same VPC
• Tags
• Key-value pairs
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 41
• Amazon EFS provides file storage over a
Section 3 key network.
takeaways • Perfect for big data and analytics, media
processing workflows, content
management, web serving, and home
directories.
• Fully managed service that eliminates
storage administration tasks.
• Accessible from the console, an API, or the
CLI.
• Scales up or down as files are added or
removed and you pay for what you use.
42 © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Recorded demo:
Amazon Elastic File
System
43 © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Module 7: Storage
Section 4: Amazon S3 Glacier
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Storage
Amazon S3 Glacier
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 45
Amazon S3 Glacier review
Amazon S3 Glacier is a data archiving service that is designed for security,
durability, and an extremely low cost.
• Amazon S3 Glacier is designed to provide 11 9s of durability for objects.
• It supports the encryption of data in transit and at rest through Secure Sockets Layer
(SSL) or Transport Layer Security (TLS).
• The Vault Lock feature enforces compliance through a policy.
• Extremely low-cost design works well for long-term archiving.
• Provides three options for access to archives—expedited, standard, and bulk—retrieval
times range from a few minutes to several hours.
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 46
Amazon S3 Glacier
• Storage service for low-cost data
archiving and long-term backup
• You can configure lifecycle archiving
Archive after Delete after 5
of Amazon S3 content to Amazon S3 30 days years
Glacier
• Retrieval options – Amazon Amazon S3
S3 bucket Glacier
• Standard: 3–5 hours Archive
• Bulk: 5–12 hours
• Expedited: 1–5 minutes
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 47
Amazon S3 Glacier use cases
Media asset archiving
Healthcare information archiving
Regulatory and compliance archiving
Scientific data archiving
Digital preservation
Magnetic tape replacement
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 48
Using Amazon S3 Glacier
RESTful
web services
Java or .NET
SDKs
Amazon S3 with
lifecycle policies
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 49
Lifecycle policies
Amazon S3 lifecycle policies enable you to delete or move objects based on
age.
Amazon S3 Amazon S3 Amazon Delete
Standard Standard - S3 Glacier
Infrequent
Access
30 days 60 days 365 days
Preview2.mp4 Preview2.mp4 Preview2.mp4
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 50
Storage comparison
Amazon S3 Amazon S3 Glacier
Data Volume No limit No limit
Average Latency ms minutes/hours
Item Size 5 TB maximum 40 TB maximum
Cost/GB per Month Higher cost Lower cost
PUT, COPY, POST,
Billed Requests UPLOAD and retrieval
LIST, and GET
¢ ¢¢
Retrieval Pricing
Per request Per request and per GB
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 51
Server-side encryption
Corporate AWS Cloud
data center
https Your Applications on
Amazon EC2 Amazon EC2
AWS Cloud
Data is encrypted Your application must
by default enable server-side encryption
Amazon S3 Glacier Amazon S3
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 52
Security with Amazon S3 Glacier
Control access with
IAM
Amazon S3 Glacier
encrypts your data with
AES-256
Amazon S3
Glacier
Amazon S3 Glacier
manages your keys for you
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 53
• Amazon S3 Glacier is a data
Section 4 key archiving service that is designed for
takeaways security, durability, and an extremely
low cost.
• Amazon S3 Glacier pricing is based
on Region.
• Its extremely low-cost design works
well for long-term archiving.
• The service is designed to provide 11
9s of durability for objects.
54 © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Recorded demo:
Amazon S3 Glacier
55 © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Activity: Storage Case
Studies
Photo by Pixabay from Pexels.
Photo by panumas nikhomkhai from Pexels.
56 © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Storage case study activity
Case 1: A data analytics company for travel sites must store billions of customer events per day. They use the
data analytics services that are in the diagram. The following diagram illustrates their architecture.
Amazon API Gateway Amazon Kinesis AWS Lambda
Amazon Kinesis
Data Firehose
Amazon Elastic Container Amazon Kinesis
Service
Storage ??
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 57
Storage case study activity
Case 2: A collaboration software company processes email for enterprise customers. They have more than
250 enterprise customers and more than half a million users. They must store petabytes of data for their
customers. The following diagram illustrates their architecture.
Elastic Load Balancing
Corporate data center
Storage ??
Amazon EC2 instances
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 58
Storage case study activity
Case 3: A data protection company must be able to ingest and store large amounts of customer data and help
their customers meet compliance requirements. They use Amazon EC2 for scalable compute and Amazon
DynamoDB for duplicate data and metadata lookups. The following diagram illustrates their architecture.
Amazon EC2 Amazon
DynamoDB
Clients
Storage ??
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 59
Module 7: Storage
Module wrap-up
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Module summary
In summary, in this module, you learned how to:
• Identify the different types of storage
• Explain Amazon S3
• Identify the functionality in Amazon S3
• Explain Amazon EBS
• Identify the functionality in Amazon EBS
• Perform functions in Amazon EBS to build an Amazon EC2 storage solution
• Explain Amazon EFS
• Identify the functionality in Amazon EFS
• Explain Amazon S3 Glacier
• Identify the functionality in Amazon S3 Glacier
• Differentiate between Amazon EBS, Amazon S3, Amazon EFS, and Amazon S3 Glacier
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 61
Complete the knowledge check
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 62
Sample exam question
A company wants to store data that is not frequently accessed. What is the best and cost-
effective solution that should be considered?
A. AWS Storage Gateway
B. Amazon Simple Storage Service Glacier
C. Amazon Elastic Block Store (Amazon EBS)
D. Amazon Simple Storage Service (Amazon S3)
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 63
Additional resources
• AWS Storage page
• Storage Overview
• Recovering files from an Amazon EBS volume backup
• Confused by AWS Storage Options? S3, EFS, EBS Explained
© 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. 64
Thank you
© 2019 Amazon Web Services, Inc. or its affiliates. All rights reserved. This work may not be reproduced or redistributed, in whole or in part, without prior written permission from Amazon
Web Services, Inc. Commercial copying, lending, or selling is prohibited. Corrections or feedback on the course, please email us at: aws-course-feedback@[Link]. For all other
questions, contact us at: [Link] All trademarks are the property of their owners.