Skip to main content

Amazon EBS

Amazon EBS Snapshot

You can back up the data on your Amazon EBS volumes to Amazon S3 by taking point-in-time snapshots. Snapshots are incremental backups, which means that only the blocks on the device that have changed after your most recent snapshot are saved. This minimizes the time required to create the snapshot and saves on storage costs by not duplicating data. When you delete a snapshot, only the data unique to that snapshot is removed. Each snapshot contains all of the information that is needed to restore your data (from the moment when the snapshot was taken) to a new EBS volume.

https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/EBSSnapshots.html

EBS volumes provide durable block-level storage for use with EC2 instances in the AWS cloud. Volumes are automatically replicated within Availability Zones for high availability and durability.

Usage

EBS volumes are network-attached storage that persists independently from the running life of a single EC2 instance. After an EBS volume is attached to an EC2 instance, you can use the EBS volume similar to a physical hard drive -- typically by formatting it with the file system of your choice and using the file I/O interface provided by the instance operating system. Multiple EBS volumes can be attached to a single EC2 instance and it allows you to dynamically increase capacity, tune performance, and change the type of any new or existing current generation volume with no downtime or performance impact. Furthermore EBS provides the ability to save point-in-time snapshots of your volumes. Each separate volume can be configured as EBS General Purpose (SSD), Provisioned IOPS (SSD), Throughput Optimized (HDD), or Cold (HDD) as needed

The volumes types fall into two categories:

  • SSD-backed volumes optimized for transactional workloads involving frequent read/write operations with small I/O size, where the dominant performance attribute is IOPS
  • HDD-backed volumes optimized for large streaming workloads where throughput (measured in MiB/s) is a better performance measure than IOPS

Amazon EBS volume types - Amazon EBS

Durability & availability

Amazon EBS cloud service is designed to be highly available and reliable. As mentioned earlier EBS volumes data is replicated across multiple servers within availability zones. Taking snapshots of your EBS volumes increases the durability of the data stored on your EBS volumes. Furthermore, EBS volumes are designed for anAnnual Failure Rate (AFR)of between0.1 and 0.2 percent, where failure refers to a complete or partial loss of the volume, depending on the size and performance of the volume.

Security

IAM service enables access to EBS volumes, allowing you to specify who can access which EBS volumes. EBS encryption enables data-at-rest and data-in-motion security. It offers seamless encryption of both EBS boot volumes and data volumes as well as snapshots. Access control plus encryption offers a strong defense-in-depth security strategy for your data.

image

Volume typeGeneral Purpose SSD (gp2)Provisioned IOPS SSD (io1)Throughput Optimized HDD (st1)Cold HDD (sc1)
DescriptionGeneral purpose SSD volume that balances price and performance for a wide variety of workloadsHighest-performance SSD volume for mission-critical low-latency or high-throughput workloadsLow-cost HDD volume designed for frequently accessed, throughput-intensive workloadsLowest cost HDD volume designed for less frequently accessed workloads
Use casesRecommended for most workloads; System boot volumes; Virtual desktops; Low-latency interactive apps; Development and test environments; Critical business applications that require sustained IOPS performance, or more than 16,000 IOPS or 250 MiB/s of throughput per volume; Large database workloads, such as:; MongoDB; Cassandra; Microsoft SQL Server; MySQL; PostgreSQL; Oracle; Streaming workloads requiring consistent, fast throughput at a low price; Big data; Data warehouses; Log processing; Cannot be a boot volume; Throughput-oriented storage for large volumes of data that is infrequently accessed; Scenarios where the lowest storage cost is important; Cannot be a boot volume
Pricing$0.114per GB-month of provisioned storage$0.131per GB-month of provisioned storage AND$0.068per provisioned IOPS-month$0.051per GB-month of provisioned storage$0.029per GB-month of provisioned storage

EBS Pricing - 100 GB - $11.4 per month

S3 Pricing - 100 GB - $2.5 per month

S3 Pricing - First 50 TB / Month - $0.025per GB

S3 Standard - Infrequent Access* - For long lived but infrequently accessed data that needs millisecond access - $0.019per GB

S3 Glacier** - For long-term backups and archives with retrieval option from 1 minute to 12 hours - $0.005per GB

S3 Glacier Deep Archive** - For long-term data archiving that is accessed once or twice in a year and can be restored within 12 hours - $0.002per GB

https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ebs-volume-types.html

Multi-Attach is now available on Amazon EBS Provisioned IOPS volume type, io2. Launched in August 2020, io2 is the newest generation of our Provisioned IOPS volume type designed for 99.999% durability (100x io1) and 500:1 IOPS:GiB (10x io1). Multi-Attach lets you share access to an EBS data volume between up to 16 Nitro-based EC2 instances within the same Availability Zone (AZ). Each attached instance has full read and write permission to the shared volume. Multi-Attach is intended to make it easier to achieve higher application availability for customers that want to deploy applications that manage storage consistency from multiple writers in shared storage infrastructure.

https://aws.amazon.com/about-aws/whats-new/2020/12/multi-attach-support-now-available-on-amazon-ebs-provisioned-iops-volume-type-io2

gp2 vs gp3

Volume Typegp3gp2
Short DescriptionLowest cost SSD volume that balances price performance for a wide variety of transactional workloadsGeneral Purpose SSD volume that balances price performance for a wide variety of transactional workloads
Durability99.8% - 99.9% durability99.8% - 99.9% durability
Use CasesVirtual desktops, medium sized single instance databases such as Microsoft SQL Server and Oracle, latency sensitive interactive applications, boot volumes, and dev/test environmentsVirtual desktops, medium sized single instance databases such as Microsoft SQL Server and Oracle, latency sensitive interactive applications, boot volumes, and dev/test environments
API Namegp3gp2
Volume Size1 GB - 16 TB1 GB - 16 TB
Max IOPS/Volume16,00016,000
Max Throughput*/Volume1,000 MB/s250 MB/s
Max IOPS/Instance260,000260,000
Max Throughput/Instance12,500 MB/s7,500 MB/s
Price$0.08/GB-month; 3,000 IOPS free and; $0.005/provisioned IOPS-month over 3,000;; 125 MB/s free and; $0.04/provisioned MB/s-month over 125$0.10/GB-month

Migrate your Amazon EBS volumes from gp2 to gp3 and save up to 20% on costs | AWS Storage Blog

  • It might take up to 24 hours for a new configuration to take effect, and in some cases more, such as when the volume has not been fully initialized. Typically, a fully used 1-TiB volume takes about 6 hours to migrate to a new performance configuration. Transitional volume performance will be no less than the source volume performance. If you are downgrading IOPS, transitional volume performance is no less than the target volume performance.

Changing RDS storage from gp2 to gp3 | AWS re:Post

  • There is no downtime associated but always plan to make modifications at the time when clusters is expected to be least busy. There wouldn't be downtime, you may see “Storage Optimization” status.

gp2 to gp3 migration for Amazon RDS | by Rajesh Kantamani | Medium

Underutilized EBS

Neglecting Underutilized EBS Volumes: A Costly Oversight in AWS | by puggy | Medium

Is there a way to programmatically find unused EBS Volume usage? : r/aws

Controlling your AWS costs by deleting unused Amazon EBS volumes | AWS Cloud Operations & Migrations Blog

Decreasing Size

Can I reduce an over-sized EBS volume? | AWS re:Post