Skip to content

Object storage: blobs, durability and cost

Choose a blob layout, distinguish durability from availability, calculate erasure-coding overhead, and budget storage and egress.

18 min7 steps

By the end you can
  • Choose an object key and metadata pattern for immutable blobs
  • Distinguish durability from request availability
  • Calculate replication and k+m erasure-coding storage overhead
  • Estimate storage and egress costs with explicit units and assumptions

Store bytes by key

ClientObject storeDatabasePUT photos/42/v3: image bytesUpload acceptedRecord key, owner and content type

An object holds bytes plus metadata under a key in a bucket. Keep searchable application metadata in a database. Prefer a new key for each blob version. Uploading bytes and publishing a database pointer are separate operations: reconcile orphan uploads and dangling pointers.

Which layout fits a photo service that searches by owner?

Answer this step to continue.

What this lesson simplifies

  • Coding arithmetic assumes equal-sized fragments and an ideal maximum-distance-separable code.
  • Prices are invented inputs, not vendor quotes; requests, retrieval, minimum duration and taxes are excluded.
  • Figures do not model repair bandwidth, correlated failures or provider durability probabilities.

Sources

  1. Amazon S3: What is Amazon S3?.
  2. Amazon S3: Data protection.
  3. Ceph: Erasure code.
  4. Amazon S3 pricing.

Reviewed by Content lead on . Revision 1.