Block Storage Vs Object Storage

Block Storage Vs Object Storage

Block Storage

In Block storage, data is broken up into pieces called blocks. and it is stored across a system that can be physically distributed. It's like 1 block device maybe your 1 independent raw disk. so that when you plug in it the operating system detects it as a raw disk so you can format that raw disk with any filesystem and start using it as a regular device upon which you can store your data. The most common example of block storage are ISCSI, SAN, and local disk. In Block Storage, files are spilt into evenly sized blocks of data, each with its own address but with no additional information i.e metadata to provide more context for what that block of data is.

Block storage option is also available in the cloud. For example AWS Elastic Block Storage(EBS). They also provide raw storage where you can attach your EC2 instance. Once you attached the Ec2 instance to your storage, it creates a file system, and immediately it is ready to access your storage. In Azure, premium Storage delivers high performance, low latency disk running on Azure virtual Machine.

Advantage of Block Storage:

  • High performances and optimized I/O bound
  • Highly redundant
  • data can be easily recovered through disk fails.

Disadvantage of Block storage:

  • Storage is tied to one server at a time
  • You need to pay for all the block storage space you’ve allocated, even if you’re not using it
  • You can only access block storage through a running server

Object storage

Object Storage is one of the most recent storage systems. In object storage, storage is presented as an unstructured collection of objects. Each object contains a blob( Binary Large object) of data and a set of metadata, attributes specific to or contextual for the object ("data about the data").

In object storage, every object contains 3 things:

  • the data itself: the data can be anything you want to store
  • A metadata: the metadata is defined by whoever created that object storage. it contains contextual information about what that data is.
  • Unique Identifier: this identifier is a 128-bit unique value given to an object to be found in a distributed system. so because of this it is possible to find data without knowing its physical location.

In cloud object storage option is also available. Let's take the example of Amazon S3. it stores the object within a resource called "buckets". Another example is the Azure Bob storage. For users with a large amount of unstructured data to store in the cloud.

Advantage of object storage:

  • it is Massively Scalable
  • Easily accessible via HTTP requests
  • A cost structure that means you only pay for what you use so Billed per usage, no fixed costs or very low entry fee.
  • Being able to store chunks of metadata alongside your data blob can further simplify your application architecture

Disadvantage of object Storage:

  • high latency than block storage
  • Object Storage does not allow the modification of a certain data blob, each object must be read and written completely which may lead to performance issues
  • Operating systems can’t easily mount an object store like a normal disk.

Thank You!

要查看或添加评论,请登录

VishvaJeet Singh的更多文章

  • ?? Traditional Data Engineering vs. MLOps Pipelines: Choosing the Right Approach ??

    ?? Traditional Data Engineering vs. MLOps Pipelines: Choosing the Right Approach ??

    Deciding whether to use a traditional data engineering pipeline or an MLOps-based pipeline depends on several key…

  • Kafka CLI Cheat Sheet

    Kafka CLI Cheat Sheet

    Kafka Docs: https://kafka.apache.

    1 条评论
  • Kafka - Confluent Platform Quick Start Docker - Part 1

    Kafka - Confluent Platform Quick Start Docker - Part 1

    In this quick start I will show you how to get up and running with Confluent Platform and its main components using…

  • AWS Lambda

    AWS Lambda

    AWS Lambda lets you run code without provisioning or managing servers. You pay only for the compute time you consume -…

  • Amazon Simple Notification Service (SNS)

    Amazon Simple Notification Service (SNS)

    Amazon Simple Notification Service (SNS) is a durable, secure, fully managed pub/sub messaging service that enables you…

  • Amazon Simple Queue Service(SQS)

    Amazon Simple Queue Service(SQS)

    Amazon Simple Queue Service (SQS) is a fully managed message queuing service that enables you to decouple and scale…

  • AWS Key Management Service (KMS)

    AWS Key Management Service (KMS)

    AWS Key Management Service (KMS) is a managed service that makes it easy for you to create and control the encryption…

  • Amazon S3

    Amazon S3

    Amazon S3(Simple Storage Service) has a simple web services interface that you can use to store and retrieve any amount…

  • Elastic Load Balancer and Route 53

    Elastic Load Balancer and Route 53

    Elastic Load Balancer - Elastic Load Balancing automatically distributes incoming application traffic across multiple…

  • Amazon EC2

    Amazon EC2

    Amazon Elastic Compute Cloud (Amazon EC2) is a web service that provides secure, re-sizable compute capacity in the…

社区洞察

其他会员也浏览了