What is BigData in Layman's Language

What is BigData in Layman's Language

Charan V. Charan V.

Charan V.

Software Engineer || 2x ICPC Regionalist 2021 & 22 || RHCE (EX294) || Technologies -> Java | AWS | Linux | DevOps | Jenkins | Python | Docker | Terraform | $PHP Hacker

发布日期: 2020年9月16日
+ 关注

BigData Problem

Hey Everyone.!

So I've just started a research on data like how much data does same company works per day. What I found what left me in raising some questions.

I searched on the internet about home much data does Facebook has to deal with per day and from techcrunch.com I found out that facebook actually deals with over 500+ TerraBytes(TBs) of data per day. This made me wonder okay it deals with it but how and where does it store and many more questions came up in my mind.

These Questions that I just raised here are termed as BIGDATA PROBLEMS. As Facebook needs to interact with 500TBs a day, it needs some huge hard disks. It can get those hardwares simply by investing lots of money but th ( problem will not get solved here. Due to very large storages and Very much of data incoming, processing those data will not be fast as Harddisks are not that much faster. It will take a couple of Days just to read the data. Now think of this, if you have a requirement of some particular data on Facebook and it will reach you after 4days(2 days for reading and 2 for writing), will you be using Facebook anymore? This problem I stated here is a subproblem of BigData which is known has velocity problem. The other problem is that how to get that much amount of storage, which is known has volume problem.

To solve this velocity problem The Tech Guys came up with the Distributed Storage Cluster System, in which The data is stored simultaneously in small parts in different storage hardwares. This will speed the process by no.of storage devices you use. More the storage devices more speed you will get. By getting n no. of storage units you will solve both volume and velocity problem.

So that's how these Tech Industries work for you :)

要查看或添加评论，请登录

Charan V.的更多文章

  • K Means Clustering UseCases in Security Domain
    2021年8月11日

    K Means Clustering UseCases in Security Domain

    Introduction K Means Clustering is an Unsupervised Machine Learning. It is one of the simplest and popular unsupervised…

  • Deploying a ML model inside Docker
    2021年5月27日

    Deploying a ML model inside Docker

    In this blog, we'll be talking about deploying a trained Machine Learning Model inside a Docker Container. So, for…

    2 条评论
  • Integrating LVM with Hadoop
    2021年3月14日

    Integrating LVM with Hadoop

    Hey Everyone, in this article we will learn how we can provide elasticity to our datanode's storage. First of all, we…

  • 1: Configuring the Webserver On a Docker Container
    2021年3月14日

    1: Configuring the Webserver On a Docker Container

    In this article, we will be discussing about how to install and configure HTTPD WebServer on a Docker Container Image…

  • A Network Setup, Ping ONE but not the OTHER
    2021年3月12日

    A Network Setup, Ping ONE but not the OTHER

    Hello Everyone, In this Article, we will setup a network such that it will ping to Google servers, but it will not ping…

  • AWS CLI Infrastructure and Using CMD to launch and manage Instances
    2020年10月31日

    AWS CLI Infrastructure and Using CMD to launch and manage Instances

    Here, in this post, I'll let you know how to use aws-cli to launch and manage AWS services with very ease. Today, I…

社区洞察

其他会员也浏览了