Preparing pitch for Spark

What is needed to learn Apache Spark 


Apache Spark is open source technoly for inmemory data analytics and complex data pipelines in a Datalake or a datawarehouse.

It is like IPL of cricket and Hadoop is like Oneday match and RDBMS is like test match .

Every format has its own value proposition and its own audience.

Similarly Hadoop is good at fast processing at cheaper cost and Spark is fastest but bit costly.


Coming to what it takes to learn Spark is simply just these two things will be enough to kickstart career into most booming part of Bigdata world 


First one is good understanding on Map Reduce and HDFS

second is good understanding on how functional programming works

It is very easy to say any body can do Spark but doing has its own complications.

Similar to good one day player is not always a good T20 player .

Hadoop developers need to concentrate on Functional aspects and memory aspects of Spark more to be a successful Sparker.

next we will be peep into Functional programming concepts .....how can we relate to our highschool maths........

Please contact me for any queries at [email protected] or whatsapp 9620535444

要查看或添加评论,请登录

janardhan reddy的更多文章

  • Disconnecting in the Connected world

    Disconnecting in the Connected world

    Welcome to the world of Social media and connected world . I am a Data and Social Engineer working in world since my…

  • Blockchain unleashed

    Blockchain unleashed

    A blockchain is decentralized transactional system for internet based generation ,It manages series of transactions as…

    3 条评论
  • How Spark is complementing Hadoop

    How Spark is complementing Hadoop

    Spark is in memory analytics tool designed for complementing Map reduce jobs for low latency and iterative jobs. Spark…

  • Lets play with Hadoop Elephant : Part 0

    Lets play with Hadoop Elephant : Part 0

    What is Hadoop Hadoop is distributed processing and storage framework Hadoop is data processing tool to handle big and…

  • Anybody can become Hadooper

    Anybody can become Hadooper

    Bigdata /Hadoop is new terminology we are listening from last few years What It means for a fresh graduate engineer is…

    1 条评论

社区洞察

其他会员也浏览了