Spark Configuration Generator

Spark Configuration Generator

Ranga Reddy Ranga Reddy

Ranga Reddy

Open Source Engineer at OneHouse

发布日期: 2022年4月29日
+ 关注

Hello Spark Enthusiast

Are you looking for generating the Spark Configuration based on Resources (Hardware Configuration)?

If yes, use the below link to generate the Spark Configuration based on your Hardware Configuration.

https://rangareddy.github.io/SparkConfigurationGenerator/

Please let me know, if you need any kind of additional features.

#apachespark #spark #ranga_reddy #spark_configuration #spark_resources

Harish Kumar

Senior Software Engineer @ IBM Labs

2 年

Wow nice one sir

赞
回复
Deepak Sahu

Data Engineering @One| MLOps | AI Engineering | Ex-Grab, 6sense

2 年

Hey Ranga, Need to understand how it is creating and more about the tech stack used here.

赞
回复
1 次回应
查看更多评论

要查看或添加评论，请登录

Ranga Reddy的更多文章

  • Apache Iceberg History & Spark Supportability Matrix
    2024年7月3日

    Apache Iceberg History & Spark Supportability Matrix

    1. Introduction The Spark and Iceberg Supportability Matrix provides comprehensive information regarding the…

    2 条评论
  • Apache Spark Supportability Matrix
    2024年2月28日

    Apache Spark Supportability Matrix

    1. Introduction: One of the most common challenges faced while developing Spark applications is determining the…

  • Spark History Server Docker Image
    2023年8月7日

    Spark History Server Docker Image

    A Sample Docker image for Spark History Server to deploy and manage the Spark Event Logs locally. Step1: Pull the…

  • Shell Script to generate Random CSV data
    2022年9月14日

    Shell Script to generate Random CSV data

    Source Code: https://gist.github.

    3 条评论
  • Create your first Airflow DAG
    2022年3月18日

    Create your first Airflow DAG

    Let's start creating a Hello World workflow, which does nothing other than sending "Hello World!" to the log. A DAG…

    22 条评论
  • Install Apache Airflow on Mac OS
    2022年3月9日

    Install Apache Airflow on Mac OS

    Airflow is written in python, so python needs to be installed in the environment, and python must be greater than 2.7…

    17 条评论
  • Spark code to create a random sample data
    2022年2月5日

    Spark code to create a random sample data

    In this article you will learn how to create a random sample data by using spark. import org.

  • Ranga's Spark Project Template Generator
    2021年11月12日

    Ranga's Spark Project Template Generator

    Hi All, I have created open source spark project template generator application. By using this application you can…

    1 条评论

社区洞察

其他会员也浏览了