What happens when a Spark job is submitted

• 举报此文章

RAJEEV KUMAR

RAJEEV KUMAR

Senior Data Architect at TCS || Ex Infosys || Ex IBMer

发布日期: 2024年12月18日

+ 关注

要查看或添加评论，请登录

RAJEEV KUMAR的更多文章

• Exploring the Memory Demands of Spark Executors for 128 MB Data Blocks

  2025年2月11日

  Exploring the Memory Demands of Spark Executors for 128 MB Data Blocks

  In this article we are going to focus on below topics: 1. Overhead Memory 2.

  9
• Why Listening to Tech Professionals Matters: The Reality of “Anything Is Possible” in Technology

  2025年1月31日

  Why Listening to Tech Professionals Matters: The Reality of “Anything Is Possible” in Technology

  In the fast-paced world of technology, there’s an ever-growing misconception among some clients: “Anything is possible…

  11
• Microsoft Fabric: Transform and integrate multiple raw data sources into a consolidated, structured format for analytics and reporting.

  2024年12月27日

  Microsoft Fabric: Transform and integrate multiple raw data sources into a consolidated, structured format for analytics and reporting.

  The objective of this project is to transform and integrate multiple raw data sources into a consolidated, structured…

  6

  1 条评论
• Microsoft Fabric: Data Transformation for Product Attributes Management

  2024年12月26日

  Microsoft Fabric: Data Transformation for Product Attributes Management

  Context: Organizations often manage product data in a structured but complex format where attributes are stored as…

  7

  1 条评论
• Mounting Lakehouse in Fabric Notebook

  2024年12月22日

  Mounting Lakehouse in Fabric Notebook

  To mount another Lakehouse in the notebook, use the below code. It should be noted that Lakehouses mounted at the…

  6

  1 条评论
• Getting A List of Folders and Delta Tables in the Fabric Lakehouse

  2024年12月22日

  Getting A List of Folders and Delta Tables in the Fabric Lakehouse

  When you are working with the files and folders in Fabric, you will often need the list of file folders and tables for…

  9
• How to Decide if Databricks Is the Right Tool for You

  2024年11月19日

  How to Decide if Databricks Is the Right Tool for You

  Databricks is an all-in-one data platform, offering capabilities for a wide range of data use cases, from data…

  13

  1 条评论
• Architectural Patterns in Data Engineering Projects

  2024年7月30日

  Architectural Patterns in Data Engineering Projects

  Data engineering is a critical component of any data-driven organization, enabling the collection, transformation, and…

  16
• Best Practice to optimize Azure Databricks environment.

  2024年5月11日

  Best Practice to optimize Azure Databricks environment.

  Azure Databricks (ADB) has the power to process terabytes of data, while simultaneously running heavy data engineering…

  16
• How to Use Oozie Workflow with HDInsight

  2023年12月9日

  How to Use Oozie Workflow with HDInsight

  Oozie is a workflow and coordination system that manages Hadoop jobs. Oozie is integrated with the Hadoop stack, and it…

  7

  2 条评论

Show more

See all articles