Spark on Kubernetes the Simple Way! :)

• 举报此文章

Josue Luzardo Gebrim

Josue Luzardo Gebrim

Platform and Data Engineer

发布日期: 2023年3月15日

+ 关注

Hello,

Have you ever imagined taking your #PySpark pipeline to a container environment? This text summarizes on Medium what it is, what it is for, and how to use it with some tips about #Spark in #Kubernetes.

To know more:

# Thanks for reading; share this post; please ! :)

要查看或添加评论，请登录

Josue Luzardo Gebrim的更多文章

• Nim: An Efficient, Expressive, Elegant, and Constantly Evolving Computational Language!

  2024年1月22日

  Nim: An Efficient, Expressive, Elegant, and Constantly Evolving Computational Language!

  NIM is a programming language of statically typed compiled systems. It combines concepts of success of mature languages…

  11
• Discovering Data Product Possibilities and Opportunities!

  2023年10月12日

  Discovering Data Product Possibilities and Opportunities!

  In today's data-driven world, the importance of data products stands out as a crucial element for business success…

  13
• Effectively enhancing and optimizing AWS Glue!

  2023年10月10日

  Effectively enhancing and optimizing AWS Glue!

  Discover the untapped secrets to success: how to boost your efficiency and drastically cut your operational expenses…

  13
• Discovering Zero?ETL!

  2023年10月5日

  Discovering Zero?ETL!

  Bringing Agility and Speed to Your Data Analysis! "Zero-ETL is a set of integrations that eliminates or minimizes the…

  14
• DuckDB: Discovering High-Performance Embedded Database!

  2023年10月4日

  DuckDB: Discovering High-Performance Embedded Database!

  A Powerful Embedded Analytics Database! There are many database management systems (DBMS) out there. But there is no…

  20
• GO(Golang) and Big Data Solutions!

  2023年6月25日

  GO(Golang) and Big Data Solutions!

  Hi Everyone, Today I bring the possibility of using different data solutions for the most diverse contexts with the…

  12
• Apache Pinot: The Missing Wine in the Data Scenario!

  2023年6月16日

  Apache Pinot: The Missing Wine in the Data Scenario!

  Hello Everyone, This time I come to bring a summary of an open-source, real-time distributed OLAP datastore solution…

  4
• Strimzi: Apache Kafka on Kubernetes in Minutes!

  2023年6月15日

  Strimzi: Apache Kafka on Kubernetes in Minutes!

  Hi everyone, Today I came to share with you a summary about Strimzi, a super interesting option to configure and use a…

  26

  3 条评论
• Dremio and Apache Iceberg: New Hope or Data Hype!?

  2023年6月14日

  Dremio and Apache Iceberg: New Hope or Data Hype!?

  Hello Everyone, I started to look at the market and saw a growing use of Apache Iceberg, an amazing data format totally…

  6
• Feature Store: Accelerating Data Science Initiatives!

  2023年6月13日

  Feature Store: Accelerating Data Science Initiatives!

  Hi Everyone! This time, bring a summary with some feature store solutions(Databricks, Google, Amazon Web Services…

  20

  2 条评论

Show more

See all articles