登录查看更多内容

Benefits of and Tips on Hortonworks Apache Spark Certification

Fisseha Berhane, PhD

Senior Principal Data Scientist

发布日期: 2018年3月25日

Recently, I took hands-on, performance-based certification for Spark on the Hortonworks Data Platform (HDPCD), and in this article I will share what benefits one gets from the certification process, and some tips on how to prepare for it.

You can get the full article with some tips on how to prepare for the test here

My previous articles on using Spark on various topics:

1. Machine Learning with Text in PySpark - Part 1

2. Leveraging Hive with Spark using Python

3. Analyzing the Bible and the Quran using Spark

4. Spark DataFrames: Exploring Chicago Crimes

5. Spark RDDs vs DataFrames vs SparkSQL - part 1: Retrieving, Sorting and Filtering

6. Spark RDDs Vs DataFrames vs SparkSQL - Part 2 : Working With Multiple Tables

7. Spark RDDs Vs DataFrames vs SparkSQL - Part 3 : Web Server Log Analysis

8. Spark RDDs Vs DataFrames vs SparkSQL - Part 4 : Set Operators

9. Spark RDDs Vs DataFrames vs SparkSQL - Part 5: Using Functions

要查看或添加评论，请登录

Fisseha Berhane, PhD的更多文章

Deep Learning with TensorFlow and Keras

2019年7月5日

Deep Learning with TensorFlow and Keras

I have been teaching deep learning (DNN and CNN) with TensorFlow and Keras to colleagues at work and I have shared them…

3 条评论
How using scikit-learn in Spark could save the day

2019年4月5日

How using scikit-learn in Spark could save the day

We may want to use scikit-learn with Spark when: 1- training a model in scikit-learn takes so long 2- the machine…

1 条评论
ROC Curve could be misleading with imbalanced data: Precision-Recall Curve is more informative

2019年4月2日

ROC Curve could be misleading with imbalanced data: Precision-Recall Curve is more informative

Even if ROC curve and area under the ROC curve are commonly used to evaluate model performance with balanced and…

2 条评论
Data distributions where K-means clustering fails; can DBSCAN be a solution? Examples with R, Python and Spark

2018年11月4日

Data distributions where K-means clustering fails; can DBSCAN be a solution? Examples with R, Python and Spark

For K-means clustering to work well the variance of the distribution of each attribute (variable) should be…

10 条评论
Sampling using truncated hash

2018年10月25日

Sampling using truncated hash

Let's suppose tens of millions of people visit your website everyday and you want to do ad hoc analysis. However, you…
Hive Partitioning with Spark

2018年10月17日

Hive Partitioning with Spark

I experimented with Hive partitioning and some of the things I discussed in this blog post are: Query response time…
Issues to pay attention to when performing PCA in Spark, Python and R

2018年10月8日

Issues to pay attention to when performing PCA in Spark, Python and R

Recently, I was using PCA with Spark with sparse matrix with millions of rows and to make sure everything was right I…

5 条评论
Simpson’s Paradox

2018年10月3日

Simpson’s Paradox

Today, I was listening to a data science podcast from DataCamp and they talked about Simpson's paradox: it is a…

1 条评论
Exploring the Pareto Distribution with R

2018年9月20日

Exploring the Pareto Distribution with R

We have learned various distributions in college. The most common one being the bell-curve, based on our area of study…

1 条评论
Machine Learning with Text in PySpark - Part 1

2018年3月10日

Machine Learning with Text in PySpark - Part 1

We usually work with structured data in our machine learning applications. However, unstructured data can also have…

3 条评论

See all articles

Benefits of and Tips on Hortonworks Apache Spark Certification

Fisseha Berhane, PhD

Senior Principal Data Scientist

Fisseha Berhane, PhD的更多文章

社区洞察

其他会员也浏览了

?? Understanding SparkContext vs. SparkSession ??

?? Exploring Apache Hudi and Delta Tables: Making Data Lake Management Smoother! ???

DAB - Databricks Asset Bundle, YAML Error (768) Parse Error at Offset 0

update-csv-using-delta databricks open source tool for notebook dependency management

The #DeltaLake 1.2.0 is now available

Apache Flink: What, How, Why, Who, Where?

How do you tune the worlds fastest OLTP DB?

Learn how to tune the worlds fastest OLTP DB

Hadoop MapReduce 大规模数据并行处理系统

Apache Cassandra :: Row Position and DecoratedKey Clarification

Fisseha Berhane, PhD的更多文章

Deep Learning with TensorFlow and Keras

How using scikit-learn in Spark could save the day

ROC Curve could be misleading with imbalanced data: Precision-Recall Curve is more informative

Data distributions where K-means clustering fails; can DBSCAN be a solution? Examples with R, Python and Spark

Sampling using truncated hash

Hive Partitioning with Spark

Issues to pay attention to when performing PCA in Spark, Python and R

Simpson’s Paradox

Exploring the Pareto Distribution with R

Machine Learning with Text in PySpark - Part 1

社区洞察

其他会员也浏览了

?? Understanding SparkContext vs. SparkSession ??

?? Exploring Apache Hudi and Delta Tables: Making Data Lake Management Smoother! ???

DAB - Databricks Asset Bundle, YAML Error (768) Parse Error at Offset 0

update-csv-using-delta databricks open source tool for notebook dependency management

The #DeltaLake 1.2.0 is now available

Apache Flink: What, How, Why, Who, Where?

How do you tune the worlds fastest OLTP DB?

Learn how to tune the worlds fastest OLTP DB

Hadoop MapReduce 大规模数据并行处理系统

Apache Cassandra :: Row Position and DecoratedKey Clarification