Ranga's Spark Project Template Generator
Hi All,
I have created open source spark project template generator application. By using this application you can based on templates you can create N number of applications with in seconds or minutes.
Advantages of using this application:
1. Create?sbt?or?maven?or both build based Spark applications.
2. Through single configuration (config.yaml?or?config_all_apps.yaml) you can create?N number of Spark Applications.
3. Supports various Spark templates like hive, hbase, kudu, various file formats etc and you can create your own templates.
4. Generates both?Scala?and?Java?based code as of now.
5. Generate the?run script?to run the spark application.
6. Deployment steps are mentioned in?README.md?file.
7. Built in?Scala Test?code for Default template.
Source code:
You can find the source code below github url.
Sample Applications:
I have created bunch of spark applications using this application.
Please let me know is there any feedback on this application.
You can contact me using following linkedin for any clarifications and doubts.
Engineering Lead at Fedex
3 年Thanks Ranga for sharing, this helps a lot