Steps for Job Execution in Local Environment:
Point Metrics:
- Add SOURCE_PATH in config.properties
- Execute spark job through IDE or spark-submit in shell.
Campaign Metrics:
-
Add following properties in config.properties CONTEXT_SOURCE_PATH - Context Source(Local Source Path) EVENT_SOURCE_PATH - Event Source(Local Source Path) TARGET_PATH - HDFS File write path(Local target Path)
-
Execute spark job through IDE or spark-submit in shell.
Flink Streaming:
- Add BOOTSTRAP_SERVER, TOPIC details in config.properties
- Execute Streams by setting up local kafka environment.