Apache Oozie Features

Table of Contents

• Apache Oozie Features
  • The .ooziePlugin.json file
  • oozieCommand Task
  • oozieUpload Task

Apache Oozie Features

The Hadoop Plugin comes with tasks to execute Apache Oozie commands and upload zip artifacts to versioned directories on HDFS.

Please note that we are no longer actively using Apache Oozie at LinkedIn. Although the Apache Oozie-related code is covered by unit tests, it is possible that the Apache Oozie tasks may fall into a non-working state.

In addition, instead of providing full documentation for each task, we will refer you to the source code to understand the various options.

The .ooziePlugin.json file

The Apache Oozie tasks will read configuration information from this file. Run ./gradlew writeOoziePluginJson to create a default .ooziePlugin.json file and then edit this file to provide information about your own Oozie instance.

See OozieConstants.groovy for more information about the configuration values you should provide.

oozieCommand Task

This task will execute the Oozie command specified on the command line by -Pcommand=commandName.

All of the standard Oozie commands are supported, including submit, run, suspend, resume, start, status and kill.

See OozieCommandTask.groovy for more information about using this task.

oozieUpload Task

This task will upload the zip artifact specified in the .ooziePlugin.json file to a versioned directory on HDFS.

See OozieUploadTask.groovy for more information about using this task.