Jump to content

Apache Oozie: Difference between revisions

From Wikipedia, the free encyclopedia
Content deleted Content added
No edit summary
m Added workflow scheduler System as category
Line 54: Line 54:


[[Category:Hadoop]]
[[Category:Hadoop]]
[[Category:Workflow Scheduler System]]

Revision as of 07:47, 6 June 2016

Repository
Websiteoozie.apache.org Edit this on Wikidata

Apache Oozie is a server-based workflow scheduling system to manage Hadoop jobs.

Workflows in Oozie are defined as a collection of control flow and action nodes in a directed acyclic graph. Control flow nodes define the beginning and the end of a workflow (start, end and failure nodes) as well as a mechanism to control the workflow execution path (decision, fork and join nodes). Action nodes are the mechanism by which a workflow triggers the execution of a computation/processing task. Oozie provides support for different types of actions including Hadoop MapReduce, Hadoop distributed file system operations, Pig, SSH, and email. Oozie can also be extended to support additional types of actions.

Oozie workflows can be parameterised using variables such as ${inputDir} within the workflow definition. When submitting a workflow job, values for the parameters must be provided. If properly parameterized (using different output directories), several identical workflow jobs can run concurrently.

Oozie is implemented as a Java web application that runs in a Java servlet container and is distributed under the Apache License 2.0.

Editors

References

  1. ^ Mahran, Ahmed (30 October 2015). "Oozie Plugin for Eclipse". www.infoq.com. InfoQ. Retrieved 30 October 2015.