User:Debra.chena/Sample page
Developer(s) | Apache Software Foundation |
---|---|
Repository | GitHub |
Written in | Python,Vue,Java,Shell,SCSS,PLpgSQL |
Operating system | macOS, Linux |
Type | Workflow management platform |
License | Apache License 2.0 |
Website | airflow |
Apache DolphinScheduler is a cloud-native visual Big Data workflow scheduler system, provides a distributed and easy-to-expandable visual workflow task scheduling platform for enterprise-level scenarios, and is dedicated to "visualizing the dependency between operation tasks and workflows, and visualizing the entire data processing process"committed to “solving complex big-data task dependencies and triggering relationships in data OPS orchestration so that various types of big data tasks can be used out of the box”.
DolphinScheduler graduated from Apache Foundation in April 9, 2021, and is the first top project led by Chinese developers to graduate from Apache.
Overview
[edit]DolphinScheduler visualizes the dependency between operation tasks and workflows, as well as the entire data processing process, these features hits the pain points of current scheduling system:
·The decentralized architecture design ensures the stability of the scheduling platform.
·The graphical page design reduces the cost of use.
·Supports multi-strategy load balancing.
·Supports multiple scheduling mechanisms.
·Supports data analysis.
·The convenient visual monitoring function.
·With complete alarm module.
Community
[edit]Apache DolphinScheduler has grown into a community consists of 17 Commiters, 15 PMC 250+ contributors and 6000+ active users.
Prominent use cases
[edit]Unicom Digital Tech has launched the first version of Apache DolphinScheduler in October 2020, and after one year’s testing, DolphinScheduler is still running smoothly in the company, processing its 7000+ process instances, tens of thousands of task instances, and 70+ worker nodes.
References
[edit]The Apache Software Foundation Announces Apache DolphinScheduler as a Top-Level Project
Apache DolphinScheduler now ASF Top-level Project
Apache DolphinScheduler Website