Dagster
Automation
Orchestrate data around the assets your team uses
Editorial discoveryOpen source
0 props
Props are a thank-you from members.
Product preview
Full sizeAbout Apache Airflow
Apache Airflow lets teams define, schedule and monitor workflows built from dependent tasks. In a typical data pipeline, define a step that collects input, a step that transforms it and a final step that checks or publishes the output. The web interface shows the status of runs and provides access to task logs when a step fails. Airflow suits teams with recurring batch work and someone to operate the scheduler, workers and supporting services. Keep task execution safe to repeat so a retry does not duplicate output. Verify the time zone, scheduling behavior and backfill strategy using one representative pipeline. A continuous event stream may require a different design from the scheduled workflow Airflow is built around.
Editorial discovery. Check the official website for current features and pricing. Source: Official product website .
Let’s talk about it0
Good products deserve a good conversation.
Be the first to start one.
