[proxy] web.archive.org← back | site home | direct (HTTPS) ↗ | proxy home | ◑ dark◐ light

Dagster

Ship data pipelines with extraordinary velocity

Dagster helps data engineers tame complexity. Elevate your data pipelines with software-defined assets, first-class testing, and deep integration with the modern data stack.

The cloud-native orchestrator for the whole development lifecycle, with integrated lineage and observability, a declarative programming model, and best-in-class testability.

Manage your data assets with code

Python assets

dbt-native orchestration

Task-based workflows

Materialize All

Materializing an asset launches a run and saves the results to persistent storage. Trigger materializations right from any asset graph.

Materialize All

Materializing an asset launches a run and saves the results to persistent storage. Trigger materializations right from any asset graph.

A single pane of glass for your data platform

Monitor execution

Debug runs

Inspect assets

Explore lineage

Dagster+

From pull request to production. Effortlessly.

The enterprise orchestration platform that puts developer experience first, with fully serverless or hybrid deployments, operational observability, data cataloging, and out-of-the-box CI/CD.

Dagster+ brings you an asset-oriented approach to go way beyond what traditional orchestration delivers.

Data teams from startups to Fortune 500 companies alike are having a blast building pipelines with Dagster

Join the Slack community

“Dagster has been instrumental in empowering our development team to deliver insights at 20x the velocity compared to the past. From Idea inception to Insight is down to 2 days vs 6+ months before.”

Gu Xie

“Dagster Insights has been an invaluable tool for our team. Being able to easily track Snowflake costs associated with our dbt models has helped us identify optimization opportunities and reduce our Snowflake costs.”

Timothée Vandeput

Data Engineer

“Dagster is the single pane of glass that our team uses to not only launch and monitor jobs, but also to surface visibility into data quality, track asset metadata and lineage, manage testing environments, and even track costs associated with Dagster and the external services that it manages.”

Zachary Romer

“Somebody magically built the thing I had been envisioning and wanted, and now it's there and I can use it.”

David Farnan-Williams

Lead Machine Learning Engineer

“Being able to visualize and test changes using branch deployments has enabled our data team to ship faster”

Aaron Fullerton

“Dagster brings software engineering best practices to a data team that supports a sprawling organization with minimal footprint.”

Emmanuel Fuentes

Integrate with the tools you already use and deploy to your infrastructure.