Prefect
Modern Python-native workflow orchestration.
About
Prefect is the modern workflow-orchestration framework: turn Python functions into observable, scheduled, retryable workflows with decorators — no DAG rewrites, dynamic task graphs, first-class async. 24k stars, Apache-2.0, 6.9M PyPI downloads/month, 100 releases in 12 months. The data-engineering successor to Airflow for Python teams: ETL, ML pipelines, and increasingly agent orchestration. Prefect Cloud is the commercial path; the OSS server self-hosts fine for smaller teams.
What it can do
- **Python-native**: decorators, no DAG boilerplate
- **Dynamic workflows**: build task graphs at runtime
- **Scheduling & retries**: first-class, with backoff
- **Observability**: UI with logs, artifacts, and lineage
- **Async-first**: native asyncio support
- **Agents**: run agent workflows as Prefect flows
Setup
```bash
pip install prefect
prefect server start # self-hosted UI
```
```python
from prefect import flow, task
@task
def extract(): return [1, 2, 3]
@flow
def etl():
data = extract()
# transform, load...
if __name__ == "__main__": etl.serve(name="nightly")
```
Docs: docs.prefect.io.
Prerequisites
Python 3.9+. Prefect server (self-hosted) or Prefect Cloud.
Use cases
Works with
Trust score — 9/10
Scored 9/10 (verified tier, metrics-v1). Evidence: 24,007 GitHub stars (log-scaled vs catalog peers); blended with ~6,895,663 monthly package downloads; last push 0d ago; 100 releases/12mo; 908 open issues. Manual review: modern Python-native orchestration, 24k stars, 6.9M PyPI/mo, 100 releases/12mo; Cloud is the monetization path. License: Apache-2.0.
★ 24,007 GitHub stars
How the trust score is built
Full methodology →- Adoption · stars/downloads, log-scaled vs peers
- 8.7/10
- Maintenance · recency, releases, issue load
- 8.5/10
- Openness · license + docs
- 10.0/10
- Manual review · sanity read + red-flag check
- 9.0/10
- · 24,007 GitHub stars (log-scaled vs catalog peers)
- · blended with ~6,895,663 monthly package downloads
- · last push 0d ago; 100 releases/12mo; 908 open issues
- · manual review: modern Python-native orchestration, 24k stars, 6.9M PyPI/mo, 100 releases/12mo; Cloud is the monetization path
Sources
Every fact above was checked against these sources. Where a claim comes from the provider and couldn't be independently verified, the text says so.