Open source · Prefect
Prefect: Python workflow orchestration
Flows/Tasks with Blocks, deployments, and cloud/self-hosted monitoring
Prefect is an open-source workflow orchestrator using Python-defined Flows/Tasks with retries, caching, parameters, concurrency, and dependency management. Blocks/Deployments plus the UI/Cloud bring scheduling, observability, and alerts for hybrid or on-prem runs.
Pythonic UX
Define Flows/Tasks in Python with async, mapping, parameters, and caching.
Runtime resilience
Retries, timeouts, concurrency limits, and checkpoints improve stability.
Blocks & deployments
Reusable Blocks for storage/queues/credentials; Deployments for scheduling and versions.
Monitoring & alerts
UI/Cloud views, logs, health checks, and alerts with hybrid execution and RBAC.
适用场景 / Use cases
- Python data and ML workflow orchestration
- Task flows needing flexible retries/caching
- Hybrid cloud/on-prem scheduling and monitoring
- Lightweight self-hosted workflow platform