PREFECT-EDI

Modern dynamic Python flow orchestrator.

Definition

Prefect 2 (July 2022) then Prefect 3 (April 2024) abandons upfront DAG in favour of native Python with @flow and @task. Prefect Cloud (managed) offers deployments, workers, secrets, automations. Particularly suited for EDI pipelines with conditional branches.

Origin

Created by Jeremiah Lowin (ex-Airflow PMC) in 2018 ; Prefect 2 July 2022 ; Prefect 3 April 2024.

Example in context

An EDI platform uses Prefect to ingest 500 SFTP partners with 4x per-flow configurable retries.

Related terms

• Airflow — historical competitor.