dexaflow
Dexaflow authoring primitives, available to a dag.py at RUN time (#17).
This is the twin of parser/leoflow_parser/_shim/dexaflow. The two exist for
opposite halves of a DAG's life and must export the same public names:
- the parser shim is on
sys.pathonly while the compiler parses, is dependency-free by ADR 0024, and derives from the parser's ownairflowshim; - this one ships in the task image and the Lite per-DAG venv, and derives from the real Task SDK.
A dag.py is not a compile-time-only artifact: runner.py re-imports the
module for every python task, so every top-level import in the user's DAG
runs again inside the task pod. Without this package the hybrid shape we
document, from dexaflow import dbt_group over a dag.py with Python
tasks around the group (ADR 0043), compiled green and then died on its own
first line with ModuleNotFoundError, in Lite and in Pro alike. DAGs written
before the rename import the same names as leoflow, a re-export of this
package.
Deriving from the real BaseOperator is load-bearing, not tidiness:
pull >> models dispatches to the real operator's __rshift__, so a
bare stub with its own __rshift__ would never be consulted.
Embed a dbt project (configured under dexaflow.yaml dbt_groups: <name>)
as a task group. Returns the placeholder operator for >> wiring; its
task_id is the group name.