The open source Apache Airflow data orchestration technology is adding new features to help enterprises build better data pipelines and understand where data is coming from.

The new operators will help enterprises integrate Vertex AI’s generative AI models into data pipelines orchestrated by Apacher Airflow and its managed workflow orchestration service Cloud Composer.

Apache Airflow, the workload management system developed by Airbnb, will power the new workflow service that Google rolled out today. Called Cloud Composer, the new Airflow-based service allows data ...

While customers really enjoy the pre-built integrations and familiar Python programming language of Apache Airflow, they want it without the added operational cost and complexity.