Data Management and Analytics Archives - Proactive Insights and Support For Open-Source Applications

5 Dec 2025 Apache Airflow: Intermittent DAG Disappearance Caused by DagBag Import Timeouts

Problem: The client experienced an intermittent disappearance of a critical Apache Airflow DAG — Dag-Factory. The DAG would appear in the Airflow UI and CLI, then vanish from the DagBag and UI for periods of time before reappearing. Each disappearance caused pipeline failures (notably the need to re-trigger the BONG initial load), interrupting production workflows. […]

Data Management and Analytics