International Journal For Multidisciplinary Research

E-ISSN: 2582-2160     Impact Factor: 9.24

A Widely Indexed Open Access Peer Reviewed Multidisciplinary Bi-monthly Scholarly International Journal

Call for Paper Volume 7, Issue 4 (July-August 2025) Submit your research before last 3 days of August to publish your research paper in the issue of July-August.

Scaling Enterprise Data Workflows with Apache Airflow and Kubernetes

Author(s) Ujjawal Nayak
Country United States
Abstract Apache Airflow 3.0 introduces a Task-Execution API, richer event-driven scheduling, and a React-based UI [1]. Concurrently, Kubernetes v1.31 adds graduated autoscaling, AppArmor/seccomp hardening, and smarter bin-packing [2]. Pairing these releases yields a cloud-agnostic data platform that elastically scales thousands of heterogeneous pipelines while meeting cost and compliance mandates
Keywords Apache Airflow, Kubernetes, Workflows, Scalable Data Pipelines
Field Engineering
Published In Volume 7, Issue 4, July-August 2025
Published On 2025-07-17
DOI https://doi.org/10.36948/ijfmr.2025.v07i04.52678
Short DOI https://doi.org/g9wnrq

Share this