read.cash Log in
t@timsu27 more from that month

A deploy guide of Airflow on Kubernetes with Helm

I am recently building Airflow on Kubernetes for my company. Here is a record of my all the resource I found and holes I ran into. Here gathers every resource online helps me setup. The main purpose is to use Helm building Airflow on Kubernetes with the ability to auto-scale and DAGs are git-synced. I think to understand the structure of Kubernetes is important. You can install Minikube to build a single node Kubernetes. Documents Airflow Home https://airflow.apache.org/ Kubernetes Getting started https://kubernetes.io/docs/setup/ Helm Quickstart Guide https://helm.sh/docs/intro/quickstart/ Minikube minikube start https://minikube.sigs.k8s.io/docs/start/ Guide Deploying Airflow with Helm Helm Chart for Apache Airflow - helm-chart Documentation https://airflow.apache.org/docs/helm-chart/stable/index.html Others Running Airflow-2.0 on Kubernetes locally using Minikube https://imsharadmishra.medium.com/running-airflow-2-0-on-kubernetes-locally-using-minikube-da91fc07f32d 序言 https://whmzsu.github.io/helm-doc-zh-cn/ Example Configuration YAML airflow 1.10.12 for Kubernetes https://hub.kubeapps.com/charts/stable/airflow Official Helm Chart of Airflow apache/airflow https://github.com/apache/airflow Other Approaches airflow-2.0 https://github.com/imsharadmishra/airflow-2.0 infinitelambda/minikube-airflow https://github.com/infinitelambda/minikube-airflow

No comments yet

Log in to join in Reading is open to everyone. Replying needs an account.