I was trying to get airflow (https://airflow.apache.org/) up and running in the cloud. It has a few moving pieces that I didn't want to worry about. So I used a helm chart to install it - https://github.com/helm/charts/blob/master/stable/airflow
Maybe this is overkill but it was reasonably quick to get up and running, scaling workers will be trivial, and the Airflow Kubernetes Operator opens up a lot of options for tasks. The vanilla install was pretty quick. Understanding the configurations took a bit more time.
I would like to hear other thoughts about simpler ways to deploy this that don't require Kubernetes.
There aren't simpler ways to deploy cluster software. Kubernetes might be overkill for a blog, but it's not overkill for a lot of cluster software. And with Helm charts it's really easy to run it.
