Skip to content Skip to sidebar Skip to footer
Showing posts with the label Airflow

Store And Access Password Using Apache Airflow

We are using Airflow as a scheduler. I want to invoke a simple bash operator in a DAG. The bash scr… Read more Store And Access Password Using Apache Airflow

Airflow: Error: Unrecognized Arguments: Webserver

I am trying to start my airflow webserver, but it says it is an unrecognised argument $ airflow web… Read more Airflow: Error: Unrecognized Arguments: Webserver

Airflow On Docker - Path Issue

Working with airflow I try simple DAG work. I wrote custom operators and other files that I want to… Read more Airflow On Docker - Path Issue

Airflow: How To Use Trigger Parameters In Functions

We are using Airflow's KubernetesPodOperator for our data pipelines. What we would like to add … Read more Airflow: How To Use Trigger Parameters In Functions

Listing Variables From External Script Python Without The Built-in And Imported Variables

I'm writing a python script that gets parameters from a json file, opens a template script spec… Read more Listing Variables From External Script Python Without The Built-in And Imported Variables

How To Run Airflow With Celeryexecutor On A Custom Docker Image

I am adding airflow to a web application that manually adds a directory containing business logic t… Read more How To Run Airflow With Celeryexecutor On A Custom Docker Image