![]() All tasks are now being executed successfully on our Kubernetes cluster, but the logs of these tasks are nowhere to be found. I slightly modified the puckel/docker-airflow image to be able to install the Kubernetes executor. If you dont configure this, the logs will. I've deployed an Airflow instance on Kubernetes using the stable/airflow helm chart. Account Keys to be provided to tasks run on Kubernetes Executors Should be. Log.info("run date is : " + str(run_date))į. Kubernetes Executor By storing logs onto a persistent disk, the files are accessible by workers and the webserver. Set this to True if you want to enable remote logging. LOGGER = logging.getLogger("airflow.task") Log: logging.log = logging.getLogger("airflow") The Kubernetes Executor allows you to run all the Airflow tasks on Kubernetes as separate Pods. Logging_config_class = log_config.LOGGING_CONFIGĮxtra_logger_names = connexion,sqlalchemyĬolored_log_format = įrom import PythonOperatorįrom kubernetes.client import models as k8s
0 Comments
Leave a Reply. |