Log only to console - Githubissues

bcgov / cas-helm

Exploration of Helm 3 on OpenShift

0 stars 0 forks source link

Log only to console #7

Closed dleard closed 4 years ago

dleard commented 4 years ago

Adds modified code from https://github.com/puckel/docker-airflow to docker folder
change all logger handlers to 'console'
follows / adapts instructions from https://github.com/apache/airflow/blob/1e3cdddcd87be3c0f11b43efea11cdbddaff4470/docs/howto/write-logs.rst
Instructions under 'Writing logs to Azure Blob Storage'

dleard commented 4 years ago

The changes to values.yaml in cas-airflow appears to copy everything to $Home/dags, so that we have all contents of $Home in the dags folder, and then the dags are in $Home/dags/dags

wenzowski commented 4 years ago

yes that sounds expected; we'll need to update the volume itself to move the dags up a folder level (and remove the home folder files from the volume)

dleard commented 4 years ago

It appears sending tasks directly to the console handler doesn't work. It needs some extra processing. Attempting to use the elasticsearch handler to stream to stdout. https://github.com/GoogleCloudPlatform/airflow-operator/issues/72