Overview

This component parses log files from other components and converts their logs to prometheus metrics that are then ingested by the monitoring Prometheus instance (the one created by thecomponents/monitoring component).

For more information on how this component reads log files and converts them to prometheus components see the log-parser documentation.

To configure this component:

set the PROMETHEUS_LOG_PARSER_POLL_DELAY variable to a number of seconds to set how often the log parser checks if new lines have been added to log files (default: 1)
set the PROMETHEUS_LOG_PARSER_TAIL variable to "true" to only parse new lines in log files. If unset, this will parse all existing lines in the log file as well (default: "true")

To view all metrics exported by the log parser:

Navigate to the https://<BIRDHOUSE_FQDN>/prometheus/graph search page
Put {job="log_parser"} in the search bar and click the "Execute" button

Update the prometheus version to the current latest v2.53.3. This is required to support loading multiple prometheus scrape configuration files with the scrape_config_files configuration option.

Changes

Non-breaking changes

New component version prometheus:v2.53.3

Breaking changes

None

Related Issue / Discussion

Additional Information

implements parser given as an example here: https://github.com/bird-house/birdhouse-deploy/issues/444#issuecomment-2394510561
this is an alternative to #474. See discussion in #444 to help decide which we should pick.

CI Operations

birdhouse_daccs_configs_branch: master birdhouse_skip_ci: false

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/2870/
Result :white_check_mark: SUCCESS

BIRDHOUSE_DEPLOY_BRANCH : prometheus-log-parser
DACCS_IAC_BRANCH : master
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-216.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/1735/

NOTEBOOK TEST RESULTS

    
[2024-11-05T21:31:48.950Z] ============================= test session starts ==============================
[2024-11-05T21:31:48.950Z] platform linux -- Python 3.11.6, pytest-8.2.0, pluggy-1.5.0
[2024-11-05T21:31:48.950Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master
[2024-11-05T21:31:48.950Z] plugins: anyio-4.3.0, dash-2.17.0, nbval-0.11.0, tornasync-0.6.0.post2, xdist-3.5.0
[2024-11-05T21:31:48.950Z] collected 301 items
[2024-11-05T21:31:48.950Z] 
[2024-11-05T21:31:57.708Z] notebooks-auth/geoserver.ipynb ..................                        [  5%]
[2024-11-05T21:33:02.127Z] notebooks-auth/test_cowbird_jupyter.ipynb ..........                     [  9%]
[2024-11-05T21:33:02.127Z] notebooks-auth/test_thredds.ipynb ...........                            [ 12%]
[2024-11-05T21:33:51.340Z] pavics-sdi-master/docs/source/notebooks/CaSR_basic.ipynb ......          [ 14%]
[2024-11-05T21:34:01.248Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [ 17%]
[2024-11-05T21:34:11.724Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [ 19%]
[2024-11-05T21:42:16.986Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ............        [ 23%]
[2024-11-05T21:42:16.986Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-climate-stations.ipynb . [ 23%]
[2024-11-05T21:42:19.496Z] ...............                                                          [ 28%]
[2024-11-05T21:42:27.202Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-xclim.ipynb .....    [ 30%]
[2024-11-05T21:42:34.847Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb .......           [ 32%]
[2024-11-05T21:42:50.592Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 34%]
[2024-11-05T21:42:56.309Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 36%]
[2024-11-05T21:43:00.558Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 38%]
[2024-11-05T21:45:59.194Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 43%]
[2024-11-05T21:47:03.880Z] .............                                                            [ 47%]
[2024-11-05T21:47:07.970Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 49%]
[2024-11-05T21:47:09.751Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 51%]
[2024-11-05T21:47:25.275Z] .................                                                        [ 57%]
[2024-11-05T21:47:32.880Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb ......          [ 59%]
[2024-11-05T21:47:33.821Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 59%]
[2024-11-05T21:47:51.112Z] .........                                                                [ 62%]
[2024-11-05T21:47:59.317Z] finch-master/docs/source/notebooks/dap_subset.ipynb ...........          [ 66%]
[2024-11-05T21:48:08.687Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 68%]
[2024-11-05T21:48:10.100Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 68%]
[2024-11-05T21:48:13.496Z] .....                                                                    [ 70%]
[2024-11-05T21:48:31.670Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 70%]
[2024-11-05T21:48:49.702Z] ............                                                             [ 74%]
[2024-11-05T21:49:11.669Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 75%]
[2024-11-05T21:49:36.789Z] .....s.                                                                  [ 77%]
[2024-11-05T21:49:43.383Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 77%]
[2024-11-05T21:50:00.879Z] ..                                                                       [ 78%]
[2024-11-05T21:50:07.498Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 78%]
[2024-11-05T21:51:09.311Z] .........                                                                [ 81%]
[2024-11-05T21:51:19.325Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-6Regridding_Conversion.ipynb . [ 82%]
[2024-11-05T21:56:10.284Z] ....                                                                     [ 83%]
[2024-11-05T21:56:12.836Z] PAVICS-landing-master/content/notebooks/hydrology/PAVICStutorial_Hydrology-01_Intro.ipynb . [ 83%]
[2024-11-05T21:56:18.580Z] ....                                                                     [ 85%]
[2024-11-05T21:56:22.788Z] PAVICS-landing-master/content/notebooks/hydrology/PAVICStutorial_Hydrology-02_Calibration.ipynb . [ 85%]
[2024-11-05T21:56:28.034Z] .....                                                                    [ 87%]
[2024-11-05T21:56:32.261Z] PAVICS-landing-master/content/notebooks/hydrology/PAVICStutorial_Hydrology-03_Watershed_properties.ipynb . [ 87%]
[2024-11-05T21:56:44.897Z] .............                                                            [ 91%]
[2024-11-05T21:56:49.114Z] PAVICS-landing-master/content/notebooks/hydrology/PAVICStutorial_Hydrology-04_Time_series_analysis.ipynb . [ 92%]
[2024-11-05T21:56:50.734Z] ......                                                                   [ 94%]
[2024-11-05T21:56:53.173Z] notebooks/hummingbird.ipynb ............                                 [ 98%]
[2024-11-05T21:59:26.905Z] notebooks/stress-tests.ipynb ......                                      [100%]
[2024-11-05T21:59:26.905Z] 
[2024-11-05T21:59:26.905Z] =============================== warnings summary ===============================

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/2876/
Result :x: FAILURE

BIRDHOUSE_DEPLOY_BRANCH : prometheus-log-parser
DACCS_IAC_BRANCH : master
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-216.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/1738/

NOTEBOOK TEST RESULTS

    
[2024-11-08T18:17:20.566Z] ============================= test session starts ==============================
[2024-11-08T18:17:20.566Z] platform linux -- Python 3.11.6, pytest-8.2.0, pluggy-1.5.0
[2024-11-08T18:17:20.566Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master
[2024-11-08T18:17:20.566Z] plugins: anyio-4.3.0, dash-2.17.0, nbval-0.11.0, tornasync-0.6.0.post2, xdist-3.5.0
[2024-11-08T18:17:20.566Z] collected 301 items
[2024-11-08T18:17:20.566Z] 
[2024-11-08T18:17:30.738Z] notebooks-auth/geoserver.ipynb ..................                        [  5%]
[2024-11-08T18:18:47.433Z] notebooks-auth/test_cowbird_jupyter.ipynb ..........                     [  9%]
[2024-11-08T18:18:53.631Z] notebooks-auth/test_thredds.ipynb ...........                            [ 12%]
[2024-11-08T18:19:41.257Z] pavics-sdi-master/docs/source/notebooks/CaSR_basic.ipynb ......          [ 14%]
[2024-11-08T18:19:52.579Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [ 17%]
[2024-11-08T18:20:02.611Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [ 19%]
[2024-11-08T18:27:40.366Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ............        [ 23%]
[2024-11-08T18:27:40.366Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-climate-stations.ipynb . [ 23%]
[2024-11-08T18:27:41.188Z] ...............                                                          [ 28%]
[2024-11-08T18:27:49.150Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-xclim.ipynb .....    [ 30%]
[2024-11-08T18:27:55.903Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb .......           [ 32%]
[2024-11-08T18:28:11.933Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 34%]
[2024-11-08T18:28:25.023Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 36%]
[2024-11-08T18:28:29.720Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 38%]
[2024-11-08T18:32:24.575Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 43%]
[2024-11-08T18:33:31.749Z] .............                                                            [ 47%]
[2024-11-08T18:33:34.482Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 49%]
[2024-11-08T18:33:35.998Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 51%]
[2024-11-08T18:33:54.470Z] .................                                                        [ 57%]
[2024-11-08T18:34:02.060Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb ......          [ 59%]
[2024-11-08T18:34:02.998Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 59%]
[2024-11-08T18:34:14.372Z] .........                                                                [ 62%]
[2024-11-08T18:34:24.944Z] finch-master/docs/source/notebooks/dap_subset.ipynb ...........          [ 66%]
[2024-11-08T18:34:33.677Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 68%]
[2024-11-08T18:34:35.058Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 68%]
[2024-11-08T18:34:38.695Z] .F...                                                                    [ 70%]
[2024-11-08T18:34:56.812Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 70%]
[2024-11-08T18:35:19.504Z] ............                                                             [ 74%]
[2024-11-08T18:35:37.621Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 75%]
[2024-11-08T18:36:05.290Z] .....s.                                                                  [ 77%]
[2024-11-08T18:36:11.883Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 77%]
[2024-11-08T18:36:26.924Z] ..                                                                       [ 78%]
[2024-11-08T18:36:35.065Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 78%]
[2024-11-08T18:37:37.200Z] .........                                                                [ 81%]
[2024-11-08T18:37:47.206Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-6Regridding_Conversion.ipynb . [ 82%]
[2024-11-08T18:42:45.812Z] ....                                                                     [ 83%]
[2024-11-08T18:42:45.812Z] PAVICS-landing-master/content/notebooks/hydrology/PAVICStutorial_Hydrology-01_Intro.ipynb . [ 83%]
[2024-11-08T18:42:46.649Z] ....                                                                     [ 85%]
[2024-11-08T18:42:50.867Z] PAVICS-landing-master/content/notebooks/hydrology/PAVICStutorial_Hydrology-02_Calibration.ipynb . [ 85%]
[2024-11-08T18:42:56.742Z] .....                                                                    [ 87%]
[2024-11-08T18:43:00.957Z] PAVICS-landing-master/content/notebooks/hydrology/PAVICStutorial_Hydrology-03_Watershed_properties.ipynb . [ 87%]
[2024-11-08T18:43:18.280Z] .............                                                            [ 91%]
[2024-11-08T18:43:22.494Z] PAVICS-landing-master/content/notebooks/hydrology/PAVICStutorial_Hydrology-04_Time_series_analysis.ipynb . [ 92%]
[2024-11-08T18:43:23.865Z] ......                                                                   [ 94%]
[2024-11-08T18:43:27.145Z] notebooks/hummingbird.ipynb ............                                 [ 98%]
[2024-11-08T18:46:01.310Z] notebooks/stress-tests.ipynb ......                                      [100%]
[2024-11-08T18:46:01.310Z] 
[2024-11-08T18:46:01.310Z] =================================== FAILURES ===================================

Oh and please also add a comment to https://github.com/bird-house/birdhouse-deploy/blob/11a589f04d560b07c1a180eb1e7436d5f61b532f/birdhouse/components/proxy/nginx.conf.template#L18 mentionning that if this proxy log format changes, have to update the corresponding regex in optional-components/prometheus-log-parser/config/thredds/prometheus-log-exporter.py.

I just have a question. I see you have logs in your generic log-parser. Where are those logs going to? To stdout which will be in docker logs output? How can we increase or decrease the logging level?

Yeah it goes to stdout by default but can be logged to a file by setting the LOG_PARSER_LOG_FILENAME variable. I don't think that sending it to a file makes sense in a dockerized environment though at the moment.

Log level can be set with an environment variable as well. I'll add in an option so that we can set it in the default.env file if you'd like by setting PROMETHEUS_LOG_PARSER_LOG_LEVEL.

Oh and please also add a comment to ...

There's already a comment by the regex but I'll add one in the nginx config file as well.

I don't think that sending it to a file makes sense in a dockerized environment though at the moment.

I wasn't asking for a log to file either. Logs going to docker logs <container-name> is fine, thanks.

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/2886/
Result :x: FAILURE

BIRDHOUSE_DEPLOY_BRANCH : prometheus-log-parser
DACCS_IAC_BRANCH : master
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-216.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/1744/

NOTEBOOK TEST RESULTS

    
[2024-11-14T14:42:43.222Z] ============================= test session starts ==============================
[2024-11-14T14:42:43.222Z] platform linux -- Python 3.11.6, pytest-8.2.0, pluggy-1.5.0
[2024-11-14T14:42:43.222Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master
[2024-11-14T14:42:43.222Z] plugins: anyio-4.3.0, dash-2.17.0, nbval-0.11.0, tornasync-0.6.0.post2, xdist-3.5.0
[2024-11-14T14:42:43.222Z] collected 301 items
[2024-11-14T14:42:43.222Z] 
[2024-11-14T14:42:52.529Z] notebooks-auth/geoserver.ipynb ..................                        [  5%]
[2024-11-14T14:44:22.439Z] notebooks-auth/test_cowbird_jupyter.ipynb ........F.                     [  9%]
[2024-11-14T14:44:22.439Z] notebooks-auth/test_thredds.ipynb ...........                            [ 12%]
[2024-11-14T14:45:07.473Z] pavics-sdi-master/docs/source/notebooks/CaSR_basic.ipynb ......          [ 14%]
[2024-11-14T14:45:17.097Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [ 17%]
[2024-11-14T14:45:25.844Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [ 19%]
[2024-11-14T14:52:44.405Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ............        [ 23%]
[2024-11-14T14:52:44.667Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-climate-stations.ipynb . [ 23%]
[2024-11-14T14:52:52.112Z] ...............                                                          [ 28%]
[2024-11-14T14:52:59.715Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-xclim.ipynb .....    [ 30%]
[2024-11-14T14:53:06.452Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb .......           [ 32%]
[2024-11-14T14:53:21.701Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 34%]
[2024-11-14T14:53:27.463Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 36%]
[2024-11-14T14:53:31.789Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 38%]
[2024-11-14T14:57:27.072Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 43%]
[2024-11-14T14:58:37.404Z] .............                                                            [ 47%]
[2024-11-14T14:58:39.320Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 49%]
[2024-11-14T14:58:41.104Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 51%]
[2024-11-14T14:58:58.560Z] .................                                                        [ 57%]
[2024-11-14T14:59:06.459Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb ......          [ 59%]
[2024-11-14T14:59:07.847Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 59%]
[2024-11-14T14:59:24.294Z] .........                                                                [ 62%]
[2024-11-14T14:59:33.531Z] finch-master/docs/source/notebooks/dap_subset.ipynb ...........          [ 66%]
[2024-11-14T14:59:41.950Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 68%]
[2024-11-14T14:59:43.338Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 68%]
[2024-11-14T14:59:46.418Z] .F...                                                                    [ 70%]
[2024-11-14T15:00:01.349Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 70%]
[2024-11-14T15:00:26.770Z] ............                                                             [ 74%]
[2024-11-14T15:00:44.913Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 75%]
[2024-11-14T15:01:08.601Z] .....s.                                                                  [ 77%]
[2024-11-14T15:01:16.754Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 77%]
[2024-11-14T15:01:33.581Z] ..                                                                       [ 78%]
[2024-11-14T15:01:40.186Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 78%]
[2024-11-14T15:02:43.385Z] .........                                                                [ 81%]
[2024-11-14T15:02:53.403Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-6Regridding_Conversion.ipynb . [ 82%]
[2024-11-14T15:07:52.046Z] ....                                                                     [ 83%]
[2024-11-14T15:07:52.047Z] PAVICS-landing-master/content/notebooks/hydrology/PAVICStutorial_Hydrology-01_Intro.ipynb . [ 83%]
[2024-11-14T15:07:54.539Z] ....                                                                     [ 85%]
[2024-11-14T15:07:59.844Z] PAVICS-landing-master/content/notebooks/hydrology/PAVICStutorial_Hydrology-02_Calibration.ipynb . [ 85%]
[2024-11-14T15:08:05.441Z] .....                                                                    [ 87%]
[2024-11-14T15:08:09.669Z] PAVICS-landing-master/content/notebooks/hydrology/PAVICStutorial_Hydrology-03_Watershed_properties.ipynb . [ 87%]
[2024-11-14T15:08:28.017Z] .............                                                            [ 91%]
[2024-11-14T15:08:34.625Z] PAVICS-landing-master/content/notebooks/hydrology/PAVICStutorial_Hydrology-04_Time_series_analysis.ipynb . [ 92%]
[2024-11-14T15:08:35.425Z] ......                                                                   [ 94%]
[2024-11-14T15:08:37.959Z] notebooks/hummingbird.ipynb ............                                 [ 98%]
[2024-11-14T15:11:13.337Z] notebooks/stress-tests.ipynb ....F.                                      [100%]
[2024-11-14T15:11:13.337Z] 
[2024-11-14T15:11:13.337Z] =================================== FAILURES ===================================

Yeah it goes to stdout by default but can be logged to a file by setting the LOG_PARSER_LOG_FILENAME variable. I don't think that sending it to a file makes sense in a dockerized environment though at the moment.

Wouldn't it be logged to file automatically because of logging: *default-logging with the specified compose?

x-logging: &default-logging
  driver: "json-file"
  options:
    max-size: "50m"
    max-file: "10"

Logging to file would be redundant, unless an alternate log representation is desired.

@fmigneault The logs are written to stdout in the container. The logging: *default-logging value tells docker how to store the logs (from the container's stdout) on the host.

Note that this update bumps the minor version since it creates a new component. If we move to a new tagging policy as described in #476 this would probably be a patch bump instead.

bird-house / birdhouse-deploy

Add the `prometheus-log-parser` optional component #473

Overview

Changes

Related Issue / Discussion

444

Additional Information

CI Operations

E2E Test Results

DACCS-iac Pipeline Results

PAVICS-e2e-workflow-tests Pipeline Results

E2E Test Results

DACCS-iac Pipeline Results

PAVICS-e2e-workflow-tests Pipeline Results

E2E Test Results

DACCS-iac Pipeline Results

PAVICS-e2e-workflow-tests Pipeline Results