apache / incubator-devlake

Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.
https://devlake.apache.org/
Apache License 2.0
2.51k stars 493 forks source link

[Bug][CircleCI] CircleCI regex is not working to collect data #7563

Open chrisolido opened 1 month ago

chrisolido commented 1 month ago

Search before asking

What happened

When configuring the scope config the regex is not working

image

What do you expect to happen

It should collect data and show in DORA metrics.

How to reproduce

Go to - project - connections - scope config - transformations

image

No data collected when run. image

Anything else

This is present since the installation.

Version

v0.21.0@ac4f7fe

Are you willing to submit PR?

Code of Conduct

dosubot[bot] commented 1 month ago

The CircleCI regex configuration in DevLake might not be working correctly because the regular expressions provided in the deploymentPattern and productionPattern fields might not match any of the CircleCI workflow or job names.

Ensure that the regular expressions you are using in the deploymentPattern and productionPattern fields accurately match the names of your CircleCI workflows or jobs. For example:

<Input
  style={{ width: 200, margin: '0 8px' }}
  placeholder="(deploy|push-image)"
  value={transformation.deploymentPattern ?? ''}
  onChange={(e) =>
    onChangeTransformation({
      ...transformation,
      deploymentPattern: e.target.value,
      productionPattern: !e.target.value ? '' : transformation.productionPattern,
    })
  }
/>

If the names of your workflows or jobs do not match the regex (deploy|push-image), then no data will be collected. Similarly, ensure that the productionPattern is also correctly set to match the intended production deployments:

<Input
  style={{ width: 200, margin: '0 8px' }}
  placeholder="prod(.*)"
  value={transformation.productionPattern ?? ''}
  onChange={(e) =>
    onChangeTransformation({
      ...transformation,
      productionPattern: e.target.value,
    })
  }
/>

Double-check the actual names of your CircleCI workflows and jobs and adjust the regex patterns accordingly [1].

To continue talking to Dosu, mention @dosu.

klesh commented 1 month ago

Hi, can you check if there is any records in the cicd_pipelines and cicd_deployments tables?

klesh commented 1 month ago

It seems to working fine on my local machine:

image

image