Open caiocampoos opened 4 months ago
Another issue i have encounter is to recreate our Jest cache, on CircleCI we are able to cache Jest, yarn and webpack in a persistent volume, there is a way to achieve a something similar with Tekton pipelines, can workspaces persist between pipelineRuns?
@caiocampoos Can you post a cache example?
@caiocampoos Can you post a cache example?
https://dev.to/woovi/how-to-automate-tests-with-tekton-3caj
I wrote an article that shows an example with cache in the PipelineRun of a triggerTemplate. You have to create a pvc and declare as workspace.
From there you can pass to the pipelines and tasks. You can pass this workspace to the task as optional to make it easy.
Currently we are trying to migrate from CircleCI to tekton on a self hosted environment. The initial implementation was great but we are currently having issues while trying to scale our pipelines.
We have 2 monorepos with about 5 to 4k tests in each one using jest. A pipeline run with 20% to 30% of our tests runs about 5-6 minutes
When we run full tests we get something close to 20 minutes. I am currently after resources that helmp me optimize our operation, how to approach scaling issues.
This is one of our pipelines, we currently have 6 services to build and deploy and about 25 packages from witch we run tests.
Some testing:
Two pipelines with ~50% load difference running each at a time, similar times: This is 10% of our tests
20-30% woovi server test packages:![Screenshot 2024-02-20 at 23 01 19](https://github.com/entria/woovi/assets/27910850/b1e593c3-0016-4c18-9f81-4e826d3d725c)
The impact in performance is when running multiple pipelines at the same time:
I would appreciate any help if possible.