zazuko / cube-creator

A tool to create RDF cubes from CSV files
GNU Affero General Public License v3.0
11 stars 2 forks source link

Transformation shows as success, but pipeline fails #1443

Open CDiGallo opened 1 year ago

CDiGallo commented 1 year ago

Describe the bug

Affected functionalities (all that apply)

Relevant links This is the failed job: https://gitlab.ldbar.ch/pipelines/cube-creator/-/jobs/58315 This corresponds to: https://int.cube-creator.lindas.admin.ch/app/cube-projects/cube-project!!shared-municipalities-test-njjzxmgyp5e/materialize/jobs/cube-project!!shared-municipalities-test-njjzxmgyp5e!!jobs!!l4Kxehs0V7JGialeHUw7t

Expected behavior We see an error in Cube-Creator

Screenshots

Desktop (please complete the following information):

Additional context

tpluscode commented 1 year ago

Hello. Have you shared the right link? Both above are actually success (if you overlook the warning about code list)

tboeni commented 11 months ago

Hello @tpluscode and @CDiGallo

I would like to piggyback a little bit on this issue. I am experiencing some transformation issues as well. For example for this Cube the transformation will fail / time out Link , when done with the full csv. (ca. 450k rows) and all the shared dimensions which are active in the cube right now. When done with a file of approx. 1/4 of the size of the original csv, the transformation runs and finishes properly Link, likewise it works if I remove one of the shared dimensions for a new transformation but use the big csv Link

Is there a way to fix this memory issue?

Best Tobi