Cocoon-Data-Transformation / cocoon

MIT License
65 stars 8 forks source link

error when excluding columns #5

Closed brsolo closed 2 months ago

brsolo commented 2 months ago

CreateColumnGrouping() sometimes fails if certain columns are excluded in DecideProjection()

To reproduce, run the workflow on patients.csv and exclude all but the first four columns

image

ValueError: Validation failed with the following error(s):
Extra attributes: id
Missing attributes: Id
 Are attributes in the leaf as an array [att1, att2]?
zachary62 commented 2 months ago

This is expected because LLM refers to "Id" as "id". The solution is to disable the cache and let the LLM retry.

zachary62 commented 2 months ago

https://github.com/Cocoon-Data-Transformation/cocoon/commit/2e8979138d65f053012fd9b96d5018aaf5739054 The above commit implements trials for the column group