no10ds / rapid

Project rAPId
https://rapid.readthedocs.io/en/latest/
MIT License
23 stars 6 forks source link

Column schema - new optional attribute "dropdown" & "allow_duplicates" #82

Open Jarek-Rolski opened 7 months ago

Jarek-Rolski commented 7 months ago

New attribute dropdown defines possible values for column values. Validation method ignores null values in column. Error message returns list of values that are not allowed, and dropdown list. Test for schema and dataset with dropdown is passed. Default value is "None"

New attribute allow_duplicates defines if column allows duplicated values. Validation method ignores null values in column. Error message returns columns names with duplicated values. Test for schema and dataset with allow_duplicates is passed. Default value is "True"

I made check for old schemas without new attributes. After retrieval from DynamoDB, parser adds new attributes to schema. It prevents errors caused by schema update. I updated dynamoDB adapter test to new schema.