[ALL] [Enhancement] Add validate data step - Githubissues

TheLion-ai / UMIE_datasets

Creative Commons Attribution 4.0 International

33 stars 1 forks source link

[ALL] [Enhancement] Add validate data step #90

Open A-Huli opened 2 months ago

A-Huli commented 2 months ago

Add ValidateData step

Create a new step for validating UMIE output data at the end of the pipeline
Add this step as the last step in all of the pipelines
Fix minor issues for processing entire dataset
Add pandas to huggingface_cli to solve the issue with data types