Implementation of synthetic table data

sambanova / ai-starter-kit

Other

81 stars 29 forks source link

Closed snova-codym closed 1 month ago

snova-codym commented 2 months ago

This update will:

Allow for the generation of synthetic table images from modified tsv formatted tables.
Create qa pairs for table qa.
Create ocr prompts and completions.

More functionality will likely need to be extended, such as more control over image augmentations.

snova-luiss commented 1 month ago

Minor suggestions:

Make sure to add output files to the .gitignore (images, json, sec_data, pt, aux, etc)
Add system dependencies to the readme

snova-codym commented 1 month ago

@snova-luiss Thanks - I will do both of these things tomorrow AM.

snova-codym commented 1 month ago

I have:

updated the git ignore to not track artifacts
Mentioned the need for Latex for the kit, with a mac reference for install
fixed some minor issues in yoda/llava_data_prep/scripts/create_synthetic_tables.py from ruff/mypy.