Create a generic Preprocess step

meghajain-1711 / Polyglotter

Code for "Translating synthetic natural language to database queries: a polyglot deep learning framework"

0 stars 0 forks source link

Create a generic Preprocess step #5

Open meghajain-1711 opened 3 years ago

meghajain-1711 commented 3 years ago

Preprocessing and Random Queries Generation is currently distributed in various scripts. We are generalizing it to object oriented approach.

[x] Create one generic preprocessing script where generation of random queries and build vocab functions will be
[x] DBSchema scripts for each different dataset needs to be accumulated to one
[ ] Need to enhance the above single script to get parameters from config file

meghajain-1711 commented 3 years ago

DBSchema accumulated to one has been updated to be kept as different. Need to think/agree on whether to keep it/as it is OR One class that has mehotds for both GetDBSchema and GetDBQuery but is DB specific And user can create child to superclass