DTUComputeCognitiveSystems / deep_detektor

Automated Factual-Claim Detection in Danish Broadcasting
Other
2 stars 0 forks source link

Data storage #6

Closed sfvnielsen closed 6 years ago

sfvnielsen commented 6 years ago

Where should we keep the data?

And what database should we use? SQL?

NorthGuard commented 6 years ago

At the moment we have CSV-files, where everything is loaded into the RAM at the same time. This does not scale very well, but our data is currently very small. Migrating tensor_provider to use SQL is not too cumbersome, and I'll gladly do it if needed.