Open raboof opened 11 months ago
Instead of placing it on disk as 231006 files, we might want to cache a 'processed' blob in a single file. This might be faster to ingest. Format could range from a JSON blob to something like a sqlite database.
Instead of placing it on disk as 231006 files, we might want to cache a 'processed' blob in a single file. This might be faster to ingest. Format could range from a JSON blob to something like a sqlite database.