search

ptarmiganlabs / butler-spyglass

Utility for extracting data lineage and load scripts for all applications in a Qlik Sense Enterprise environment
https://ptarmiganlabs.com
MIT License
13 stars 2 forks source link

Truncate Discriminator and Statement fields before storing to disk #14

Closed mountaindude closed 5 years ago

mountaindude commented 5 years ago

Especially the discriminator field can become extremely large (tens of megabytes or more) when data is read from large inline tables. Realistically all interesting info will be found early in these fields => truncate then to 1000 chars before storing to disk.

mountaindude commented 5 years ago

Fixed in b92018e449dcfe7053d3b6d51ff6634e4b123117