search

ptarmiganlabs / butler-spyglass

Utility for extracting data lineage and load scripts for all applications in a Qlik Sense Enterprise environment
https://ptarmiganlabs.com
MIT License
13 stars 2 forks source link

Store extracted info to disk as it is retrieved from Sense engine #2

Closed mountaindude closed 5 years ago

mountaindude commented 5 years ago

Consider writing the retrieved info to disk as it becomes available. This would reduce the impact of Butler Spyglass crashing late during an extraction run. It would also allow the generated files to be immediately inspected.

Could be a good idea to create/delete files in the out-folder to indicate whether an extraction run is ongoing or done.

mountaindude commented 5 years ago

Implemented in acb7fd2a1c683fae0a4e1f174a03247f9cd8188d