Find an efficient way to save data - Githubissues

Wyko / netcrawl

Netcrawl is a tool designed to discover and poll one or more devices, inventory them, and then provide useful data on the processed devices.

http://netcrawl.readthedocs.io

54 stars 10 forks source link

Find an efficient way to save data #3

Closed Wyko closed 7 years ago

Wyko commented 7 years ago

[ ] Come up with a save format
[ ] Find out how to retrieve the data too

Wyko commented 7 years ago

XML by itself would be a slow way to do it. Having one database that contains everything would have to be fully rewritten each time it gets changed. With multiple calls a second, that's unacceptable.

Wyko commented 7 years ago

Sql was recommended as a good database format. SQLLITE?

Wyko commented 7 years ago

Potential solution: individual files for each device, organized by an index file which contains IP, serial, hash info.

Wyko commented 7 years ago

Postgresql was the final solution