search

Icinga / icingaweb2-module-fileshipper

Provide CSV, JSON, XML and YAML files as an Import Source for the Icinga Director and optionally ship hand-crafted additional Icinga2 config files
https://icinga.com/docs/director/latest/fileshipper/doc/02-Installation/
GNU General Public License v2.0
27 stars 13 forks source link

Huge database tables #39

Open flohoff opened 1 year ago

flohoff commented 1 year ago

Hi, we have fileshipper running for an automated Netbox -> Icinga2 export for a multitude of objects like switches, switch interfaces, PDUs, Firewalls and stuff.

Importing the files took longer and longer which is astonishing as the amount of objects didnt change. Today i had a look at the database tables and i was baffled:

i2director=# select count(*) from imported_row;
  count  
---------
 1179641
(1 row)

i2director=# select count(*) from imported_row_property;
  count  
---------
 6823277
(1 row)

I import around 150-180 devices with a total of 1000 objects, so my impression is that there is no cleanup/expire of old objects happening.

flohoff commented 5 months ago

Still growing - and the fileshipper tables are by now ~12GB in size which is ~98% of all icinga director tables.

 imported_property                     | 4633 MB        |       4570234880
 imported_row_property                 | 5641 MB        |       2289041408
 imported_rowset_row                   | 1265 MB        |        443850752
 imported_row                          | 514 MB         |        289652736