Closed jopietsch closed 3 years ago
inside coalesced/ifCounters, the blank namespace is much bigger than the others.
(suzieq-QZqWZG2D-py3.8) jpietsch@jpietsch-server:~/parquet-out/coalesced/ifCounters/sqvers=1.0/namespace=$ du -hs ~/parquet-out/coalesced/ifCounters/sqvers\=1.0/*
4.2G /home/jpietsch/parquet-out/coalesced/ifCounters/sqvers=1.0/namespace=
7.1M /home/jpietsch/parquet-out/coalesced/ifCounters/sqvers=1.0/namespace=dual-bgp
202M /home/jpietsch/parquet-out/coalesced/ifCounters/sqvers=1.0/namespace=dual-evpn
5.6M /home/jpietsch/parquet-out/coalesced/ifCounters/sqvers=1.0/namespace=eos
5.7M /home/jpietsch/parquet-out/coalesced/ifCounters/sqvers=1.0/namespace=junos
5.6M /home/jpietsch/parquet-out/coalesced/ifCounters/sqvers=1.0/namespace=nxos
7.0M /home/jpietsch/parquet-out/coalesced/ifCounters/sqvers=1.0/namespace=ospf-ibgp
5.7M /home/jpietsch/parquet-out/coalesced/ifCounters/sqvers=1.0/namespace=ospf-single
20M /home/jpietsch/parquet-out/coalesced/ifCounters/sqvers=1.0/namespace=single
9.3M /home/jpietsch/parquet-out/coalesced/ifCounters/sqvers=1.0/namespace=single-evpn
Fixed via commit 32265e8cf757a3bcaf90b39cc99dbd97321dbe16 and 528168648de6e1a77017085755f2605ad6078c90
Describe the bug in both ifCounters and ospfIf, there is a blank namespace. Inside those two blank namespaces, each parquet file is larger then the last. So the parquet file written at 17:36 is bigger than the file written at 16:35, and so on. Each new file is bigger than the previous, as if it is one table that keeps growing.
In ifCounters it starts at 13778 bytes, and keeps growing, and then resets back to 13778
I noticed because my coalesced directory is much bigger than my _archived directory