search

cityindex-attic / logsearch-purge-bot

Purges data from LogSearch
Apache License 2.0
0 stars 1 forks source link

Not all data in old indexes is being deleted #7

Closed mrdavidlaing closed 10 years ago

mrdavidlaing commented 10 years ago

Consider data stored on 11 Aug 2013 - http://logsearch.cityindextest5.co.uk/#dashboard/temp/vBlwcs4dROKhpxYz876ZDQ

This should have been deleted, but hasn't been.

dpb587 commented 10 years ago

It is coming from D:/Websites/_AppMetricsData/CiapiLatencyCollector/2013-08-11 02_06_22.7fcc6942-e025-4c9d-a19a-a64a9e3785d7.txt. I suspect @fandrei was using the file for testing and imported it after the latest purge?

mrdavidlaing commented 10 years ago

This dashboard http://logsearch.cityindextest5.co.uk/#dashboard/temp/qgoaxEfBQnCZ0gdr9sJddg showing a pie of type would support your theory - all the indexes still there from before 27 Sept 2013 are for _type:ci_appmetrics

image

mrdavidlaing commented 10 years ago

I'm going to force a purge now - 07 Nov 2013 16:55 UTC

mrdavidlaing commented 10 years ago

Ok, purge done - http://logsearch.cityindextest5.co.uk/#dashboard/temp/BREgyplgQiKMjlMv5rimpA

image

But records still there - http://logsearch.cityindextest5.co.uk/#dashboard/temp/C_OiRxxQT2ypTB1HtiVLkA

image

I don't think its a case of @fandrei importing data after its been deleted, I think the data isn't being deleted for some reason

fandrei commented 10 years ago

I haven't made any tests with old data last few days.

mrdavidlaing commented 10 years ago

@fandrei - Thanks for confirming that.

If you do ship in any old data whilst @bitpusher is trying to resolve this issue, please could you just drop everyone a note in the flow.

fandrei commented 10 years ago

ok

sopel commented 10 years ago

Closed as Won't Fix due to project being retired to the CityIndex Attic.