search

y-scope / clp

Compressed Log Processor (CLP) is a free log management tool capable of compressing logs and searching the compressed logs without decompression.
https://yscope.com
Apache License 2.0
877 stars 70 forks source link

How to remove clp file via management console? #597

Open dkhwangbo opened 1 week ago

dkhwangbo commented 1 week ago

I can read compressed data with below.

  1. compress raw log with sbin/compress.sh
  2. Open 'search' page of web UI
  3. Search, and read specific row with log-viewer

To remove compressed data, delete all file within archive_output directory and ir_output directory. And then, Open 'search' page of webUI again, and search with '*' . Then I got error.

Any document or best practice about it? How to remove specific (not all) clp file without error?

kirkrodrigues commented 1 week ago

Hey @dkhwangbo,

To remove compressed data, delete all file within archive_output directory and ir_output directory. And then, Open 'search' page of webUI again, and search with '*' . Then I got error.

Ah, that's an unsupported use case since the metadata for those archives would still exist in the database. We will be improving CLP's robustness for cases like this, but it will remain an error since missing data is not something we want to hide from the user.

How to remove specific (not all) clp file without error?

CLP doesn't currently have support for deleting a single file from the archives, although it's something we could support.

To clarify, do you want to delete a compressed file based on its original file path (i.e., the path that was initially passed to compress.sh)?

dkhwangbo commented 1 week ago

@kirkrodrigues Hi. Thanks for your reply. I want to remove 'compressed file'. (result of compress.sh)