dosaboy / searchkit

Apache License 2.0
2 stars 3 forks source link

SequenceSearchDef: report file search progress on debug log #16

Open mustafakemalgilor opened 5 months ago

mustafakemalgilor commented 5 months ago

shorten the search file name to just parent_folder/filename and also print the search def tags before the search, so we can tell which search is currently being run.

Example log output:

2024-05-09 14:03:14,667 268633 DEBUG searchkit [-] starting search of /workspace/case-data/test/sosreport-juju-4b6be0-3-lxd-13-00359298-2023-05-02-tiaplar/var/log/neutron/neutron-server.log.1 (offset=0, pos=0) for tags [{'openstack.neutron.ovndb_leader_bouncing.checks.has_nbdb_log.check.search', 'openstack.neutron.ovn_stale_db.checks.has_1829109_neutron_log.check.search', 'openstack.neutron.ovndb_leader_bouncing.checks.has_sbdb_log.check.search', 'openstack.neutron.bugs.lp1993628.checks.logs.check.search', 'openstack.neutron.bugs.lp1980211.checks.has_ovsdb_reconnection_errors.check.search', 'openstack.neutron.bugs.lp1948466.checks.has_1948466.check.search', 'openstack.neutron.bugs.lp1960319.checks.has_1960319_log.check.search'}]
2024-05-09 14:03:14,667 268632 DEBUG searchkit [-] starting search of /workspace/case-data/test/sosreport-juju-4b6be0-3-lxd-13-00359298-2023-05-02-tiaplar/var/log/neutron/neutron-server.log (offset=0, pos=0) for tags [{'openstack.neutron.ovndb_leader_bouncing.checks.has_nbdb_log.check.search', 'openstack.neutron.ovn_stale_db.checks.has_1829109_neutron_log.check.search', 'openstack.neutron.ovndb_leader_bouncing.checks.has_sbdb_log.check.search', 'openstack.neutron.bugs.lp1993628.checks.logs.check.search', 'openstack.neutron.bugs.lp1980211.checks.has_ovsdb_reconnection_errors.check.search', 'openstack.neutron.bugs.lp1948466.checks.has_1948466.check.search', 'openstack.neutron.bugs.lp1960319.checks.has_1960319_log.check.search'}]
/*...*/
2024-05-09 14:03:18,280 268632 DEBUG searchkit [-] 100000 lines searched in neutron/neutron-server.log (0.304459%)