docid_to_date discards useful file path information

JustinAzoff / netflow-indexer

A program that uses xapian to index the flat file databases used by nfdump or flow-tools

http://justinazoff.github.com/netflow-indexer/

36 stars 4 forks source link

Open JustinAzoff opened 13 years ago

JustinAzoff commented 13 years ago

a filename like

turn /data/nfsen/profiles/live/podium/nfcapd.2009030110

gets turned into

"2009-03-01 10:00"

but the path contained potentially useful information like profile='live' and source='podium'

I need to replace doc_id_to_date with something that keeps this information

JustinAzoff commented 13 years ago

50% complete. Backend support was added in 6d986a1ab55f2ed0d9d2ee03e61772942a71a896

'pathregex' is the new configuration option that can either be a real regex or a simple string like profiles/:profile/:source/

Remaining now is support in the CLI and CGI for controlling what fields are output

JustinAzoff commented 13 years ago

CLI support added in 611b2e5311defa82bc94ef27b2cf419d79607e01

JustinAzoff commented 13 years ago

TODO: web interface