search

waterslideLTS / waterslide

WaterSlide is a streaming event-at-a-time architecture for processing metadata. It is designed to take in a set of streaming events from multiple sources, process them through a set of modules ("kids"), and return meaningful outputs.
Other
113 stars 40 forks source link

modifications and patches to existing processing #23

Closed Karl-MS closed 4 years ago

Karl-MS commented 4 years ago

waterslide_users_guide.tex: added use of environment variables in waterslide scripts waterslide_users_guide.pdf: recompiled pdf with added documentation on use of environment variables fileout.c - fixed bug to not close out completed file if writing stdout or stderr proc_asciihex.c - added additional options for parsing partial hex strings proc_combinestrings.c - added output option to force output to ascii string proc_csv_in.c - added option to read entire line as a string for easier input parsing proc_denest.c - added option to extract into a subtuple proc_exactmatch.c - removed shared table option it was not implemented proc_fillmissing.c - added support for nested tuples proc_firstn.c - fixed crashes when attempting to free empty tables proc_fixedmatch.c - was not working, added code to make it work as intended proc_kafka_in.c - swapped out error reporting funciton as existing method was depricated proc_keytime.c - fixed purpose documentation proc_label.c - added ability to create a pointer and attach to root tuple proc_match.c - added additional tagging options when matching proc_print.c - added json output and json labeling options, added print to STDERR proc_re2.c - added option for ascii string output and extraction to nested output proc_uniq.c - added support for hashing nested objects, fixed crash on destroy proc_uniqexpire.c - fixed crash on destroy for empty tables proc_untiln.c - fixed crash on destroy for empty tables proc_workbalance.c - fixed crash on destroy for empty objects proc_workreceive.c - fixed crash on destroy

quizdoge commented 4 years ago

Thanks so much for all of this work. Apologies for the delay--I had some issues accessing my account and it took too long to resolve.

I'm reviewing now.