Ant target to set up environment for manually testing through Splunk

[petterik]

Create ant target(s) that set up Splunk and the archiver for manually tests, that goes through Splunk.

By testing through Splunk means that data is added to a Splunk index, and when the data is rolled, the data gets archived by the archiver. This could be useful for testing different configurations or even make automatic tests later.

What needs to be set up:

1. Run ant splunk-setup
2. Copy archive-configration to installed shuttl.
3. Create an index that rolls fast.

Requirements:

• The archive should be using the local file system to avoid the Hadoop setup.
• It needs to be easy to teardown/delete/clean any data that is archived when done testing.
• The set up should be extensible, so it's easy to add new configurations.
• The manual-test index should be configured to roll to frozen fast.

[petterik]

Manual testing can be done by using the ant commands: ant manual-test-format-splunk-bucket ant manual-test-format-csv

There's also a script that oneshots data into Splunk until interrupted at: splunk-shuttl/test/sh/manual-test/add-oneshot-1MB-files-to-splunk.sh

The data is archived into splunk-shuttl/build-cache/local_archiver