Added functional batching and timeout retry mechanisms

[Miller-Kyle]

The batching wasn't working correctly and we now need to batch the number of records we send in each manifest ingest, or the service will complain the request was too large. We also were hanging when calling the storage api, so I added in a timeout and retry logic.