[partial] TSDB Proxy Client

[at15]

Related #15 #18

Util

• [x] requests, a python requests like wrapper for HTTP. May merge back into Ayi when its runner pr is finished 69cbc8f006877be345f1516a0ee8ba3dfb77273a

Improve docker image

• [ ] use unified naming prefix
• [ ] scripts for recycling unused container and images

Command

• [x] ping

KairosDB

• [ ] payload (partly finished in #14 )
  • [x] no compress
  • [ ] group by series
  • [ ] gzip
• [ ] client (only have a put method that cast the payload, but do nothing)
  • [x] ping `tsdb-proxy ping --db kairosdb --host localhost --port 8080
  • [ ] write data to server using one http client
  • [ ] write data to server with multiple http client
  • [ ] track time
  • [ ] report (use another goroutine to pull?)
• [ ] server write: accept write request
• [ ] * server read: accept read request and shard
• [ ] mock server for test

InfluxDB

• [ ] payload (line protocol?)
• [ ] client
  • [x] ping tsdb-proxy ping --db influxdb --host localhost --port 8086

OpenTSDB

• [ ] client
  • [x] ping tsdb-proxy ping --db opentsdb --host localhost --port 4242

[at15]

the thing is, I lost some commit for testing the KairosDB client because I was thinking about adding a flag so tests require KairosDB running can be disabled on travis. So I didn't push them to remote and re installed my PC. The lost part should be a method to generate test payload and a test to query the test payload against a running KairosDB, also I noticed the at least one tag issue from KairosDB

[at15]

Got error when try to use the flag checked added in 0046976, it causes an important cycle, and actually this test is no longer a unit test, it's an integration test that test most functions of KairosDBHTTPClient, (could be e2e maybe) so I think I need a sub package called integration inside kairosdb or just instead tsdb

• also could add a flag call integeration http://stackoverflow.com/questions/25965584/separating-unit-tests-and-integration-tests-in-go
• Found a blog about glong test via so http://peter.bourgon.org/go-in-production/#testing-and-validation
• Also may consider using context in test, a example is https://github.com/GoogleCloudPlatform/golang-samples/blob/master/internal/e2e/flexible_test.go it is using x/net/context but I guess in 1.7 context is already a top level package

[at15]

[at15]

LGTM

Though most goal of this PR is not finished., but they should be split to more fine grained PR

• test using go 1.7 context
• trace for client
• docker
• report metrics
• mock server (could also be used for proxy server implementation)