search

OpenTSDB / opentsdb

A scalable, distributed Time Series Database.
http://opentsdb.net
GNU Lesser General Public License v2.1
4.99k stars 1.25k forks source link

Spark Datasource API for OpenTSDB #1104

Open nch14 opened 6 years ago

nch14 commented 6 years ago

emmm, this project is a great one. However, current http-api may be its weakness to load a large number of data (and analyze).

Will opentsdb provide something like jdbc or a official solution with Spark?

Best regards!

IDerr commented 6 years ago

Hi @nch14 you can check this gist : https://gist.github.com/bobrik/81748aaec4c349b736e8a103d1515103

It provides a RDD interface for opentsdb.

Regards,

nch14 commented 6 years ago

emmmmm, still willing to see an offical driver that implements Spark's DataSource api, i am quite sure that will make OpenTSDB better.

Thanks a lot!

IDerr commented 6 years ago

@nch14 you should let this issue open, in case if someone is willing to do it :)

johann8384 commented 6 years ago

I've added the feature-request label and re-opened the item. It seems like it could be valuable to have a class which implements this API and provides access to OpenTSDB data using our code. This would be the best way to maintain compatibility with our schema as it evolves.

fabiana001 commented 6 years ago

We are using this: https://github.com/teamdigitale/spark-opentsdb

nch14 commented 6 years ago

@fabiana001 I noticed that before and really wish it had a more detailed readme file