Closed paulrizzo closed 2 years ago
@paulrizzo Have you published a third party of this change I might be able to use? Twitter no longer actively maintains this project.
@bobber205 I have not published this to a repository so right now you would need to pull this change into a local version of master and built a snapshot from that. If others are interested I would like to split off of this project and clean up bunch of the legacy Twitter pieces that won't be valid after the end of this year anyways. This will allow us to clean up the interfaces and code quite a bit so its more maintainable moving forward.
@paulrizzo That's what I figured. no problem :)
Having a hell of a time publishing a local version, if you have any tutorials/reference guides to share I'd love to see them! <3
I'm a mostly FE/ruby guy, I don't know jack about Java and Maven.
@paulrizzo Are you using this library along with https://github.com/gnip/sample-kinesis-connector? Got any examples of how to use your changes with that library? Thanks! <3
@bobber205 If you pull this change into you local version you can run mvn clean install
to build the jar file. From there you just use as needed. I am not using the kinesis-connector but rather a custom implementation for managing connections and processing messages to the appropriate location. Unfortunately I cannot post this code because it's owned by the company I work for. If you are using PowerTrack kinesis seems like a good place to start, if you are consuming the firehose/compliance streams you'll need to write something more involved to manage the partitions and failover cases. Hope this helps
Not sure if you saw this @paulrizzo http://support.gnip.com/articles/updating-hbc-for-ptv2.html
I like your changes alot. I may end up using them! I will let you know if I do <3
Thanks for doing the work twitter doesn't want to do!
Good morning @paulrizzo
Have you had any issue with HttpUriRequest
trying to connect to the non secure port 80 version of the stream?
The url says https://gnip-stream.com/blah/blah but the IOException says connection to "http://gnip-stream.twitter.com" was refused.
Just putting it out there, in case you've seen it <3
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
This adds supports for the v2 GNIP volume and compliance streams. I also added in the new host URLs for convenience.
It may be worth considering deprecating the old Twitter endpoints so we can clean up this project a bit. I'd propose releasing a final version of 2.x.x, bumping master to 3.x.x and removing all the legacy Twitter code. This will allow us to clean up the interfaces/implementations for the GNIP API's.