search

foursquare / fsqio

A monorepo that holds all of Foursquare's opensource projects
Apache License 2.0
254 stars 54 forks source link

Add HFileV1 reader/writer code to fsqio #8

Closed slackhappy closed 8 years ago

slackhappy commented 8 years ago

Hello my fine friends!

I'm interested in using quiver at Slack, and I've hacked together the HFileV1 HFileOutputFormat with direct key value pairs on top of hbase 0.94, but as you can imagine, relying on that is a bit unpopular.

I remember that some of this code was reimplemented outside of hbase to avoid the legacy dep. Could we include it here? There is a real dearth of MR-writable file formats out there with an associated static server.

This is a whiskey-bounty eligible request.

<3 johng

mateor commented 8 years ago

Hi @slackhappy. The common consensus is that Foursquare is willing to do that. We will be taking a look at how much work that may/may not be soonish.

tdyas commented 8 years ago

screen shot 2016-05-10 at 6 05 29 pm -- reactions on our internal slack to your request

slackhappy commented 8 years ago

It'll be okay, broken heart, we can still be friends.

mateor commented 8 years ago

Hi @slackhappy. Hope you are well.

Foursquare open sourced the HFile Reader and Writer code today, thanks to @theevocater who did all the work :)

8a6ff0075aae5cc05347ed43e0e84859b1d31c7c e3ecb932172c35ed237b4f36a7cd7a77c064180f 856167995f021a5ed9995a4302204b7ff96cb809 f1b8127531531cecf15a9316b9ffec7552d08de4

Hope that you find it useful!