search

airbnb / airpal

Web UI for PrestoDB.
http://airbnb.github.io/airpal
Apache License 2.0
2.76k stars 459 forks source link

AWS Athena Support #214

Open tejasmanohar opened 7 years ago

tejasmanohar commented 7 years ago

AWS Athena is built on Presto and is thus, very similar. Its query interface is also Hive. It would be awesome if Airpal supported AWS Athena. I believe the main change is moving to the JDBC interface for communicating with Presto so that Athena can be dropped in.

I'd be willing to PR. Thoughts? Is this something AirBnB would be interested in merging upstream?

// cc @andykram (seems like you wrote lots of the presto/hive code)

corydolphin commented 7 years ago

Are there any updates here? Or an idea of how hard this would be to do?

breath103 commented 6 years ago

:+1: especially since now athena support HTTP API

tejasmanohar commented 6 years ago

I hacked on it for a night but never used it. If you want to try it, I'd use the JDBC driver (which proxies the HTTP JSON-RPC API under the hood) since that's what the other Airpal connections are.

sameermahajan commented 6 years ago

Any latest updates on this? We are also looking for it. Or any pointers to jdbc connectivity based code from airpal?

SameerMahajan-GSLab commented 5 years ago

We found out that fetching the results was VERY SLOW when we used JDBC especially when the result set was very large (over million rows). It is better to use AWS SDK athena client / http client. A couple of hours of execution (with JDBC) came down to a few seconds.

dthauvin commented 5 years ago

this feature could help a lot of people.

farzad-xgen commented 4 years ago

+1

Tarekk commented 3 years ago

+1

OElesin commented 3 years ago

If anyone is interested, I recently built "Querypal", inspired by Airpal. Querypal is a web UI for Amazon Athena, which is also compatible with mobile browsers.

More information here: https://towardsdatascience.com/introducing-querypal-web-ui-for-amazon-athena-also-works-on-mobile-7beab6b101b0

m0rph3u5-zip commented 3 years ago

If anyone is interested, I recently built "Querypal", inspired by Airpal. Querypal is a web UI for Amazon Athena, which is also compatible with mobile browsers.

More information here: https://towardsdatascience.com/introducing-querypal-web-ui-for-amazon-athena-also-works-on-mobile-7beab6b101b0

Hi OElesin, I read your amazing article. Im very interested in your "Querypal". Its amazing and more useful. Im creating a similar project for my CDP Manager. My project is very similar indeed. Congratulations because I see from the images that you managed to create the query editor, which I havent been able to achieve so far. Ive read that your project will be Open Source. Is possible to try it? Itsnt on Github is it? Thanks and great job. Thanks!

OElesin commented 3 years ago

@m0rph3u5-zip, thanks for the comments and interest. It is possible to try it and it is on GitHub, but a private repository at this time.

Querypal is available in private beta. If you provide your email, I can provide you access so as to give it a go.

m0rph3u5-zip commented 3 years ago

@m0rph3u5-zip, thanks for the comments and interest. It is possible to try it and it is on GitHub, but a private repository at this time.

Querypal is available in private beta. If you provide your email, I can provide you access so as to give it a go.

it would be great. My email on github is cia.waglio@yahoo.com. Thanks!

OElesin commented 3 years ago

Querypal is now open source: https://github.com/OElesin/querypal