search

rmetzger / stratosphere-sql

My private playground to develop SQL support on Stratosphere
Apache License 2.0
4 stars 2 forks source link

Extend the method to evaluate boolean expressions for WHERE #3

Closed camelia-c closed 10 years ago

camelia-c commented 10 years ago

Extend the method to evaluate boolean expressions for WHERE statements, in order to support more types and more operations (<,>, <=, LIKE etc.)

rmetzger commented 10 years ago

Hey, I'm currently looking into a different way to solve this task. The author of optiq pointed me to some code that will generate the code required to evaluate expressions (https://groups.google.com/forum/#!topic/optiq-dev/-97ONPmDTB4). I'm currently working on changing the optiq code so that we can use that feature for our purposes.

Doing so would allow us to support ALL SQL functions / boolean expression evaluation without much effort from our side.

If you are looking for another task, you can either add support for another data source. I want to do two things there a) Avro support. Avro files have the schema self-contained. So we need to extract the Avro schema and tell make it available to Optiq. I also want to look into Paquet / ORC support. This is a columnar storage file format. It will lead to very good performance for most SQL queries because it reduces I/O.

Another Task that is open the following (it is a bit more difficult since its more explorative): Optiq has code to offer a JDBC interface. We want also to provide a JDBC interface for Stratosphere SQL. If you want, you can also have a look into Optiq and find out what changes are required at our current code to support a JDBC interface.

Regards, Robert

rmetzger commented 10 years ago

I created issues for the tasks https://github.com/rmetzger/stratosphere-sql/issues/5, https://github.com/rmetzger/stratosphere-sql/issues/4, https://github.com/rmetzger/stratosphere-sql/issues/6

zerolevel commented 10 years ago

hi. @Caroline : where you able to fix this issue. @robert : I dont get this error, but i get the following error.

http://tny.cz/98b4c577 (paste bin)

I went to look for it. and found that stratosphere-sql has dependency on eu.stratosphere.types.JavaValue; and this class file is not the part of the main repository also.

Please look at this matter.

thanks mohit.

rmetzger commented 10 years ago

Hi,

yes, you need a special version of Stratosphere to use the SQL interface: Find more information here: https://github.com/rmetzger/stratosphere-sql/issues/1#issuecomment-36732753

I'm happy to help if you have further questions.