search

ibis-project / ibis

the portable Python dataframe library
https://ibis-project.org
Apache License 2.0
5.31k stars 598 forks source link

StarRocks backend support #8423

Open kenneth-copeland opened 9 months ago

kenneth-copeland commented 9 months ago

Is your feature request related to a problem?

I am frustrated by ... the lask of StarRocks support

Describe the solution you'd like

I'd like to try using StarRocks

The StarRocks python client is SQLAlchemy based ... so maybe it would only take 4 hours ... and you would have 20 backends supported :)

What version of ibis are you running?

7.2.0

What backend(s) are you using, if any?

No response

Code of Conduct

gforsyth commented 9 months ago

Thanks for opening this, @kenneth-copeland !

We've moved away from sqlalchemy on main and will no longer require it as of Ibis 9.0, but that shouldn't actually have a huge impact on whether or not we can support StarRocks.

It looks to be MySQL compatible, so this could potentially be handled in a way similar to the RisingWave backend + Postgres.

Noting also that there is a docker image available so we would be able to test in CI: https://hub.docker.com/r/starrocks/allin1-ubuntu

cpcloud commented 9 months ago

Looks like sqlglot has a StarRocks dialect.

lostmygithubaccount commented 9 months ago

also to be clear, adding new backends is not a priority for the core Ibis team right now so we're unlikely to contribute this, but would be more than happy to work with someone on contributing it!