Closed jitingxu1 closed 6 months ago
Seems like a good idea. I think it would also be a good idea to publish a step support matrix to the website, as it's hard to work around a step that contains operations that aren't supported on your backend (more so than on the core Ibis repo, where you may be able to drop into raw SQL or find some workaround), because step definitions are broader in scope. As a result, e.g. if somebody wants to use the TargetEncode
step, they can first check whether it's supported on their backend.
Two more things to think about:
quantile
operation isn't supported on a backend, can we catch the would-be failure in the step definition without actually having to connect to an actual backend?Feedback:
ibis.to_sql
and specify the dialect), and you should also be able to compile without any dependencies.If you want to do execution testing (may not be necessary?):
enable unit tests on different backends