apache / incubator-xtable

Apache XTable (incubating) is a cross-table converter for lakehouse table formats that facilitates interoperability across data processing systems and query engines.
https://xtable.apache.org/
Apache License 2.0
853 stars 140 forks source link

Testing XTable through Azure Pipelines not working #363

Closed jcamachor closed 6 months ago

jcamachor commented 7 months ago

We were using Azure Pipelines for testing the project pull requests and changes. After migration to ASF infrastructure, those triggers have stopped working.

This might not be trivial to solve and needs to be further investigated: https://issues.apache.org/jira/browse/INFRA-17030

jcamachor commented 7 months ago

@vinothchandar , it seems the Hudi community has CI enabled through Azure Pipelines. Do you know whether anything changed since INFRA-17030, or had to implement a workaround?

jcamachor commented 7 months ago

I found the JIRA with a series of PRs: https://issues.apache.org/jira/browse/HUDI-7438 It seems there's a custom workaround in place for Azure Pipelines not having write access to the ASF repo. I'll delve deeper into this over the next few days, any help / guidance is appreciated.

jcamachor commented 7 months ago

I found the corresponding documentation. I'll replicate (and document as well) a similar architecture to the one described in: https://cwiki.apache.org/confluence/display/HUDI/Guide+on+CI+infrastructure