microsoft / hyperspace

An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.
https://aka.ms/hyperspace
Apache License 2.0
424 stars 115 forks source link

Add windows build pipeline #470

Closed paryoja closed 3 years ago

paryoja commented 3 years ago

What is the context for this pull request?

What changes were proposed in this pull request?

Using Windows environments to test in the azure pipeline.

Does this PR introduce any user-facing change?

No

How was this patch tested?

By using the Azure pipeline configured.

paryoja commented 3 years ago

I added four windows jobs according to linux jobs already exist. However, windows jobs (~20mins) takes more time than linux's (~12mins). I think it could be a bit annoyed if you wait for your job to be completed.

paryoja commented 3 years ago

I think I should do some refactoring so that this pipeline could be easily used after new versions of Scala / Spark are released.

paryoja commented 3 years ago

Refactoring Done.

imback82 commented 3 years ago

I added four windows jobs according to linux jobs already exist. However, windows jobs (~20mins) takes more time than linux's (~12mins). I think it could be a bit annoyed if you wait for your job to be completed.

It should be OK for now, and we can enable Windows builds only for CI builds on master if the speed up is needed later.

I think I should do some refactoring so that this pipeline could be easily used after new versions of Scala / Spark are released.

Thanks for doing this!