apache / datafusion-ballista

Apache DataFusion Ballista Distributed Query Engine
https://datafusion.apache.org/ballista
Apache License 2.0
1.39k stars 181 forks source link

Update arrow requirement from 47.0.0 to 49.0.0 #908

Closed dependabot[bot] closed 6 months ago

dependabot[bot] commented 7 months ago

Updates the requirements on arrow to permit the latest version.

Changelog

Sourced from arrow's changelog.

47.0.0 (2023-09-19)

Full Changelog

Breaking changes:

Implemented enhancements:

  • Row Format Adapative Block Size #4812 [arrow]
  • Stateless Row Conversion #4811 [arrow] [arrow-flight]
  • Add option to specify custom null values for CSV reader #4794 [arrow]
  • parquet::record::RowIter cannot be customized with batch_size and defaults to 1024 #4782 [parquet]
  • DynScalar abstraction (something that makes it easy to create scalar Datums) #4781 [arrow]
  • Datum is not exported as part of arrow (it is only exported in arrow_array) #4780 [arrow]
  • Scalar is not exported as part of arrow (it is only exported in arrow_array) #4779 [arrow]
  • Support IntoPyArrow for impl RecordBatchReader #4730 [arrow]
  • Datum Based String Kernels #4595 [arrow] [arrow-flight]

Fixed bugs:

  • MapArray::new_from_strings creates nullable entries field #4807 [arrow]
  • pyarrow module can't roundtrip tensor arrays #4805 [arrow]
  • concat_batches errors with "schema mismatch" error when only metadata differs #4799 [arrow]
  • panic in cmp kernels with DictionaryArrays: Option::unwrap() on a None value' #4788 [arrow]
  • stream ffi panics if schema metadata values aren't valid utf8 #4750 [arrow]
  • Regression: Incorrect Sorting of *ListArray in 46.0.0 #4746 [arrow]
  • Row is no longer comparable after reuse #4741 [arrow]
  • DoPut FlightSQL handler inadvertently consumes schema at start of Request<Streaming<FlightData>> #4658
  • Return error when converting schema #4752 [arrow] (wjones127)
  • Implement PyArrowType for Box<dyn RecordBatchReader + Send> #4751 [arrow] (wjones127)

Closed issues:

  • Building arrow-rust for target wasm32-wasi falied to compile packed_simd_2 #4717

Merged pull requests:

... (truncated)

Commits


Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
dependabot[bot] commented 7 months ago

The following labels could not be found: auto-dependencies.

dependabot[bot] commented 6 months ago

Looks like arrow is up-to-date now, so this is no longer needed.