Closed martint closed 3 years ago
MemSQL, MySQL, Oracle, Phoenix, PostgreSQL, Redshift, SQLServer connectors changes
---
* Partial support for `DELETE` statement where predicate can be fully pushed down to the the remote datasource. {issue}`6287`)
General
* Reduce number of requests from coordinator to workers ({issue}`8460`)
Hive
* Ensure generation of unique ROW IDs during UPDATE on ORC ACID transactional tables.
Before it was possible that Hive was not able to read the table updated by Trino ({issue}`8268`)
ClickHouse, Druid, MemSQL, MySQL, Oracle, Phoenix, PostgreSQL, Redshift, SQLServer connectors changes
* Add `write.batch-size` connector configuration to control JDBC batch size used during writes.
It can also be controlled using the `write_batch_size` session property. ({issue}`8434`)
SPI
* Cast materialized view storage table columns to match view column types. ({issue}`8408`)
Hive
* Ensure generation of unique ROW IDs during INSERT into ORC ACID transactional tables.
Before it was possible that subsequent DELETE from a table would delete more rows than intended ({issue}`8452`)
General:
* Improve query performance by sending collected dynamic filters from coordinator to workers. ({issue}`5183`)
CLI
* Fix auto completion when pressing the tab button. ({issue}`8529`)
ClickHouse, MemSQL, MySQL, Oracle, Phoenix, PostgreSQL, Redshift, SQLServer connectors changes
* Add new configuration property `insert.non-transactional-insert.enabled` to allow INSERT queries to write directly
to the target table. This can improve performance in some cases by sacrificing transactional behaviour. It can also
be controlled using `non_transactional_insert` session property. ({issue}`8496`)
MemSQL, MySQL, Phoenix, SQLServer connectors changes
* Fix performance regression of writes in JDBC connectors. ({issue}`8559`)
General
* Improve performance of inequality joins where join condition sides have different type. ({issue}`8500`)
SPI
* Remove deprecated `ConnectorSplitManager#getSplits` method overrides ({issue}`8569`)
General
* Fix query failure when there is a constant predicate on some
column `col` (e.g `col=1`), followed by `ORDER BY col` and `LIMIT`. ({issue}`8535`)
MongoDB
* Add support for `json` type. ({issue}`8352`)
Iceberg
* Add support for Trino views. ({issue}`8540`)
SPI
* Introduce `ConnectorPageSource#getCompletedPositions` for tracing physically read positions ({issue}`8524`)
MongoDB
* Support reading MongoDB `DBRef` type. ({issue}`3134`)
All connectors except of Hive, Iceberg, Memory, Blackhole
* Fix SHOW CREATE SCHEMA. ({issue}`8598`)
General:
* Improve performance of queries with `WHERE` predicates. ({issue}`8624`)
Iceberg
* Fix query failure when joining with a bucketed Iceberg table. ({issue}`7502`)
* Fix query failure when showing stats for a bucketed Iceberg table. ({issue}`8616`)
General
* Fix query failure when running `SHOW CREATE SCHEMA information_schema`. ({issue}`8600`)
SPI
* Remove deprecated `TupleDomain.transform`. ({issue}`8056`)
Iceberg
* Fix query failure when joining with a partitioned table that has structural columns (`array`, `map` or `row`). ({issue}`8647`)
Phoenix 5
* Improve performance of `ORDER BY ... LIMIT` queries on sorted data. ({issue}`8171`)
General
* Disallow `DROP SCHEMA` if the schema is not empty. ({issue}`8660`)
Iceberg Connector
* Fail queries on tables with row-level deletes, since it is not supported. ({issue}`8450`)
Iceberg Connector
* Fix failures for queries that write tables in Parquet format. ({issue}`5201`)
Iceberg
* Improve query planning time. ({issue}`8676`, {issue}`8689`)
* Improve performance of `IN (<subquery>)` expressions. ({issue}`8639`)
General:
* Improve support for correlated subqueries with GROUP BY or LIMIT and complex correlated filter conditions.
General:
* Report cumulative query system memory usage. ({issue}`8615`)
## Elasticsearch
* Add support for assuming an IAM role. ({issue}`8714`)
Ashhar Hasan
Dain Sundstrom
David Phillips
GitHub
Grzegorz Kokosiński
Karol Sobczak
Martin Traverso
Piotr Findeisen
SHOW CREATE SCHEMA information_schema
Pratham
Yuya Ebihara
Łukasz Osipiuk