trinodb / trino

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
https://trino.io
Apache License 2.0
10.3k stars 2.97k forks source link

Release notes for 360 #8455

Closed martint closed 3 years ago

martint commented 3 years ago

Ashhar Hasan

kokosing commented 3 years ago
MemSQL, MySQL, Oracle, Phoenix, PostgreSQL, Redshift, SQLServer connectors changes
---
* Partial support for `DELETE` statement where predicate can be fully pushed down to the the remote datasource. {issue}`6287`)

6287

sopel39 commented 3 years ago
General
* Reduce number of requests from coordinator to workers ({issue}`8460`)

https://github.com/trinodb/trino/pull/8460

losipiuk commented 3 years ago
Hive
* Ensure generation of unique ROW IDs during UPDATE on ORC ACID transactional tables. 
  Before it was possible that Hive was not able to read the table updated by Trino ({issue}`8268`)

8268

8448

hashhar commented 3 years ago
ClickHouse, Druid, MemSQL, MySQL, Oracle, Phoenix, PostgreSQL, Redshift, SQLServer connectors changes
* Add `write.batch-size` connector configuration to control JDBC batch size used during writes.
  It can also be controlled using the `write_batch_size` session property. ({issue}`8434`)

8434

sopel39 commented 3 years ago
SPI
* Cast materialized view storage table columns to match view column types. ({issue}`8408`)

https://github.com/trinodb/trino/pull/8408

losipiuk commented 3 years ago
Hive
* Ensure generation of unique ROW IDs during INSERT into ORC ACID transactional tables. 
  Before it was possible that subsequent DELETE from a table would delete more rows than intended ({issue}`8452`)

8480

8452

sopel39 commented 3 years ago
General:
* Improve query performance by sending collected dynamic filters from coordinator to workers. ({issue}`5183`)

https://github.com/trinodb/trino/pull/5183

kokosing commented 3 years ago
CLI
* Fix auto completion when pressing the tab button. ({issue}`8529`)

8529

hashhar commented 3 years ago
ClickHouse, MemSQL, MySQL, Oracle, Phoenix, PostgreSQL, Redshift, SQLServer connectors changes

* Add new configuration property `insert.non-transactional-insert.enabled` to allow INSERT queries to write directly
  to the target table. This can improve performance in some cases by sacrificing transactional behaviour. It can also
  be controlled using `non_transactional_insert` session property. ({issue}`8496`)

8496

hashhar commented 3 years ago
MemSQL, MySQL, Phoenix, SQLServer connectors changes

* Fix performance regression of writes in JDBC connectors. ({issue}`8559`)

8559

sopel39 commented 3 years ago
General
* Improve performance of inequality joins where join condition sides have different type. ({issue}`8500`)

https://github.com/trinodb/trino/pull/8500

sopel39 commented 3 years ago
SPI
* Remove deprecated `ConnectorSplitManager#getSplits` method overrides ({issue}`8569`)

https://github.com/trinodb/trino/pull/8569

sopel39 commented 3 years ago
General
* Fix query failure when there is a constant predicate on some
  column `col` (e.g `col=1`), followed by  `ORDER BY col` and `LIMIT`. ({issue}`8535`)

https://github.com/trinodb/trino/pull/8535

ebyhr commented 3 years ago
MongoDB

* Add support for `json` type. ({issue}`8352`)

8584

findepi commented 3 years ago
Iceberg
* Add support for Trino views. ({issue}`8540`)

8540

sopel39 commented 3 years ago
SPI
* Introduce `ConnectorPageSource#getCompletedPositions` for tracing physically read positions ({issue}`8524`)

https://github.com/trinodb/trino/pull/8524

ebyhr commented 3 years ago
MongoDB

* Support reading MongoDB `DBRef` type. ({issue}`3134`)

8549

findepi commented 3 years ago
All connectors except of Hive, Iceberg, Memory, Blackhole
* Fix SHOW CREATE SCHEMA. ({issue}`8598`)

8598

sopel39 commented 3 years ago
General:
* Improve performance of queries with `WHERE` predicates. ({issue}`8624`)

https://github.com/trinodb/trino/pull/8624

findepi commented 3 years ago
Iceberg
* Fix query failure when joining with a bucketed Iceberg table. ({issue}`7502`)
* Fix query failure when showing stats for a bucketed Iceberg table. ({issue}`8616`)

7502 #8616

findepi commented 3 years ago
General
* Fix query failure when running `SHOW CREATE SCHEMA information_schema`. ({issue}`8600`)

https://github.com/trinodb/trino/pull/8600

findepi commented 3 years ago
SPI
* Remove deprecated `TupleDomain.transform`. ({issue}`8056`)

https://github.com/trinodb/trino/pull/8056

findepi commented 3 years ago
Iceberg
* Fix query failure when joining with a partitioned table that has structural columns (`array`, `map` or `row`). ({issue}`8647`)

8647

hashhar commented 3 years ago
Phoenix 5
* Improve performance of `ORDER BY ... LIMIT` queries on sorted data. ({issue}`8171`)

8171

hashhar commented 3 years ago
General
* Disallow `DROP SCHEMA` if the schema is not empty. ({issue}`8660`)

https://github.com/trinodb/trino/pull/8660

phd3 commented 3 years ago
Iceberg Connector
* Fail queries on tables with row-level deletes, since it is not supported. ({issue}`8450`)

8450

phd3 commented 3 years ago
Iceberg Connector
* Fix failures for queries that write tables in Parquet format. ({issue}`5201`)

5201

8504

findepi commented 3 years ago
Iceberg
* Improve query planning time. ({issue}`8676`, {issue}`8689`)

8676, #8689 (for #8675, but that's still not fully done yet)

martint commented 3 years ago
* Improve performance of `IN (<subquery>)` expressions. ({issue}`8639`)

8639

kasiafi commented 3 years ago
General:
* Improve support for correlated subqueries with GROUP BY or LIMIT and complex correlated filter conditions.

https://github.com/trinodb/trino/pull/8554

sopel39 commented 3 years ago
General:
* Report cumulative query system memory usage. ({issue}`8615`)

https://github.com/trinodb/trino/pull/8615

martint commented 3 years ago
## Elasticsearch

* Add support for assuming an IAM role. ({issue}`8714`)

https://github.com/trinodb/trino/pull/8714