trinodb / trino

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
https://trino.io
Apache License 2.0
10.3k stars 2.97k forks source link

Release notes for 364 #9534

Closed martint closed 2 years ago

martint commented 3 years ago

Ashhar Hasan

sopel39 commented 3 years ago
General:
* Improve performance of `GROUP BY` with single grouping column. ({issue}`9514`)

https://github.com/trinodb/trino/pull/9514

dain commented 3 years ago
Hive:
* Fix `ArrayIndexOutOfBoundsException` when inserting into a partition table with `hive.target-max-file-size` set.  ({issue}`9557`)

9557

findepi commented 3 years ago
Hive
* Fix Hive incompatibility with Parquet files containing `char` or `varchar` data produced by the experimental Parquet writer.
   Hive 2 or newer should now read such files correctly, while Hive 1.x is still known not to read them. ({issue}`9515`)

This change might affect Iceberg too. However, we don't have Iceberg connector tests with Hive, so i don't know.

9515

findepi commented 3 years ago
SQL Server
* Fix query failure when `count(*)` aggregation is delegated to SQL Server database and table has more than 2147483647 rows. ({issue}`9549`)

9549

sopel39 commented 3 years ago
General:
* Add support for `ALTER MATERIALIZED VIEW ... RENAME TO ...`. ({issue}`9492`)

Iceberg:
* Add support for renaming materialized views. ({issue}`9492`)

https://github.com/trinodb/trino/pull/9492

findepi commented 3 years ago
Hive
* Fix reading semi-invalid Avro schema written by Avro 1.8.2. ({issue}`9243)

9243

findepi commented 2 years ago
Iceberg
* Create Parquet files that can be read more efficiently. ({issue}`9569`)

https://github.com/trinodb/trino/pull/9569

ebyhr commented 2 years ago
## General
* Add support for `ALTER TABLE ... SET PROPERTIES` statement. ({issue}`9401`)

## SPI
* Introduce `ConnectorMetadata#setTableProperties` for altering table properties. ({issue}`9401`)

## ClickHouse
* Support changing `sample_by` table properties using `ALTER TABLE ... SET PROPERTIES` statement. ({issue}`9401`)

9401

#

This should not be documented if we couldn't fix the implementation before release.

findepi commented 2 years ago
Iceberg 
* Improve query performance when dynamic filtering can be leveraged. ({issue}`4115`)

9538 #4115 #9193

findepi commented 2 years ago
SPI
* Expose which columns are covered by dynamic filters. ({issue}`9644`)

9644

findepi commented 2 years ago
Iceberg
* Fix data loss in case of concurrent inserts to a table. ({issue}`9583`)

9583 #9584

sopel39 commented 2 years ago
General
* Fix displaying character type dynamic filter values in ``EXPLAIN ANALYZE``. ({issue}`9673`)

https://github.com/trinodb/trino/pull/9673

Praveen2112 commented 2 years ago
General 
* Fix query failure for update operation if it has a correlated subquery. 

8286

sopel39 commented 2 years ago
General
* Improve performance of decimal aggregations. ({issue}`9640`)

https://github.com/trinodb/trino/pull/9640

sopel39 commented 2 years ago
General
* Fix decimal division when result is between `-1` and `0`. ({issue}`9696`)

https://github.com/trinodb/trino/pull/9696

findepi commented 2 years ago
Hive
* Write files compatible with Hive 1 and Hive 3 in experimental Parquet writer. ({issue}`6377`)

6377 #9611

findepi commented 2 years ago
General
* Fix SHOW STATS failure for a query projecting a boolean column. ({issue}`9710`)

9710 #9711

aczajkowski commented 2 years ago
# Hive
* Restrict partition overwrite on insert to auto commit context only ({issue}`9559`)

https://github.com/trinodb/trino/issues/9559 https://github.com/trinodb/trino/pull/9675

Praveen2112 commented 2 years ago
JDBC
* Allow using token from existing Kerberos context. This allows us to perform Kerberos authentication without 
passing the Keytab or credential cache to the driver ({issue}`4826`)

9606

findepi commented 2 years ago
Iceberg
* Return value with UTC zone for table partitioned on `timestamp with time zone`. ({issue}`9704)
* Fix query failure when reading from `$partitions` table for a table partitioned on `timestamp with time zone` or `uuid` ({issue}`9703`, {issue}`9757)

9757 #9703 #9704

findepi commented 2 years ago
Iceberg
* Fix query failure when reading Iceberg table statistics. ({issue}`9714`)

9714 #9719

ebyhr commented 2 years ago
## MemSQL
* Support reading MemSQL `datetime(6)` and `timestamp(6)` types as Trino `timestamp(6)`. ({issue}`9725`)

9725

kokosing commented 2 years ago
# Hive
* Allow to skip setting permissions on new directories by setting `hive.fs.new-directory-permissions=skip` in connector properties file. ({issue}`9539`)

9539

losipiuk commented 2 years ago
# Hive
* Allow translating Hive views which cast `timestamp` columns to `decimal`. ({issue}`9530`)

9530

losipiuk commented 2 years ago
# Hive
* Add `OPTIMIZE` table procedure for merging small files in non-transactional Hive table. 
  Procedure can be executed using `ALTER TABLE <table> EXECUTE OPTIMIZE(file_size_threshold => ...)` syntax. ({issue}`9665`)

9665 #9761

losipiuk commented 2 years ago
# SPI
* Add SPI for table procedures that can process table data in a distributed manner. Table procedures can be run via `ALTER TABLE ... EXECUTE ...` syntax. ({issue}`9665 `)

9665

ebyhr commented 2 years ago
## Cassandra
* Map Cassandra `uuid` type to Trino `uuid`. ({issue}`5231`)

5231

dain commented 2 years ago
# Hive
* Fix query failure when writing to a partitioned table with target max file size set. ({issue}`9557`)

9557

sopel39 commented 2 years ago
General:
* Fix invalid query results for queries with nested joins and ``IS NOT DISTINCT FROM`` join clauses. ({issue}`9805`)

https://github.com/trinodb/trino/pull/9805

kokosing commented 2 years ago
General
* Improve CPU coordinator utilization. ({issue}`8650`)

8650

losipiuk commented 2 years ago
# Hive
* Reject execution of `CREATE TABLE` when bucketing is requested on columns with unsupported column types. Previously `CREATE` was allowed but it was not possible to insert data to such a table. ({issue}`9793`)

9793

findepi commented 2 years ago
General / UI
* Improve responsiveness of Web UI when query history contains queries with long query text. ({issue}`8892`)

8892