trinodb / trino

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
https://trino.io
Apache License 2.0
10.36k stars 2.98k forks source link

Release notes for 332 #3114

Closed martint closed 4 years ago

martint commented 4 years ago

Dain Sundstrom

findepi commented 4 years ago
MongoDB
* Add ``objectid_timestamp`` function for getting ``timestamp with time zone`` from ``ObjectId``. (:issues:`3089`)

https://github.com/prestosql/presto/pull/3089

kokosing commented 4 years ago
Security
---
- Verify access to table columns when running ``SHOW STATS``. (:issue:`2665`)
Show stats for permissions

General
--- 
- Support passing subset of columns to ``SHOW STATS``. (:issue:`2665`)

2665

kokosing commented 4 years ago
General 
----
- Support multiple event listener plugins. They can be specified with ``event-listener.config-files`` configuration property. (:issue:`3128`)

3128

findepi commented 4 years ago
Hive
* Add ``hive.fs.new-directory-permissions`` configuration property for setting the permissions of new directories
  created by Presto. Default value is ``0777``. (:issue:`3126`)

https://github.com/prestosql/presto/pull/3126

ebyhr commented 4 years ago
Memory
* List missing views in ``system.jdbc.tables`` table. (:issues:`3208`)

https://github.com/prestosql/presto/pull/3208

kokosing commented 4 years ago
Hive
---
 - Add ``hive.partition-use-column-names`` configuration property and matching ``partition_use_column_names`` catalog session property that allows to match columns between table and partition schemas by names. By default they are mapped by index. (:issue:2933`)

2933

sopel39 commented 4 years ago
General
-------

* Fix LDAP authentication not working if user belongs to multiple groups. (:issue:`3206`)

https://github.com/prestosql/presto/pull/3206

ebyhr commented 4 years ago
MongoDB
* Delete document from ``_schema`` collection when DROP TABLE is executed for the table that exists only in ``_schema``. (:issues:`3234`)

https://github.com/prestosql/presto/pull/3234

kokosing commented 4 years ago
General
----
- Add ``CREATE SCHEMA ... AUTHORIZATION`` syntax to create a schema with specified owner. (:issue:`3066`).

Hive
--- 
- Add support for ``CREATE SCHEMA ... AUTHORIZATION`` to create a schema with specified owner. (:issue:`3066`).

3066

sopel39 commented 4 years ago
General
-------

* Add ``optimizer.push-partial-aggregation-through-join`` feature toggle for pushing partial
  aggregation through inner join. (:issue:`3205`)
* Rename ``optimizer.push-aggregation-through-join`` feature toggle to
  ``optimizer.push-aggregation-through-outer-join``. (:issue:`3205`)

https://github.com/prestosql/presto/pull/3205

sopel39 commented 4 years ago
General
-------

* Expose operator stats of how many splits were processed with dynamic filter applied. (:issue:`3217`)

https://github.com/prestosql/presto/pull/3217

kokosing commented 4 years ago
SPI
--- 
 - Allow ``Connector`` to provide ``EventListener`` registration. (:issue:`3166`)

3166

Praveen2112 commented 4 years ago
Kudu
----

* Fix incorrect column mapping in Kudu connector (:issue `3170`, :issue `2963`)

3212

findepi commented 4 years ago
General
* Fix query failure during planing phase for certain queries involving multiple joins. (:issue:`3149`)

https://github.com/prestosql/presto/issues/3149 https://github.com/prestosql/presto/pull/3245

kokosing commented 4 years ago
Security
---
 - Return only accessible to user views from ``<catalog>.information_schema.views`` table. (:issue:`3290`)

3290

sopel39 commented 4 years ago
Hive
----

* Add support for endpoint URL for Glue. (:issue:`3239`)

https://github.com/prestosql/presto/pull/3239

Praveen2112 commented 4 years ago
General
----
* Fix execution failure for queries involving huge IN on long decimal columns. (:issue: `3191`)

3196

dain commented 4 years ago
Hive
----
* Add experimental file system caching.  This can be enabled with the `hive.cache.enabled` catalog property. (:issue:`2679`)

2679

martint commented 4 years ago

Hive

* Fix failure reading certain Parquet files larger than 2GB. (:issue:`2730`)

https://github.com/prestosql/presto/issues/2730

martint commented 4 years ago

Hive

* Improve performance when reading gzip-compressed Parquet data. (:issue:`3175`)

https://github.com/prestosql/presto/pull/3175

martint commented 4 years ago
* Include filters over all table columns in output of ``EXPLAIN (TYPE IO)``. (:issue:`2743`)

https://github.com/prestosql/presto/pull/2743

martint commented 4 years ago

SPI

* Expose row filters and column masks in ``QueryCompletedEvent``. (:issue:`3183`)

https://github.com/prestosql/presto/pull/3183

martint commented 4 years ago

BigQuery

* Extract parent project ID from service account before looking at the environment. (:issue:`3131`)

3131

martint commented 4 years ago

SPI

* Expose referenced functions and procedures in ``QueryCompletedEvent``. (:issue:`3246`)

https://github.com/prestosql/presto/pull/3246

findepi commented 4 years ago
General
* Ignore trailing whitespace when loading configuration files such as ``etc/event-listener.properties``, ``etc/group-provider.properties``, etc.
  Trailing whitespace in main and catalog configuration files was already ignored.

https://github.com/prestosql/presto/pull/3231

findepi commented 4 years ago
SPI
* Deprecate ``ConnectorPageSourceProvider#createPageSource(ConnectorTransactionHandle, ConnectorSession, ConnectorSplit, ConnectorTableHandle, List<ColumnHandle>)`` (``createPageSource`` variant not taking ``dynamicFilter``). The method will be removed in a future release.

https://github.com/prestosql/presto/pull/3255

findepi commented 4 years ago
SQL Server
* Reject ``ALTER TABLE ... RENAME TO`` between schemas. Previously such rename was accepted but
  renamed was accepted but performed incorrectly.

https://github.com/prestosql/presto/pull/3284

martint commented 4 years ago

Elasticsearch

* Add support for ``ip`` type. (:issue:`3347`)

https://github.com/prestosql/presto/pull/3347

findepi commented 4 years ago
Kudu
* Fix incorrect query result for certain queries involving ``IS NULL`` predicates with ``OR``. (:issue:`3274`)

https://github.com/prestosql/presto/issues/3274 https://github.com/prestosql/presto/pull/3288

martint commented 4 years ago

Elasticsearch

* Add support for `keyword` fields with numeric values. (:issue:`3381`)

https://github.com/prestosql/presto/pull/3381

electrum commented 4 years ago

Hive

* Support reading files compressed with newer versions of LZO. (:issue:`3209`)

3209

electrum commented 4 years ago

JDBC Driver

* Add ``clientInfo `` property to set extra information about the client. (:issue:`3188`)
* Add ``traceToken`` property to set a trace token for correlating requests across systems. (:issue:`3188`)

3188

electrum commented 4 years ago

General

* Reduce overhead for internal communication requests. (:issue:`3215`)

3215

electrum commented 4 years ago

Hive

* Add support for :ref:`alluxio_catalog_service`. (:issue:`2116`)

2116

This will require adding an anchor before "Alluxio Catalog Service" in connector/hive.rst

electrum commented 4 years ago

General

* Fix prepared statements or view creation for queries containing certain nested aliases or ``TABLESAMPLE`` clauses. (:issue:`3250`)

3250

electrum commented 4 years ago

Elasticsearch

* Remove unnecessary ``elasticsearch.aws.use-instance-credentials`` configuration property. (:issue:`3265`)

3265

electrum commented 4 years ago

Hive

* Remove unnecessary ``hive.metastore.glue.use-instance-credentials`` configuration property. (:issue:`3265`)

3265

electrum commented 4 years ago

Hive

* Remove unnecessary ``hive.s3.use-instance-credentials`` configuration property. (:issue:`3265`)

3265

electrum commented 4 years ago

Hive

* Add flexible :ref:`s3_security_mapping`, allowing for separate credentials
  or IAM roles for specific users or buckets/paths. (:issue:`3265`)

3265

electrum commented 4 years ago

Hive

* Add support for specifying an External ID for an IAM role trust policy using
  the ``hive.metastore.glue.external-id`` configuration property (:issue:`3144`)

3144

electrum commented 4 years ago

Hive

* Explicitly disallow reading from Delta Lake tables. Previously, reading
  from partitioned tables would return zero rows, and reading from
  unpartitioned tables would fail with a cryptic error. (:issue:`3366`)

3366

electrum commented 4 years ago

Hive

* Allow using configured S3 credentials with IAM role. Previously,
  the configured IAM role was silently ignored. (:issue:`3351`)

3351