Release notes for 0.189

[raghavsethi]

Aleksei Statkevich

• [x] 11-02 17:07:40 4376620418 Add indexableKeys to PrestoThriftTableMetadata
• [x] 11-02 17:07:40 6db42dbb27 Refactor thrift conversion methods
• [x] 11-02 17:07:40 fac33282e1 Add record set to thrift page converters
• [x] 11-03 12:01:14 06c19ecf85 Fix UTF-8 typo in Thrift connector docs

  Dain Sundstrom

• [x] 11-04 11:07:25 d66ba348be Fix exception caused by coersion in plan printer
• [x] 11-08 12:07:13 23e8be6464 Upgrade to Airbase 75
• [x] 11-08 14:51:05 bcfb4c6f28 Add new locations for query output during scheduling

  David Phillips

• [x] 11-03 12:22:28 377f68c0f9 Use correct non-null annotation in client
• [x] 11-03 13:11:13 712d008987 Fix usage of default charset in typeof function
• [x] 11-03 13:53:13 067bb231a6 Remove workaround for Jetty client Kerberos realm bug
• [x] 11-03 14:58:09 00fb7a8f50 Cleanup imports for Hive connector
• [x] 11-03 14:58:09 3b50eadc9f Remove incorrect comment from BridgingHiveMetastore
• [x] 11-03 14:58:09 8e7671ad0f Do not require Thrift metastore config for file metastore
• [x] 11-03 14:58:09 c4e0754b66 Move Thrift metastore classes to separate package
• [x] 11-03 14:58:09 e6268ba723 Move Thrift methods out of MetastoreUtil
• [x] 11-03 15:53:41 1b61eca55c Make CLI execute USE on the server
• [x] 11-03 15:53:41 2c22a59d8f Add server support for USE statement
• [x] 11-03 20:13:17 73a4466763 Update to Airlift 0.156
• [x] 11-06 17:57:07 1093d9f5cb Skip sending final leg of SPNEGO authentication
• [x] 11-06 17:57:07 a21e6c397d Add client certificate authentication
• [x] 11-06 17:57:07 fca5bff8d0 Allow multiple authentication types
• [x] 11-07 17:20:55 09e7d83b37 Close ResultSet when Statement is closed
• [x] 11-07 17:20:55 7ba93d83f0 Remove unnecessary ClientSession constructor
• [x] 11-07 17:20:55 ca13dddf37 Add transaction and session support to JDBC driver
• [x] 11-11 22:45:48 8e78654452 Add key store configuration for JDBC driver

  Grzegorz Kokosiński

• [x] 11-07 00:15:23 848e064e1f Product test for ignoring bucketing if table is not bucketed
• [x] 11-07 02:43:07 865545e498 Add missing mock method implementations in AbstractMockMetadata
• [x] 11-07 02:43:07 ebb40fd658 Fix error message with invalid catalog and schema
• [x] 11-07 02:43:55 847d90e839 Save the JVM error log from product tests
• [x] 11-07 02:43:55 9cc98fbfad Archive product test results on S3
• [x] 11-07 11:40:57 9f23635839 Remove DummyMetadata
• [x] 11-08 05:22:13 68efa70420 Merge tiny pages returned from PageProcessor

  Haozhun Jin

• [x] 11-07 14:44:01 7b4ca22758 Add borrow method to AsyncQueue
• [x] 11-07 14:44:01 d482747e03 Track buffered split count in HiveSplitSource independently
• [x] 11-07 14:44:01 ece4ece582 Replace CompletableFuture with ListenableFuture in AsyncQueue
• [x] 11-07 15:10:17 1ce3a0bece Reduce memory usage of HiveSplitSource
• [x] 11-07 15:10:17 30b604d982 Reduce loader concurrency in BackgroundHiveSplitLoader
• [x] 11-07 15:10:17 504fae08bd Remove connectorId/clientId from most Hive connector entities
• [x] 11-08 16:32:57 668ab5f001 Remove unused fields and methods from BackgroundHiveSplitLoader
• [x] 11-08 16:32:57 ca83d278d0 Fix split scheduling failure for empty file in Hive connector

  James Sun

• [x] 11-02 21:38:45 467ecb04b6 Get the sizes of output data streams in orc column writer
• [x] 11-02 21:38:45 807e8eeac1 Write ORC output streams based on the order of sizes
• [x] 11-02 21:38:45 ad840b72e9 Remove unused writeDataStreams interface
• [x] 11-08 16:30:14 06d992f22f Deprecate unused SliceArrayBlock
• [x] 11-08 16:30:14 1959d7615c Move truncated length computation of slice to SliceStreamReader
• [x] 11-08 16:30:14 72fa55d75e Use VariableWidthBlock in SliceDictionaryStreamReader

  Karol Sobczak

• [x] 11-03 02:12:42 3148df968f Move ExpressionAnalyzer's Scope to Context
• [x] 11-03 02:12:42 3423f439fb Introduce Analysis.isColumnReference shorthand
• [x] 11-03 02:12:42 785509f298 Fix planning when lambda argument shadows relation column
• [x] 11-03 02:12:42 e506142275 Use Scope to resolve lambda arguments in ExpressionAnalyzer
• [x] 11-03 02:12:42 fbe3fb039e Support lambda captures using dereference expressions

  Nezih Yigitbasi

• [x] 11-07 14:30:47 d03d945928 Use environment from context in DB resource group manager
• [x] 11-08 08:34:50 a8ca86d539 Fix bing_tile_at for points close to tile edges
• [x] 11-09 10:27:40 e02a0dff8d Fix query id comparison in CreateTableOperation

  Raghav Sethi

• [x] 11-07 14:15:20 edef5e5113 Elide empty comments in HiveColumnHandle

  Rongrong Zhong

• [x] 11-07 20:47:18 aa1a84a4a0 Refactor loadProperties to PropertiesUtil
• [x] 11-07 20:47:18 b52f40f082 Support SessionPropertyConfigurationManager plugin
• [x] 11-07 20:47:18 c07143c5e6 Apply session properties from SessionPropertyConfigurationManager

  Wenlei Xie

• [x] 11-09 21:55:59 d132272a7b Move ESRI version specification to dependency management
• [x] 11-13 05:22:15 5f272a498c Allow casting JSON to row with missing fields in JSON object

  Łukasz Osipiuk

• [x] 11-06 03:24:44 ef219a1429 Correct doc for Kafka raw decoder
• [x] 11-09 03:41:51 056721ce71 Rename test class to match the tested class
• [x] 11-09 03:41:51 be03dc1583 Refactor TestBackgroundHiveSplitLoader#drain
• [x] 11-09 03:41:51 f543ecee7b Test handling of empty file in BackgroundHiveSplitLoader
• [x] 11-10 07:29:10 02e3f3e269 Extract data type mapping tests to separate classes
• [x] 11-10 07:29:10 17f740d4a4 Add support for DECIMAL in JDBC connectors
• [x] 11-10 07:29:10 7827b238e7 Use convenience utf8Slice(String)
• [x] 11-10 07:29:10 9c75d7def0 Fix formatting

[wenleix]

General

• Allow casting JSON to row with missing fields in JSON object. For example, CAST(JSON '{"foo": 42}' AS ROW(foo BIGINT, bar VARCHAR)) returns {foo=42, bar=null}

[dain]

General

• Fix query failure while logging query plan.
• Fix client hang with LIMIT queries when optimizer.force-single-node-output is disabled.

[nezihyigitbasi]

General

• Fix a bug in the bing_tile_at and bing_tile_polygon functions that may produce incorrect results for points that are close to tile edges.

[kokosing]

General

• Raise proper error message when using catalog that does not exist
• Performance improvement for queries with highly selective filter, where tiny pages are produced. Now tiny pages are merged together, so their synchronization overhead becomes negligible.

[losipiuk]

Kafka connector

• Fix documentation concering raw decoder

JDBC connectors (MySQL, PostgreSQL, SqlServer, Redshift)

• Change mapping for columns with DECIMAL(p,s) data type. Previously such columns were mapped to Presto's DOUBLE type and now to corresponding DECIMAL type.

[highker]

SPI

• Deprecate SliceArrayBlock

Hive

• Save memory usage when reading table columns containing string values from ORC or DWRF files. This can lead to high GC overhead or out-of-memory crash.

[electrum]

General Changes
---------------

* Execute :doc:`/sql/use` on the server rather than in the CLI, allowing it
  to be supported by any client. This requires clients to add support for
  the protocol changes (otherwise the statement will be silently ignored).

Security Changes
----------------

* Support configuring multiple authentication types, which allows supporting
  clients that have different authentication requirements or gracefully
  migrating between authentication types without needing to update all clients
  at once. Specify multiple values for ``http-server.authentication.type``,
  separated with commas.
* Add support for TLS client certificates as an authentication mechanism by
  specifying ``CERTIFICATE`` for ``http-server.authentication.type``.
  The distinguished name from the validated certificate will be provided as a
  ``javax.security.auth.x500.X500Principal``. The certificate authority (CA)
  used to sign client certificates will be need to be added to the HTTP server
  KeyStore (should technically be a TrustStore but separating them out is not
  yet supported).
* Skip sending final leg of SPNEGO authentication when using Kerberos.

JDBC Driver Changes
-------------------

* Per the JDBC specification, close the ``ResultSet`` when ``Statement`` is closed.
* Add support for TLS client certificate authentication by configuring the
  ``SSLKeyStorePath`` and ``SSLKeyStorePassword`` parameters.
* Add support for transactions using SQL statements or the standard JDBC mechanism.
* Allow executing the ``USE`` statement. Note that this is primarily useful when
  running arbitrary SQL on behalf of users. For programmatic use, continuing
  to use ``setCatalog()`` and ``setSchema()`` on ``Connection`` is recommended.
* Allow executing ``SET SESSION`` and ``RESET SESSION``.

Hive Changes
------------

* Do not require setting ``hive.metastore.uri`` when using the file metastore.

[AlekseiS]

Add support for index joins to Thrift connector.

[sopel39]

General

• Fix scope semantics when lambda argument shadows relation column
• Add support for dereference expressions to relation columns from lambda body

[rongrong]

Add SessionPropertyConfigurationManager plugin to enable overriding default session properties dynamically.