Release notes for 0.190

[electrum]

Aleksei Statkevich

• [x] 11-19 14:08:31 09cb669b98 Move StatementResource to its own package
• [x] 11-19 14:08:31 103b89f2ef Move static inner classes out of StatementResourse
• [x] 11-19 14:08:31 363b28b602 Move RowIterable to its own class
• [x] 11-19 14:08:31 bb8d94660b Fix field name in StatementClient
• [x] 11-19 14:08:31 f83d7cc6e5 Remove unused constants from PrestoResultSet
• [x] 11-19 14:11:39 2e82f977a2 Separate status and data channels in StatementClient

  Dain Sundstrom

• [x] 11-20 11:52:50 f085bf6f1d Update to Swift 0.15.5
• [x] 11-20 20:13:28 92fbcd17ac Update to Swift 0.15.6 to fix non-system classloaders
• [x] 11-21 20:37:44 9fd2a56f8c Add Comparable to JDBC interval objects

  David Phillips

• [x] 11-25 19:50:20 173216dc35 Remove RecordSink interface
• [x] 11-25 19:50:20 1d5b790b57 Add Decimals utility method for reading BigDecimal
• [x] 11-25 19:50:20 5aebbabb37 Replace JDBC connector RecordSink with PageSink
• [x] 11-25 19:50:20 ef7e45803d Replace Cassandra RecordSink with PageSink
• [x] 12-01 13:56:50 9726ec6145 Document Hive setting hive.max-partitions-per-scan
• [x] 12-05 09:25:33 ad86589bc4 Update to Airlift 0.158
• [x] 12-05 15:11:16 709dd8b15a Use explicit charset when creating JSON reader

  Grzegorz Kokosiński

• [x] 11-23 01:26:14 76a0e6c3af Add tpch.q17 test query to big_query tests group
• [x] 11-27 05:07:56 602b202051 Avoid meaningless output from grep command
• [x] 11-27 05:07:56 ffa7c2a5c8 Check also hive metastore port when checking hadoop
• [x] 12-01 11:08:03 198a105125 Ensure proper table cleanup when data setup fails

  Haozhun Jin

• [x] 11-17 17:21:27 db1ed7f524 Add config property for maximum memory for HiveSplitSource buffering

  James Sun

• [x] 11-15 10:39:15 623fb4470a Replace PageProjectionOutput with Work
• [x] 11-28 18:24:40 00f319374d Rename Page/Block::mask to getPositions
• [x] 11-28 18:24:40 2ed4093613 Use session property to switch joins with dictionary
• [x] 11-28 18:24:40 7ed2888338 Abstract page builder for LookupJoinOperator
• [x] 11-28 18:24:40 84ac5b3491 Add benchmark for chains of joins
• [x] 11-28 18:24:40 cb4d77c5d0 Use dictionary mask to avoid block copy in join
• [x] 11-28 18:24:40 ce3293fe3e Add mask interface to blocks

  Jiexi Lin

• [x] 11-28 15:59:34 768c76c5bc Classify TApplicationException as external error
• [x] 11-29 20:32:42 9cb4c9d162 Classify RuntimeTApplicationException as external error

  Martin Traverso

• [x] 11-15 11:06:09 8fcc903a58 Use != to compare booleans instead of ^
• [x] 11-15 11:06:54 00a9dfbfdd Add Jackson serialization support to BingTile
• [x] 11-15 11:10:24 fa04706441 Update minimums when scheduling splits to full nodes
• [x] 11-15 11:17:51 df79e1d851 Remove unnecessary type arguments
• [x] 11-15 11:20:48 832aa77d92 Add submittedQueries counter to SqlQueryManager
• [x] 11-15 11:21:53 79561a17fa Use BatchScanner when loading non-exact ranges
• [x] 11-15 11:34:11 2ba7dd7b1e Fix invalid array_min/max result of containing NaN
• [x] 11-16 10:25:21 09beec8b7b Create dedicated test for GROUPING
• [x] 11-16 10:25:21 7e2e38df3d Fix planning failure with GROUPING and implicit coercions
• [x] 11-16 10:42:40 5e9a9bb95c Support CAST to INTERVAL type
• [x] 11-16 11:32:46 e71fc3ee12 Improve error message when failing cast to decimal
• [x] 11-16 11:59:20 a1f3dde533 Circumvent automatic character encoding detection in Jackson
• [x] 11-21 15:44:09 42895e9616 Sort output of SHOW FUNCTIONS case-insensitive
• [x] 11-23 09:48:39 337f4b13b1 Disallow window functions in HAVING clause
• [x] 11-23 16:36:10 98133a0e49 Decode partition names in FileHiveMetastore
• [x] 11-23 22:27:49 2d8a08474c Fix incorrect pattern for SingleMarkDistinctToGroupBy
• [x] 11-27 12:04:30 3643c05953 Use proper DOUBLE literals in tests
• [x] 11-27 12:04:30 379de7b8ed Fix handling of DECIMAL literals with only integral or only fractional part
• [x] 11-27 12:04:30 687e51f6b5 Speed up TestAnalyzer
• [x] 11-27 12:04:30 90b249401a Convert results to common types before comparing
• [x] 11-27 12:04:30 aab60c5ae1 Remove no-op assignment
• [x] 11-27 12:04:30 d6b70e19fa Round decimals to expected precision in H2QueryRunner
• [x] 11-27 12:04:30 dba2648ddc Enable treatment of fixed point literals as DECIMAL
• [x] 11-27 12:06:22 8267b7f87f Remove auto GC based on code-cache fill level
• [x] 11-27 17:54:34 538b69d6de Remove unused field in MongoPageSource
• [x] 11-27 17:54:34 6f3c8f8cfb Use dedicated method to acquire UTC chronology

  Nezih Yigitbasi

• [x] 11-17 10:10:37 1cb2b6fb1d Update to Airlift 0.157
• [x] 11-21 09:44:13 47573c4a1b Add limits to geometry_to_bing_tiles function
• [x] 11-21 09:44:13 e9447b8479 Optimize geometry_to_bing_tiles function
• [x] 11-22 08:59:31 7f16b343eb Fix arguments to format() call in SingleRowBlockWriter
• [x] 11-22 10:19:14 be7d43005b Update equals methods to get rid of boxing/unboxing
• [x] 11-22 10:21:02 874f3417ec Update deprecated use of SimpleType
• [x] 11-22 10:21:02 b7e0a1d93e Update deprecated use of Throwables.propagate
• [x] 11-29 18:22:20 2ae76804d2 Use static import for StandardTypes.DOUBLE
• [x] 11-29 18:22:20 4c50f28bf5 Add ST_Buffer function
• [x] 11-30 11:43:39 c5e1b7c1b6 Remove redundant end value for the read byte range
• [x] 11-30 14:07:19 7d69468acb Update memory revocation handling in OperatorContext
• [x] 11-30 14:07:19 e74746c9d6 Add an initialize method to the Driver
• [x] 11-30 14:19:14 a7901b68a8 Mark driverBlockedFuture as final
• [x] 11-30 20:56:24 21d1502420 Remove unnecessary method reference
• [x] 11-30 22:39:14 0181961ac9 Fix potential overflow in Bing tile functions
• [x] 11-30 22:39:14 14b9040b6f Replace the if/else chain with a switch
• [x] 11-30 22:39:14 175bc1e325 Remove redundant initializer
• [x] 11-30 22:39:14 64de87c0c9 Remove unnecessary boxing
• [x] 12-01 09:21:40 070db03861 Fix NPE in LocalFileRecordCursor::isNull
• [x] 12-01 14:20:44 0626c090c0 Fix a race condition in Driver
• [x] 12-01 18:05:21 4f749a127a Push down the environment filter to DAO
• [x] 12-01 18:05:21 b646a5ab9a Add a priority column to the db resource group selectors

  Piotr Findeisen

• [x] 11-15 04:46:29 67ee9dd67e Reclassify JDBC connectors changes in release notes

  Raghav Sethi

• [x] 12-04 11:06:38 f8aa440a5a Add query type to selectors table
• [x] 12-04 11:11:51 1e72b279ec Reorder priority and query type in selector constructor

  Rongrong Zhong

• [x] 11-15 16:16:15 1248c8ff06 Augment AggregationNode with ordering information
• [x] 11-15 16:16:15 225d2666f1 Add syntax support for aggregation_function(... ORDER BY ..)
• [x] 11-15 16:16:15 27d5ecb6e5 Execute aggregation function with ORDER BY
• [x] 11-15 16:16:15 329a01203c Import static constant in TestSqlParser
• [x] 11-15 16:16:15 505a9664f2 Add documentation for aggregate with ORDER BY
• [x] 11-15 16:16:15 5d62ac851a Add query plan for agg_function(.. ORDER BY..)
• [x] 11-17 11:34:08 960c1ac16b Add exact match selector support to db-backed resource groups
• [x] 11-28 18:17:39 e0a41b0708 Prune ORDER BY in aggregation when not necessary
• [x] 11-29 15:19:45 8cf12717d3 Add clientTags to queryContext
• [x] 12-04 12:26:03 ce278d0f09 Use more specific name for exact match selector in ResourceGroupDao

  Shixuan Fan

• [x] 11-25 15:22:46 c2eaae8f4f Reduce lowest standard error for approx_distinct

  Wenlei Xie

• [x] 11-16 13:03:12 be2fc0f2ef Avoid unnecessary shuffle before table write
• [x] 11-21 10:23:18 6ef69bf216 Minor cleanup in AbstractTestBlock.assertRetainedSize

  Yi He

• [x] 11-15 10:55:08 aad24e3087 Make thrift retry configurable
• [x] 11-17 22:50:54 cf726cbe98 Fix lost principal passed by TaskUpdateRequest
• [x] 12-01 14:27:56 c8dc628b39 Add metrics for Thrift connector remote requests

  Łukasz Osipiuk

• [x] 11-22 02:56:40 54629737d4 Introduce Page.getSingleValuePage
• [x] 11-22 09:59:52 5f3a0963d2 Include range end in exception message when range out of range
• [x] 11-27 14:45:42 41856d9169 Use AbstractTestFunctions in time related tests
• [x] 11-27 14:45:42 bbe1ed3e34 Expose AbstractTestFunctions.session to subclasses
• [x] 11-27 14:46:59 c0186a7181 Address intermittent failures of testQueryLoggingCount
• [x] 11-27 14:46:59 cefe8b4bfc Fix formatting
• [x] 11-27 14:46:59 df158c52bb Static import currentThread
• [x] 11-30 05:55:19 2d5905161c Accept other default schema name than 'tpch' in AbstractTestIntegrationSmokeTest.testShowSchemas
• [x] 11-30 05:55:19 e77f9c97ee Adapt AbstractTestQueries for connectors that do not support BIGINT
• [x] 11-30 05:56:19 bacd00b8df Skip creation of TPCH tables for type mapping tests
• [x] 11-30 08:41:46 16938f5a7f Inherit TestDateTimeOperators from AbstractTestFunctions
• [x] 11-30 08:45:18 0ddeaedfc6 Extend AbstractTestFunctions.assertInvalidFunction
• [x] 11-30 08:45:18 3cb8b64dd3 Fill in suppressed exceptions in assertInvalid* functions
• [x] 11-30 08:45:18 7f08e8a519 Make assertInvalid* delegates to functionAssertions
• [x] 11-30 08:45:18 dd7948c253 Deprecate unsafe version of assertInvalidFunction
• [x] 11-30 09:34:25 8e47f151a6 Use assertInvalidFunction instead of assertThrows
• [x] 11-30 13:14:22 92309cb907 Use try-resource for FunctionAssertions in testLocale

[shixuan-fan]

General:

approx_distinct now supports standard error in the range of [0.0040625, 0.26000].

[AlekseiS]

No user-facing changes from me.

[nezihyigitbasi]

General Changes

• Add :func:ST_Buffer geospatial function.
• Fix a memory leak on the workers.

Resource Groups Changes

• Add a priority column to the db resource group selectors.

[wenleix]

General

• Avoid shuffle before writing to table if the output has the desired partition property.

Hive

• Improve performance for writing to bucketed table when the output has the desired bucket property (e.g. the output is from bucketed join)

[kokosing]

No user-facing changes from me.

[highker]

General

• Improve join performance up to 50%. The optimization can be turned off by setting config or session property dictionary_processing_join to false.

SPI

• Introduce getPositions interface for Block and Page.
• Remove mask interface for Page.

[martint]

== General

* Fix correctness issue for :func:`array_min` and :func:`array_max` when arrays contain `NaN`.
* Fix planning failure for queries involving GROUPING that require implicit coercions in expressions
  containing aggregate functions.
* Fix failure in :func:`json_extract` for certain UTF-8 sequences.
* Fix potential workload imbalance when using topology-aware scheduling.
* Fix performance regression for queries containing ``DISTINCT`` aggregates over the same column.
* Add support for casting to `INTERVAL` types.
* Improve error handling when a `HAVING` clause contains window functions.
* Allow treating decimal literals as values of the DECIMAL type. This behavior can
  be turned on via the ``parse_decimal_literals_as_double`` session property or 
  ``parse-decimal-literals-as-double`` configuration option.
* Ignore case when sorting the output of `SHOW FUNCTIONS`.
* Improve rendering of BingTile type
* Add JMX counter to track the number of submitted queries.

== Accumulo

* Improve table scan parallelism.

== Hive

* Fix query failures for the file-based metastore implementation when partition column values contain the character ':'.

[rongrong]

General

• Add support for ORDER BY in aggregation function.
• Add exact match source selector to db managed resource group.

[hellium01]

== General

• Fix issue for "show tables" showing empty result when connecting from secured connections.

== Thrift

• Add configuration option in thrift connector for retry times and intervals.
• Add JMX metrics for monitoring thrift connector retry.

[electrum]

Release notes: https://github.com/prestodb/presto/pull/9502