Release notes for 357

[martint]

Ashhar Hasan

• [x] all checked
• 05-02 22:58:37 6720c9472c Combine testLimitPushDown with testLimit
• 05-02 22:58:37 86d68ef523 Extract limit pushdown tests to BaseJdbcConnectorTest
• 05-02 22:58:37 974996ad2b Reorder declarations in hasBehaviour to match TestingConnectorBehaviour
• 05-04 01:35:51 41be8e36de Fix information_schema query failures in BigQuery connector
• 05-04 06:25:23 02053a6c0b Adjust resource paths for Trino rename
• 05-04 06:25:23 5f87373550 Change test to use table instead of values
• 05-04 06:25:23 a6b811efa6 Inline constants into COUNT over constant aggregation expression
• 05-12 03:45:06 cdb56d4872 Implement aggregation pushdown for ClickHouse
• 05-17 02:27:09 8ec9e634d8 Run iceberg tests on CDH5 and HDP3
• 05-17 05:10:00 3b5267db85 Use airbase property to configure maven-release-plugin

  Dain Sundstrom

• [x] all checked
• 05-11 18:07:03 1e7a75eb27 Fix timezone output in API results
• 05-11 23:37:54 776838ea90 Upgrade to airlift 205

  David Phillips

• [x] all checked
• 05-03 15:46:54 0dfafc8f12 Add the "clear" command to the CLI
• 05-06 11:37:39 6c46f68fbe Fix incorrect and informal use of it's throughout
• 05-13 12:35:33 0bceba454b Add type mapping configuration section
• 05-13 12:37:00 7ef69279f0 Add PostgreSQL version requirement
• 05-13 18:29:32 2c1c240c26 Move write partitioning properties to new chapter
• 05-17 16:06:38 d9709358f1 Upgrade provisio and trino-maven-plugin to allow building with JDK 16
• 05-17 16:44:50 9b88bca36c Run CI checks on JDK 16

  GitHub

• [x] all checked
• 05-13 12:41:57 6983a4e9da Add reference to to_base64url in function list
• 05-13 12:43:57 422b3b7331 Add examples for url_extract_protocol

  Grzegorz Kokosiński

• [x] all checked
• 05-07 12:53:09 0acabe3641 Support JMX stats and lazy connection in Phoenix
• 05-07 12:53:09 2c4cac5c65 Simplify Optional handling in Phoenix
• 05-07 12:53:09 3705c0bc08 Make LazyConnectionFactory injectable
• 05-07 12:53:09 6e3f0bc3e5 Remove extra import
• 05-07 12:53:09 e216e881f5 Rename Presto to Trino in Phoenix
• 05-11 01:43:43 9e9b794335 Make the UI aware of principal-field
• 05-11 05:04:49 792ab8f64c Fix flaky ExternalAuthenticator tests
• 05-11 05:04:49 bbbf61b821 Refactor TestExternalAuthenticator
• 05-11 05:04:49 dedae5708b Remove unused field
• 05-11 12:38:49 105203dbe9 Fix flaky TestingSqlServer setup
• 05-11 12:39:10 25994c45ac Convert TestJdbcConnectorFactory into TestJdbcPlugin
• 05-11 12:39:10 263fab7152 Add TestSqlServerCaseInsensitiveMapping test for SQL Server
• 05-11 12:39:10 3bff56873f Do not fail all queries if there are duplicates
• 05-11 12:39:10 7136d30cef JSON based object mapping in JDBC connectors
• 05-11 12:39:10 da57fb656f Extract identifier mapping from BaseJdbcClient
• 05-14 05:21:42 6a6bbfac23 Do not closeResultSet() when statement is already closed
• 05-14 05:21:42 a400388793 Cancel query when JDBC connection or statement is closed

  Karol Sobczak

• [x] all checked
• 05-04 03:27:10 cd3891cbba Remove json annotations from ConnectorMaterializedViewDefinition
• 05-05 02:54:34 ce2194ac46 Add retries on Elasticsearch 429 HTTP status
• 05-05 08:04:23 500525a680 Fix indent
• 05-05 08:04:23 d56de0e582 Analyze fresh materialized views
• 05-06 08:59:53 a54f24b8ba Remove unused ctor parameter in PlanOptimizers
• 05-07 07:50:48 bdef4171e0 Don't create local query runner
• 05-10 13:19:15 a6e19ff2c5 Make AbstractCostBasedPlanTest#getSourcePath extendable
• 05-11 05:27:59 329cdcc8e6 Use method references instead of lambda
• 05-12 06:57:00 1c32d34515 Avoid null checks in ProcessWorkProcessor
• 05-13 03:13:54 5352cfbf33 Add test for computed statistics
• 05-14 02:33:28 45886793dc Delete unnecessary text file
• 05-14 02:35:56 61ae7e8c78 Fix table headers in docs
• 05-14 02:41:27 02f1345278 Improve output of EquatableValueSet#toString
• 05-14 02:41:27 04d77ef850 Print dynamic filters in EXPLAIN ANALYZE
• 05-14 02:41:27 10309ff24b Add missing (s) to dynamicFilter in PlanPrinter
• 05-14 02:41:27 319c6abbbc Use Domain#toString with limit for DynamicFilterDomainStats
• 05-14 02:41:27 60f73bc7b2 Add limit to Domain#toString SPI
• 05-14 02:41:27 72d02fa18c Improve output of Domain#toString
• 05-14 02:41:27 a80a7c924d Improve formatting of ranges in SortedRangeSet
• 05-14 02:41:27 c4ddfedf40 Add tests on toString methods in Domain

  Martin Traverso

• [x] all checked
• 04-30 18:20:06 3eaf2816f9 Update Trino book badge in README
• 05-03 12:11:57 c3e1b438ab Use more specific argument
• 05-03 12:11:57 f9311ae211 Add support for row subqueries
• 05-04 06:35:35 760a9af7ae Add support for CURRENT_CATALOG and CURRENT_SCHEMA
• 05-04 09:06:16 157b3343dc Remove redundant verify
• 05-04 09:06:16 251a7eb95b Rename methods
• 05-04 09:06:16 56019ce7e6 Suppress exceptions during expression optimization
• 05-04 09:06:16 565c3c522e Refactor CoalesceExpression evaluation
• 05-04 09:06:16 646632958e Refactor SimpleCaseExpression evaluation
• 05-04 09:06:16 7983ae2542 Test SubscriptExpression evaluation
• 05-04 09:06:16 90e2079f0d Fix error messages
• 05-04 09:06:16 930e49c5f0 Simplify testing methods
• 05-04 09:06:16 be0890dcb4 Refactor SearchedCaseExpression evaluation
• 05-04 09:06:16 c18dbdb623 Verify that expression evaluation did not return Expression
• 05-04 09:06:16 c5df3cc4b3 Refactor ArithmeticUnaryExpression optimization
• 05-04 09:06:16 c81d14b5dc Comment DereferenceExpression evaluation
• 05-04 09:06:16 d97ef0dbdc Check arguments count in desugar array constructor
• 05-04 09:06:16 e541e3824a Refactor IfExpression evaluation
• 05-04 10:34:44 ba894ecc36 Make join test insensitive to values optimization
• 05-04 10:34:44 c1bade5725 Add rule to inline projection assignments into ValuesNode
• 05-04 12:08:43 1926093015 Add rule to replace join over constant with project
• 05-04 12:08:43 98b45dbe6b Make spatial join tests insensitive to join optimization
• 05-05 08:11:49 2dc0c28228 Remove trivial null filter
• 05-05 08:11:49 3219bc9c81 Squash identity projections
• 05-05 08:11:49 5ad00945ba Add rule to simplify filter predicate
• 05-05 08:11:49 9988036a3a Add rule to inline project expressions into filter
• 05-06 18:25:41 44d907e17c Add convenience wrapper for single Assignment
• 05-06 18:25:41 f781bf9f2f Unwrap single-column row comparisons in Apply
• 05-06 22:17:18 888ca891f2 Add debug logging for plan transformations
• 05-10 14:01:20 f5d3d3d901 Remove dead code in to_unixtime
• 05-11 08:18:25 0185cd8309 Simplify set operations involving empty sets
• 05-11 17:37:03 735ecd26a4 Documente human_readable_seconds and add it to function list
• 05-11 17:39:48 1f5878b15f Document soundex function
• 05-11 17:42:50 309d86c3d4 Add examples for bitwise right shift functions
• 05-11 18:52:05 23c1ff8a88 Upgrade pinot libraries to 0.6.0
• 05-11 18:52:05 ba77c29a22 Remove references to presto in PinotQueryClient
• 05-12 18:08:58 5b65622bb4 Add a link to the tdigest_agg function from list.rst
• 05-12 18:14:02 4c9c6d7c82 Add map_union example and add it to function list
• 05-14 15:41:15 8a8391e4af Desugar row dereference into row subscript
• 05-17 08:51:27 184522e3f6 Extract encloseInParentheses from FilterToPinotSqlConverter
• 05-17 08:51:27 582af46141 Exclude array types from filters
• 05-17 08:51:27 7b7172e3ab Fix filter parsing for passthrough queries
• 05-17 08:51:27 7e12574b8c Remove commented out code in DynamicTableBuilder
• 05-17 08:51:27 f40db4377c Fix realtype in filter for segment query
• 05-17 12:36:12 3267b918a7 Push cast into row constructor
• 05-17 12:36:12 3c04b83fe2 Unwrap row dereferences
• 05-17 16:59:57 31a11f4a0c Add support for multi-column subqueries in IN predicates and quantified comparisons
• 05-17 18:28:04 46b09d327b Fix prepared grant with quotes

  Piotr Findeisen

• [x] all checked
• 05-07 13:53:27 a28a53f3c9 Add .java-version for jenv
• 05-10 02:24:15 6762b0520f Move Hive testing plugin to tests
• 05-10 07:45:04 c324a51bdc Use correct enum class for system property in test
• 05-10 07:45:04 f221c03054 Add a test for partition filter elimination in Hive
• 05-10 12:59:20 45ee9d3db7 Workaround implicit transactions when using Phoenix JDBC
• 05-10 12:59:20 541edbe222 Simplify transactions in JdbcPageSink
• 05-10 12:59:20 ae38cd56a2 Document why disable auto-commit in read-only transaction
• 05-10 12:59:20 b4f82be8e3 Workaround broken auto-commit reporting in ClickHouse JDBC
• 05-10 12:59:20 e1708c365a Use Phoenix driver explicitly
• 05-10 13:13:59 78cd33e1ae Narrow modernizer exclusions
• 05-12 12:03:11 252a67b3da Enforce ordering of dependency elements in POM files
• 05-12 12:03:11 e31f80b7d3 Update pedantic pom enforcer to 2.0.0
• 05-13 10:11:32 cef28f4b8e Reuse Filter ID when pushing predicate into Table Scan
• 05-17 07:30:53 17052b3839 Resolve potential heap pollution warning
• 05-17 07:30:53 48345edb50 Remove unused method
• 05-17 07:30:53 a555fccbd1 Check list emptiness directly
• 05-17 13:20:09 76a86b838c Upgrade sql server jdbc driver

  Pratham

• [x] all checked
• 05-12 18:43:32 3778e95099 Fix example for Iceberg metadata delete

  Praveen Krishna

• [x] all checked
• 05-06 00:47:42 6b04f8a435 Add support for epoch milli exposed as String in elasticsearch

  Yuya Ebihara

• [x] all checked
• 05-06 01:18:29 4820905f84 Add exit command to the help text
• 05-06 23:04:25 a86f2d9a2a Add support for casting row to json with field name
• 05-07 21:46:36 4afae0b0db Apply @ConfigSecuritySensitive to mongodb.credentials
• 05-08 00:14:02 e11ddcb9e2 Add support for dropping column in MongoDB
• 05-13 17:08:30 4aaef8436e Allow multiple non-static scalar functions in a class
• 05-13 17:08:30 f522fc9fe8 Add format_number function
• 05-17 05:40:40 c540a8e95d Escape single quote in BigQuery string condition
• 05-17 06:00:03 16d6a8f90b Make table wider in Kinesis documentation
• 05-17 06:00:03 e0d98fa159 Make Kinesis update interval from S3 configurable
• 05-17 18:21:25 4da93e24b8 Remove obsolete comment in S3TableConfigClient

  Łukasz Osipiuk

• [x] all checked
• 05-07 06:27:48 2454815fa7 Configure list of optimizers via provider

[martint]

* Add support for subquery expressions that return multiple columns. E.g., `SELECT x = (VALUES (1, 'a'))`. ({issue}`7773`)

https://github.com/trinodb/trino/issues/7773

[hashhar]

BigQuery
* Fix failures for queries accessing `information_schema.columns`. ({issue}`7830`)

https://github.com/trinodb/trino/pull/7830

[sopel39]

SPI
* Make ``ConnectorMaterializedViewDefinition`` non-serializable ({issue}`7762`)

https://github.com/trinodb/trino/pull/7762

[hashhar]

General
* Allow aggregation pushdown when `COUNT(1)` is used with `GROUP BY`. ({issue}`7251`)

https://github.com/trinodb/trino/issues/7251, https://github.com/trinodb/trino/pull/7776

[martint]

* Add support for `CURRENT_CATALOG` and `CURRENT_SCHEMA`. ({issue}`7824`)

7824

[sopel39]

Elasticseach:
* Retry requests with backoff when Elasticsearch is overloaded. ({issue}`7423)

https://github.com/trinodb/trino/pull/7423

[sopel39]

General:
* Enforce materialized view creator security policies when view is fresh. ({issue}`7618`)

https://github.com/trinodb/trino/pull/7618

[ebyhr]

General
* Cast `row` to `json` with field names, instead of `array`. This behavior can be restored with the `deprecated.legacy-row-to-json-cast` configuration option. ({issue}`3536`)

3536, #3613

[ebyhr]

MongoDB
* Redact the value of `mongodb.credentials` in the server log. ({issue}`7862`)

7862

[ebyhr]

MongoDB
* Add support for dropping columns. ({issue}`7853`)

7853

[kokosing]

* Make the UI aware of principal-field (configured with `http-server.authentication.oauth2.principal-field`) when using `web-ui.authentication.type=ouath2`. ({issue}`7639`)

7639

[hashhar]

ClickHouse

* Improve performance of aggregation queries by computing aggregations within ClickHouse. Currently, the following aggregate functions are eligible for pushdown: count, min, max, sum and avg. ({issue}`7434`)

https://github.com/trinodb/trino/pull/7434, https://github.com/trinodb/trino/issues/7219

[kokosing]

SQL Server, PostgreSQL, MySQL
* Added JSON based identifier mapping that can be set with `case-insensitive-name-matching.config-file`. ({issue}`7434`)

7841

[ebyhr]

General
* Add {func}`format_number` function. ({issue}`1878`)

1878, #1905

[sopel39]

General
* Print dynamic filters summary in `EXPLAIN ANALYZE`. ({issue}`7874)

https://github.com/trinodb/trino/pull/7874

[kokosing]

JDBC
* Cancel Trino query execution when JDBC connection or statement is closed. ({issue}` 7819`)

7819

[ebyhr]

BigQuery
* Fix query failure when containing a predicate on BigQuery `string` type with single quotes. ({issue}`7784`)

7784, #7869

[ebyhr]

Kinesis
* Allow configuring refresh interval to get table descriptions from S3 via the `kinesis.table-description-refresh-interval` config property. ({issue}`1609`)

1609, #6726

[martint]

* Fix incorrect handling of row expressions in `IN` predicate, quantified comparisons and scalar subqueries. ({issue}`7797`)

7797

[martint]

* Add support for multiple columns in `IN` predicate and quantified comparison subqueries. ({issue}`7863`)

7863

[martint]

* Fix failure when preparing a `GRANT` statement that contains quoted SQL keywords. ({issue}`7941`)

[Praveen2112]

* Elasticseach
Add support for epoch millis exposed as String in elasticsearch

7838

[losipiuk]

General
* Minor performance improvement for queries using `IN` predicate with short list of constants. ({issue}`7840`)

https://github.com/trinodb/trino/pull/7840

[sopel39]

General:
* Reduce memory usage for queries with `WINDOW` clause. ({issue}`7947`)

https://github.com/trinodb/trino/pull/7947

[electrum]

# CLI

* Add `clear` command to clear the screen. ({issue}`7632`)

7632

[kokosing]

# Security
* Do not require configuring truststore for well known certficates for Oauth2 or JWK authentication when secured internal communication is used. ({issue}`7936`)

7936

[Praveen2112]

# Kudu
* Fix query failures for grouped execution on range partitioned kudu tables. ({issue}`7738`)

7745

[hashhar]

# ClickHouse
* Map ClickHouse `UUID` columns as `UUID` type in Trino instead of `VARCHAR`. ({issue}`7097`)

7915, #7097

[electrum]

# Security

* Fix handling of SNI for multiple TLS certificates. ({issue}`8007`)

8007

[losipiuk]

# General
* Fix an issue where sending a large ``EXPLAIN`` query could render the cluster unstable. ({issue}`8017`)

8017

STILL IN FLIGHT cc: @martint