search

trinodb / trino

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
https://trino.io
Apache License 2.0
10.4k stars 3k forks source link

Create plan for Kinesis connector changes #23921

Open mosabua opened 1 week ago

mosabua commented 1 week ago

The Kinesis connector seems to have very limited usage from looking at slack conversations and vendor data.

The current connector codebase uses a old, deprecated SDK for Kinesis that is now in maintenance mode and will be completely deprecated in 2025. Nobody is available to improve the connector and upgrade it to the newer SDK.

This issue was raised in a maintainer call on the 24th of October 2024 by @wendigo and discussed with all the present maintainers.

We are contemplating removal of the connector similar to #23792 .

We are currently looking for more input and data about potential usage. Please comment in this ticket if you are using the Kinesis connector.

More importantly we are also looking for contributors who are willing to update the connector to the new SDK.

raunaqmorarka commented 1 week ago

That connector was contributed to Trino by one of my colleagues at Qubole. We contributed it because we had no customers using it, didn't want to invest any more in maintaining it and thought that giving it to the community might breathe some life into it. My impression is that it has stayed unused in Trino as well and it should be okay to remove it.

mosabua commented 1 week ago

I prepared a PR in case we want to go ahead with removal - which seems likely at this stage.

mosabua commented 3 days ago

I reached out to AWS team and Amazon Kinesis team .. hopefully we get some input from them.