Create table with two special columns: KINESIS_SHARD_ID VARCHAR(2000), SHARD_SEQUENCE_NUMBER VARCHAR(2000) ❌
Create three UDF scripts ✅
Create connection with AWS credentials: ... IDENTIFIED BY 'AWS_ACCESS_KEY=<AWS_ACCESS_KEY>;AWS_SECRET_KEY=<AWS_SECRET_KEY>;AWS_SESSION_TOKEN=<AWS_SESSION_TOKEN>'; ❓
Run import ❌
IMPORT INTO <table_name>
FROM SCRIPT KINESIS_CONSUMER WITH
TABLE_NAME = '<table_name>'
CONNECTION_NAME = 'KINESIS_CONNECTION'
STREAM_NAME = '<stream_name>'
REGION = '<region>';
In order to support the extension mananger we need to add an extension that manages the Kinesis connector.
Steps to configure Kinesis connector
See user guide:
KINESIS_SHARD_ID VARCHAR(2000), SHARD_SEQUENCE_NUMBER VARCHAR(2000)
❌... IDENTIFIED BY 'AWS_ACCESS_KEY=<AWS_ACCESS_KEY>;AWS_SECRET_KEY=<AWS_SECRET_KEY>;AWS_SESSION_TOKEN=<AWS_SESSION_TOKEN>';
❓