slingdata-io / sling-cli

Sling is a CLI tool that extracts data from a source storage/database and loads it in a target storage/database.
https://docs.slingdata.io
GNU General Public License v3.0
299 stars 16 forks source link

Sling issue while inserting data into StarRocks using Parquet Format. #325

Open pawan-chauhan-9560 opened 1 week ago

pawan-chauhan-9560 commented 1 week ago

Issue Description

context canceled

source:  Parquet file ( Created from sql server)
target: Starrocks
streams:
  ./sling run --src-stream 'file:///opt/sling/fastest/*.parquet' --tgt-conn STARROCKS --tgt-object testing.Product' --mode full-refresh
~ could not perform request
Put "http://test:***@privateIP:8040/api/testing/FastestGrowingHSProducts_3_tmp/_stream_load": dial tcp **privateIP**:8040: connect: connection refused

context canceled

~ error writing dataflow to local storage: /tmp/starrocks/testing/Product_3_tmp/2024-06-17T083727.126
~ could not perform request
Put "http://test:***@privateIP:8040/api/testing/Product_3_tmp/_stream_load": dial tcp **privateIP**:8040: connect: connection refused
flarco commented 1 week ago

hi, this seems like it's an issue with your connection. Can you specify the fe_url? if there is a user/password, specify in url correctly (http://myuser:mypass@host.ip:8030) See docs: https://docs.slingdata.io/connections/database-connections/starrocks also make sure sling conns test Starrocks works.

pawan-chauhan-9560 commented 1 week ago

Added the user and password but getting same issue

~ could not perform request Put "http://test:***@192.168.191.1:8040/api/testing/FastestGrowingHSProducts_3_tmp/_stream_load": dial tcp 192.168.191.1:8040: connect: connection refused

flarco commented 1 week ago

That's strange. Since I can't reproduce this, it's hard to tackle. I would suggest trying to load into your instance via the curl command to see if you're getting that error. connection refused means something is wrong with either your hostname/port Please ensure your fe_url is correct, including the scheme.