ets / tap-spreadsheets-anywhere

GNU Affero General Public License v3.0
31 stars 63 forks source link

SFTP error #61

Open dantodor opened 1 year ago

dantodor commented 1 year ago

Hello!

I'm trying to use the tap within meltano to get a csv file from an sftp server. I set up one locally with docker compose.

Config is what I understood from your examples:

      - path: sftp://testuser:testpwd@localhost//data
        name: orgs
        pattern: "organizations-100.csv"
        start_date: '2010-01-01T00:00:00Z'
        key_properties: []
        format: csv
        delimiter: ","

However, when I run meltano elt ... output is something like this

2023-07-10T08:28:43.707800Z [info     ] INFO Processing 0 selected streams from Catalog cmd_type=extractor name=tap-spreadsheets-anywhere run_id=a74db321-0bd1-443d-acf9-795731dc0543 state_id=2023-07-10T082839--tap-spreadsheets-anywhere--target-duckdb stdio=stderr

For further testing, I ran meltano invoke -d, and the result is:

meltano invoke tap-spreadsheets-anywhere -d
2023-07-10T08:37:04.440135Z [info     ] Environment 'dev' is active
ERROR Unable to write Catalog entry for 'orgs' - it will be skipped due to error 500 Unknown command.
ERROR Unable to write Catalog entry for 'orgs' - it will be skipped due to error module 'smart_open.ssh' has no attribute '_connect'
{
  "streams": []
}

NB, by using the sftp command line I have no issues on connecting and downloading the file.

What am I doing wrong?

Also, syntax for getting from ftp instead of sftp is the same, except for the name of the protocol?

Thank you!