slingdata-io / sling-cli

Sling is a CLI tool that extracts data from a source storage/database and loads it in a target storage/database.
https://docs.slingdata.io
GNU General Public License v3.0
301 stars 16 forks source link

MongoDB: Select is not selecting / excluding columns #244

Closed comino closed 2 months ago

comino commented 3 months ago

Issue Description

source: MONGO
target: CLICKHOUSE

default: 
  mode: full-refresh

streams:
  mydb.users: 
    mode: full-refresh
    object: 'mongo_users'
    select: ['email', "_id" ]
2:19PM INF execution succeeded

But the resulting dataset contains the whole user object. I also tried the reverse approach and excluded fields with "-password", but the dataset still contains the password column.

flarco commented 3 months ago

Ah yes, not yet implemented. Will add.

flarco commented 2 months ago

Added in v1.2.3.