How to select only particular stream(s)?

[pnadolny13]

In GitLab by @knkarthik on Jul 7, 2020, 13:02

I only want pipelines and extended pipelines streams. How can I achieve this?

[pnadolny13]

In GitLab by @DouweM on Jul 14, 2020, 11:13

@knkarthik Did you see the section on entity selection at https://meltano.com/#meltano-select? I think this would do it:

meltano select tap-gitlab "pipelines" "*"
meltano select tap-gitlab "pipelines_extended" "*"

[pnadolny13]

In GitLab by @DouweM on Jul 14, 2020, 11:13

assigned to @DouweM

[pnadolny13]

In GitLab by @knkarthik on Jul 17, 2020, 14:09

@DouweM Sorry I should've been clearer - I'm using singer not meltano. Looking at the code I guess there's no way to achieve this outside of meltano.

[pnadolny13]

In GitLab by @DouweM on Jul 17, 2020, 17:22

@knkarthik Ah, my bad! I had thought this was an issue on https://gitlab.com/meltano/meltano, not https://gitlab.com/meltano/tap-gitlab :face_palm:

You're totally right, tap-gitlab does not currently support entity selection, not even in Meltano. This would require implementing discovery mode, which I created an issue for a while ago: https://gitlab.com/meltano/tap-gitlab/-/issues/25, but that hasn't become a priority yet.

Would you be interested in contributing this functionality, by any chance? :smiley:

[pnadolny13]

In GitLab by @DouweM on Jul 17, 2020, 17:22

marked this issue as a duplicate of #25

[pnadolny13]

In GitLab by @DouweM on Jul 17, 2020, 17:22

marked this issue as related to #25