search

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
15.48k stars 3.99k forks source link

[source-gitHub] `Projects V2` new streams #35618

Open ball-hayden opened 6 months ago

ball-hayden commented 6 months ago

Connector Name

source-github

Connector Version

v1.5.7

What step the error happened?

None

Relevant information

https://github.com/airbytehq/airbyte/issues/25438 added support for syncing V2 Projects from GitHub.

However, it added support for syncing just the projects, not the contents of the project (which was surprising). So I can get insights into the names of my projects, but not much else.

Please add support for syncing GitHub V2 projects' contents. (Submitted here in response to https://github.com/airbytehq/airbyte/issues/25438#issuecomment-1941374223)

For the avoidance of doubt, this should include at least the following types:

Relevant log output

No response

Contribute

natikgadzhi commented 6 months ago

Hey @ball-hayden, thanks for filing this! Yep, looks like making a separate stream for items would give you the data you want. That stream is not on our roadmap right now, but contributions are welcome.

You could use #30731 as an example and I'd be happy to help and review it, or you could wait for a bit — we'll likely migrate GitHub connector to low-code, and then adding add the stream, but that'll be in a few months.