open-metadata / OpenMetadata

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.
https://open-metadata.org
Apache License 2.0
5.55k stars 1.05k forks source link

Create connector for PubSub #13643

Open panys9 opened 1 year ago

panys9 commented 1 year ago

Is your feature request related to a problem? Please describe. There are no connector for ingesting metadata from GCP PubSub

Describe the solution you'd like Create a connector for GCP PubSub as a messaging entity

Describe alternatives you've considered Can create a custom connector but needs to be maintained and is harder to configure by the user.

Additional context

heavylemon1 commented 11 months ago

Hello @panys9 @pmbrull ! :wave:

New to the project here, I saw this issue and wanted to know if I can pick it up and start working on it. I have some experience with Data Engineering concepts like ingestions, and some experience working with databases which might help me on this issue.

If that's not the case, that's completely understandable by my side. Thanks!

coreycasmedes commented 3 months ago

I've started working on this one if anyone is interested https://github.com/coreycasmedes/OpenMetadata/tree/ISSUE-13643

haithem-souala commented 3 months ago

+1

SimonDegeorge commented 2 months ago

It would be great to have this feature !

CyberHippo commented 2 months ago

+1

pmbrull commented 1 month ago

hi @coreycasmedes are you still working on it?

coreycasmedes commented 1 month ago

hi @coreycasmedes are you still working on it?

Yes. I was busy for the last month but now I'm actively working on it again