open-metadata / OpenMetadata

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.
https://open-metadata.org
Apache License 2.0
5.21k stars 990 forks source link

Create connector for PubSub #13643

Open panys9 opened 11 months ago

panys9 commented 11 months ago

Is your feature request related to a problem? Please describe. There are no connector for ingesting metadata from GCP PubSub

Describe the solution you'd like Create a connector for GCP PubSub as a messaging entity

Describe alternatives you've considered Can create a custom connector but needs to be maintained and is harder to configure by the user.

Additional context

heavylemon1 commented 9 months ago

Hello @panys9 @pmbrull ! :wave:

New to the project here, I saw this issue and wanted to know if I can pick it up and start working on it. I have some experience with Data Engineering concepts like ingestions, and some experience working with databases which might help me on this issue.

If that's not the case, that's completely understandable by my side. Thanks!

coreycasmedes commented 1 month ago

I've started working on this one if anyone is interested https://github.com/coreycasmedes/OpenMetadata/tree/ISSUE-13643

haithem-souala commented 1 month ago

+1

SimonDegeorge commented 1 week ago

It would be great to have this feature !

CyberHippo commented 1 week ago

+1

pmbrull commented 1 day ago

hi @coreycasmedes are you still working on it?

coreycasmedes commented 1 day ago

hi @coreycasmedes are you still working on it?

Yes. I was busy for the last month but now I'm actively working on it again