search

googleapis / java-pubsublite-spark

Apache License 2.0
16 stars 13 forks source link

support for pubsub proper #399

Closed chinwobble closed 2 years ago

chinwobble commented 2 years ago

Thanks for stopping by to let us know something could be better!

PLEASE READ: If you have a support contract with Google, please create an issue in the support console instead of filing on GitHub. This will ensure a timely response.

Is your feature request related to a problem? Please describe. We are currently using publishing clickstream events to pubsub and would like to do real time transformations on them using apache spark. The clickstream is published the snowplow library and it is difficult to change the target to pubsublite.

Is it possible for this library to read from pubsub proper subscriptions or is there some mechanism where pubsub lite subscription can get messages from a pubsub proper topic.

Describe the solution you'd like Add a spark connector to read from pubsub subscription.

Describe alternatives you've considered Any alternative solutions or features you've considered.

Additional context Any other context or screenshots about the feature request.

dpcollins-google commented 2 years ago

Hello,

This is out of scope for this library, which is only focused on Pub/Sub Lite. If you want this feature, you can file a request through the public issue tracker (https://issuetracker.google.com/savedsearches/559741)

-Daniel