search

quickwit-oss / quickwit-datasource

Quickwit data source for Grafana
GNU Affero General Public License v3.0
36 stars 9 forks source link

Allow using private datasource connect (PDC) #127

Open camerondavison opened 2 months ago

camerondavison commented 2 months ago

I would like to be able to query my quickwit cluster from the grafana cloud. PDC allows you to proxy from grafana cloud into your internal network.

The elasticsearch plugin has a check box on the datasource

Screenshot 2024-05-08 at 11 47 12 AM

https://grafana.com/docs/grafana-cloud/connect-externally-hosted/private-data-source-connect/

ddelemeny commented 2 months ago

Hi, thanks for opening this issue.

I haven't found any guidelines relative to supporting the PDC feature for plugin developers, and I believe the action is not ours to take here. If I understood correctly, the feature allows some plugins on Grafana Cloud to establish their connection through a ssh tunnel with a machine on a private network running the pdc-agent.

This would not likely change the way a plugin works, but it probably requires careful the vetting of plugins which are allowed to reach into Grafana Labs's clients networks.

As mentioned in this discussion, Grafana devs are working to expand the range of supported datasources.

If I've overlooked/missed something about what we can do to enable or facilitate this feature for quickwit, please point me in the right direction!

camerondavison commented 2 months ago

I couldn't find anything either. But I have never made a grafana plug-in. So I thought maybe I was missing something. That is too bad. It would be really nice to work with.

fmassot commented 2 months ago

Let’s ask the grafana team and see what we can do (done on the grafana slack).

sympatheticmoose commented 2 months ago

Hey @camerondavison - I'm David from Grafana Labs. We're currently working on enablement to make it possible for 3rd party plugins to add PDC support. The hope is that this is available in the next couple of month, but we'll be partnering with @fmassot on refining those materials - so that this data source could add support as soon as possible.