search

jaegertracing / jaeger

CNCF Jaeger, a Distributed Tracing Platform
https://www.jaegertracing.io/
Apache License 2.0
20.19k stars 2.4k forks source link

[Feature]: Support Apache Doris as a storage backend #4780

Open YunMuZhe opened 11 months ago

YunMuZhe commented 11 months ago

Requirement

Apache Doris is a high-performance, real-time analytic database based on the MPP architecture and is known for its extreme speed and ease of use. We want to integrate all data into Doris in our applications and It'd be really neat to have Doris integrated as a supported storage backend.

Problem

Choosing other storage backends will add unnecessary complexity to applications by requiring of administrating additional databases just for the sake of storing traces.

Proposal

Add Doris as a supported storage backend. The syntax of Doris is basically the same as MySQL, and it also has the characteristics of clickhouse's temporal database, so support doris should be very fast.

Open questions

In the meantime, what can one do store traces in a Doris database?

jkowall commented 11 months ago

@YunMuZhe Are you going to contribute this backend support or are you just requesting that someone work on it?

YunMuZhe commented 11 months ago

@YunMuZhe Are you going to contribute this backend support or are you just requesting that someone work on it?

I also want to do it myself, but I feel that my abilities may not be up to it, so I request official support. Thanks.

YunMuZhe commented 11 months ago

We wanted to transfer data to Doris through Kafka today, but we tried all day and couldn't send the data to Kafka.

However, according to the guidelines on the official website, the KAFKA_PRODUCER_BROKERS environment variables are passed in but not effective.

This is the errors:

image

And this is the environment of my container:

image

May I ask if this is a problem or if there is a problem with my usage? And what is the correct configuration like?

Finally, may I ask if there are any corresponding guidelines for developing Storage Plugin? I would like to see if it is difficult and evaluate if I am competent for this part of the work.

Thank you for your help.

AkashKumar7902 commented 8 months ago

@yurishkuro is this up for takes ?

yurishkuro commented 8 months ago

@AkashKumar7902 we do not plan to support Doris as an official Jaeger backend. This can be developed as a solution compatible with Jaeger Remote Storage API, but it would need to live outside of jaegertracing GitHub org. So if you want to work on it, feel free, and post a link to the repo here.