use otel collector to receive astra traces and send to astra preprocessor (self ingestion of traces)

[autata]

Summary

Does self ingestion of astra traces rather than using the zipkin plugin. I see in other tracing projects, they show functionality with self ingestion. I thought a good way to do this was to utilize otel collector to receive and send spans to the preprocessor.

Uses otel-collector for self-ingestion into the preprocessor. This shows a small change to the bulk ingest api to support otlp collected traces exported using the opensearch exporter.

This is blocked by: https://github.com/slackhq/astra/pull/1054 (and setting a reasonable default, maybe 1% sampling) so we dont go into a spiral of self-ingestion.

Potentially, a better implementation would be to implement the OTLP API as an ingestion input.

Requirements

• [x] I've read and understood the Contributing Guidelines and have done my best effort to follow them.
• [x] I've read and agree to the Code of Conduct.

Screenshot

Note: it looks like a processor is needed to fix duration on this. (todo if we want to merge this example)

[github-actions[bot]]

This PR is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 3 days.