Open senkr132 opened 5 months ago
@senkr132 Are you able to decode the incoming payload using protoc --decode
and the desc file you created? That would help isolate the issue. If you could share one of the payloads here, too, that would be helpful.
@jszwedko - i tried the following approach
Also i recorded the payload coming from Grafana Agent by letting it to pass thorough the HTTP source and write it to file using the File sink which uses raw_message codec and native.
My expertise on prtobuf is limited - please let me know if anything else i can try.
Attached the payload written to a file vector-2024-03-08-native.log vector-2024-03-08-raw-message.log
Hmm the first failure makes me think that the file isn't valid protobuf which means it may not have passed through without alteration. I might try capturing it in a different way: maybe using netcat
.
A note for the community
Problem
We have some of the sources which are sending logs using Grafana Agent and we would like to use the HTTP server as source to consume the protobuf message and transform it before sending to our log aggregation system (Loki).Tried to decode the incoming message using codec = protobuf but it fails to parse the incoming packet
Configuration
Version
0.36.0
Debug Output
Example Data
Just used a simple file in tailing in grafana agent.
Additional Context
Used the proto file from here to generate desc file - https://github.com/grafana/loki/blob/main/pkg/push/push.proto Used the following command to generate the desc file protoc --include_imports -o protobuf_descriptor_set.desc push.proto
References
No response