Dry-run API for event ingestion - Githubissues

GreptimeTeam / greptimedb

An open-source, cloud-native, unified time series database for metrics, logs and events with SQL/PromQL supported. Available on GreptimeCloud.

https://greptime.com/

Apache License 2.0

4.19k stars 299 forks source link

Dry-run API for event ingestion #4415

Closed sunng87 closed 1 week ago

sunng87 commented 1 month ago

What type of enhancement is this?

API improvement

What does the enhancement do?

The idea is to provide a dry-run API for user to test their pipeline and input data.

Features we need from this API:

Accepts saved pipeline name or raw pipeline definition (without saving)
Accepts all formats that supported by ingest API
Output data just like select * from <table>
Provide error information of pipeline or data

This API will be the key for our pipeline manager/editor

Implementation challenges

No response

paomian commented 1 week ago

relate https://github.com/GreptimeTeam/greptimedb/pull/4667