[DEPRECATED] Promscale is a unified metric and trace observability backend for Prometheus, Jaeger and OpenTelemetry built on PostgreSQL and TimescaleDB.
Hi team, I have installed prom-migrator to migrate my Prometheus data to another storage.
I have installed and run it successfully but the process always was killed cause out of memory.
I have set time duration (2 minutes ), increment duration (1 minute), and file size (10MB) is too small but still an error.
Hi team, I have installed prom-migrator to migrate my Prometheus data to another storage.
I have installed and run it successfully but the process always was killed cause out of memory. I have set time duration (2 minutes ), increment duration (1 minute), and file size (10MB) is too small but still an error.
prom-migrator -reader-url=http://localhost:9090/api/v1/read -writer-url=http://localhost:19291/api/v1/receive -progress-enabled=false -gc-on-push=true -start=1678886762 -end=1678888800 -max-read-duration=2m -max-read-size=10MBlevel=info ts=2023-03-16T04:38:03.825Z caller=writer.go:85 msg="writer is up" level=info ts=2023-03-16T04:38:03.825Z caller=shards.go:106 msg="shard-0 is active" level=info ts=2023-03-16T04:38:03.825Z caller=reader.go:65 msg="reader is up" progress: 2.94% | slab-1 time-range: 1 mins | start: 1678886762 | end: 1678886822 | pulling (0/1) ... 14% |█████ | progress: 2.94% | slab-1 time-range: 1 mins | start: 1678886762 | end: 1678886822 | pulling (0/1) ... 28% |███████████ | progress: 2.94% | slab-1 time-range: 1 mins | start: 1678886762 | end: 1678886822 | pulling (1/1) ... 28% |███████████ |progress: 8.83% | slab-2 time-range: 2 mins | start: 1678886822 | end: 1678886942 | pulling (0/1) ... 14% |█████ | progress: 2.94% | slab-1 time-range: 1 mins | start: 1678886762 | end: 1678886822 | pulling (1/1) ... 22% |████████ | progress: 2.94% | slab-1 time-range: 1 mins | start: 1678886762 | end: 1678886822 | pulling (1/1) ... 33% |█████████████ | progress: 2.94% | slab-1 time-range: 1 mins | start: 1678886762 | end: 1678886822 | preparing to push 33% |█████████████ | progress: 2.94% | slab-1 time-range: 1 mins | start: 1678886762 | end: 1678886822 | preparing to push 44% |█████████████████ | progress: 2.94% | slab-1 time-range: 1 mins | start: 1678886762 | end: 1678886822 | pushing ... 44% |█████████████████ | [5s: progress: 2.94% | slab-1 time-range: 1 mins | start: 1678886762 | end: 1678886822 | pushing ... 55% |██████████████████████ | [5s: progress: 2.94% | slab-1 time-range: 1 mins | start: 1678886762 | end: 1678886822 | pushing (1/1) ... 55% |██████████████████████ | progress: 2.94% | slab-1 time-range: 1 mins | start: 1678886762 | end: 1678886822 | pushing (1/1) ... 66% |██████████████████████████ | progress: 2.94% | slab-1 time-range: 1 mins | start: 1678886762 | end: 1678886822 | pushed 0.00 MB. Memory footprint: 0.05 MB. 66% |████████████████ progress: 2.94% | slab-1 time-range: 1 mins | start: 1678886762 | end: 1678886822 | pushed 0.00 MB. Memory footprint: 0.05 MB. 100% |████████████████████████████████████████| progress: 8.83% | slab-2 time-range: 2 mins | start: 1678886822 | end: 1678886942 | pulling (0/1) ... 28% |███████████ | progress: 8.83% | slab-2 time-range: 2 mins | start: 1678886822 | end: 1678886942 | pulling (1/1) ... 28% |███████████ | [22s:56s]level=info ts=2023-03-16T04:38:31.465Z caller=planner.go:258 msg="decreasing time-range delta to 1 minute(s) since size beyond permittable limits" progress: 11.78% | slab-3 time-range: 1 mins | start: 1678886942 | end: 1678887002 | pulling (0/1) ... 14% |█████ progress: 8.83% | slab-2 time-range: 2 mins | start: 1678886822 | end: 1678886942 | pulling (1/1) ... 22% |████████ | progress: 8.83% | slab-2 time-range: 2 mins | start: 1678886822 | end: 1678886942 | pulling (1/1) ... 33% |█████████████ | progress: 8.83% | slab-2 time-range: 2 mins | start: 1678886822 | end: 1678886942 | preparing to push 33% |█████████████ | [22s:1m7s]Killed