tsbs_load load timescaledb error

[ruoshui9527]

tsbs_generate_data --use-case="iot" --seed=123 --scale=4000 \ --timestamp-start="2024-03-10T00:00:00Z" \ --timestamp-end="2024-03-12T00:00:00Z" \ --log-interval="10s" --format="timescaledb" \ | gzip > /tmp/timescaledb-data.gz

use tsbs_load:

./tsbs_load config --target=timescaledb --data-source=FILE

vi After modifying the relevant content, execute ./tsbs_load load timescaledb --config=./config.yaml Using config file: ./config.yaml 2024/03/12 11:50:22 input header in wrong format. got '%!s(uint8=31)', expected 'tags'

use tsbs_load_timescaledb:

cat /tmp/timescaledb-data.gz | gunzip | ./tsbs_load_timescaledb \

--postgres="sslmode=disable" --host="192.168.1.10" --port=5433 --pass="111111" \ --user="postgres" --admin-db-name=tsbs --workers=8 \ --in-table-partition-tag=true --chunk-time=8h --write-profile= \ --field-index-count=1 --do-create-db=true --force-text-format=false \ --do-abort-on-exist=false --create-metrics-table=true could not execute sql: SELECT create_hypertable('readings'::regclass, 'time'::name, replication_factor => NULL, chunk_time_interval => 28800000000, create_defe_hypertable(regclass, name, replication_factor => unknown, chunk_time_interval => bigint, create_default_indexes => boolean) does not exist (SQLSTATE 42883)

goroutine 1 [running]: github.com/timescale/tsbs/pkg/targets/timescaledb.MustExec(0x8d8971?, {0xc0000e6000, 0x9b}, {0x0?, 0x4?, 0x8?}) /home/ps/tsbs-master/pkg/targets/timescaledb/creator.go:296 +0xd0 github.com/timescale/tsbs/pkg/targets/timescaledb.(dbCreator).createTableAndIndexes(0xc00008a0f0, 0xc000128dd0, {0xc000178140, 0x8}, {0xc00016a280, 0x8, 0x8} /home/ps/tsbs-master/pkg/targets/timescaledb/creator.go:224 +0x6ff github.com/timescale/tsbs/pkg/targets/timescaledb.(dbCreator).PostCreateDB(0xc00008a0f0, {0x8bc0b4?, 0x9?}) /home/ps/tsbs-master/pkg/targets/timescaledb/creator.go:105 +0x365 github.com/timescale/tsbs/load.(CommonBenchmarkRunner).useDBCreator(0xc000122790, {0x971cf8, 0xc00008a0f0}) /home/ps/tsbs-master/load/loader.go:252 +0x215 github.com/timescale/tsbs/load.(CommonBenchmarkRunner).preRun(0xc000122790, {0x972660, 0xc00068e000}) /home/ps/tsbs-master/load/loader.go:128 +0x72 github.com/timescale/tsbs/load.(*CommonBenchmarkRunner).RunBenchmark(0xc000122790, {0x972660, 0xc00068e000}) /home/ps/tsbs-master/load/loader.go:184 +0x37 main.main() /home/ps/tsbs-master/cmd/tsbs_load_timescaledb/main.go:102 +0x213

[moaazassali]

I am getting the same error input header in wrong format. got '%!s(uint8=31)', expected 'tags'. Did you find a solution?

[Koheiru]

There are two different issues described.

The first one is like a feature =) It is about that tsbs_load tool couldn't read compressed file with metrics. Error message input header in wrong format. got '%!s(uint8=31)', expected 'tags' is a marker of this issue. So, you can do one of the following:

• use pipe as described in documentation

  #> cat /tmp/timescaledb-data.gz | gunzip | ./tsbs_load_timescaledb ...

• store and use decompressed version of the logs-file

  #> cat /tmp/timescaledb-data.gz | gunzip > /tmp/timescaledb-data.txt
  #> tsbs_load config --target=timescaledb --data-source=/tmp/timescaledb-data.txt
  ... modify config ...
  #> tsbs_load load timescaledb --config=./config.yaml

The second issue is critical and there is no workaround but I've already create fix for this issue (check #255). So, you can merge my fix or just use older version of timescaledb.