Report "data file in invalid format" when loading data

[sunshinerxu]

The data load program load_timescaledb.sh reports error information , then the process stops.

Environment: CPU:Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz2 Memory：128GB Disk: 200GB SSD, 4TB HDD Network Interface：Intel 82599ES 10-Gigabit2 Docker Image: timescaledb:1.6.1-pg11 from Docker Hub

Script： NUM_WORKERS=40 BATCH_SIZE=10000 BULK_DATA_DIR=./tsdata ./go/src/github.com/timescale/tsbs/scripts/load_timescaledb.sh

Output: Bulk loading file ./tsdata/timescaledb-data.gz

• pg_isready -h localhost localhost:5433 - accepting connections
• cat ./tsdata/timescaledb-data.gz
• gunzip
• /home/tsbs/go/bin/tsbs_load_timescaledb --postgres=sslmode=disable --db-name=benchmark --host =localhost --user=postgres --port=5433 --workers=40 --batch-size=10000 --reporting-period=10s --use-hypertable=true --use-jsonb-tags=false --in-table-partition-tag=true --hash-workers=false --time-partition-index=false --partitions=1 --chunk-time=8h --write-profile= --field-index-count=1 --do-create-db=true --force-text-format=falsetime,per. metric/s,metric total,overall metric/s,per. row/s,row total,overall row/s 1587711242,2643131.91,2.644480E+07,2643131.91,528730.33,5.290000E+06,528730.33 1587711252,2799028.55,5.444991E+07,2721080.99,559703.60,1.089000E+07,544217.12 1587711262,2731927.99,8.175475E+07,2724694.13,546288.75,1.635000E+07,544907.18 1587711272,2678968.47,1.085444E+08,2713264.17,535999.85,2.171000E+07,542680.63 1587711282,2875825.70,1.373027E+08,2745773.15,575000.02,2.746000E+07,549143.85 1587711292,2706018.79,1.643629E+08,2739147.99,540999.76,3.287000E+07,547786.61 1587711302,2635174.76,1.907146E+08,2724295.76,527000.23,3.814000E+07,544817.35 1587711312,2739610.14,2.181107E+08,2726209.93,548000.19,4.362000E+07,545215.18 1587711322,2809039.54,2.462011E+08,2735412.70,561999.99,4.924000E+07,547080.05 1587711332,2730225.80,2.735034E+08,2734894.04,545999.88,5.470000E+07,546972.04 1587711342,2609809.17,2.996015E+08,2723523.22,522000.15,5.992000E+07,544701.97 1587711352,2796843.77,3.275699E+08,2729633.00,559000.03,6.551000E+07,545893.43 1587711362,2764614.28,3.552160E+08,2732323.76,553000.06,7.104000E+07,546440.07 1587711372,2734374.67,3.825598E+08,2732470.25,546999.81,7.651000E+07,546480.05 1587711382,2650353.49,4.090635E+08,2726995.96,529997.58,8.181000E+07,545381.25 1587711392,2859353.37,4.376568E+08,2735268.00,572002.99,8.753000E+07,547045.05 1587711402,2775310.38,4.654100E+08,2737623.36,554999.52,9.308000E+07,547512.95 1587711412,2684571.81,4.922557E+08,2734676.14,537000.28,9.845000E+07,546928.93 1587711422,2560156.15,5.178572E+08,2725491.12,511999.87,1.035700E+08,545090.60 1587711432,2874537.94,5.466026E+08,2732943.28,574999.59,1.093200E+08,546586.02 1587711442,2735035.01,5.739530E+08,2733042.88,547000.12,1.147900E+08,546605.73 1587711452,2614275.39,6.000957E+08,2727644.49,523000.44,1.200200E+08,545532.79 1587711462,2670242.29,6.267982E+08,2725148.79,533999.66,1.253600E+08,545031.36 1587711472,2845153.53,6.552497E+08,2730148.88,569000.31,1.310500E+08,546030.05 1587711482,2714677.57,6.823965E+08,2729530.04,542999.91,1.364800E+08,545908.84 1587711492,2624641.87,7.086429E+08,2725495.96,524999.73,1.417300E+08,545104.66 1587711502,2680046.05,7.354433E+08,2723812.66,536000.09,1.470900E+08,544767.46 1587711512,2785988.02,7.633032E+08,2726033.17,557000.00,1.526600E+08,545204.33 1587711522,2644154.61,7.897448E+08,2723209.82,528999.72,1.579500E+08,544645.56 1587711532,2504506.80,8.147899E+08,2715919.84,500999.76,1.629600E+08,543190.73 1587711542,2710326.74,8.418931E+08,2715739.42,542000.79,1.683800E+08,543152.34 1587711552,2798867.36,8.698891E+08,2718337.78,559853.61,1.739800E+08,543674.38 1587711562,2616161.60,8.960444E+08,2715242.34,523126.93,1.792100E+08,543051.89 1587711572,2590590.66,9.219498E+08,2711576.23,518009.41,1.843900E+08,542315.37 2020/04/24 14:59:34 data file in invalid format; got 4901.14user 73.58system 43:49.66elapsed 18 9%CPU (0avgtext+0avgdata 54616maxresident)k expected tags

The data file timescaledb-data.gz is 3-days data generated by the following command : $HOME/go/bin/tsbs_generate_data --use-case="iot" --seed=123 --scale=4000 --times tamp-start="2016-01-01T00:00:00Z" --timestamp-end="2016-01-04T00:00:00Z" --log-interval="10s" --format="timescaledb" | gzip > $HOME/tsdata/timescaledb-data.gz

Does anyone know how to solve this problem?