search

scylladb / gemini

Test data integrity by comparing against an Oracle running in parallel
Apache License 2.0
27 stars 16 forks source link

Gemini failed writing to a "map" type column: Mutation statement generation failed","error":"json: unsupported type: map[interface {}]interface {}"} #388

Closed yarongilor closed 11 months ago

yarongilor commented 11 months ago

Gemini got the following error:

Seed:                   20
Maximum duration:       5m0s
Warmup duration:        1m0s
Concurrency:            2
Test cluster:           [172.17.0.4]
Oracle cluster:         []
Output file:            /gemini_result_d2721fad-9045-454b-b2bc-dd2e1b202167.log
Schema: {
    "keyspace": {
        "replication": {
            "class": "NetworkTopologyStrategy",
            "replication_factor": 1
        },
        "oracle_replication": {
            "class": "SimpleStrategy",
            "replication_factor": 1
        },
        "name": "custom_d1"
    },
    "tables": [
        {
            "name": "posts",
            "partition_keys": [
                {
                    "type": "bigint",
                    "name": "gorge_id"
                },
                {
                    "type": "int",
                    "name": "pail"
                }
            ],
            "clustering_keys": [
                {
                    "type": "bigint",
                    "name": "id"
                }
            ],
            "columns": [
                {
                    "type": {
                        "complex_type": "udt",
                        "value_types": {
                            "id4": "bigint",
                            "name4": "text",
                            "response_type4": "tinyint"
                        },
                        "type_name": "post_action",
                        "frozen": true
                    },
                    "name": "action"
                },
                {
                    "type": "bigint",
                    "name": "prog_id"
                },
                {
                    "type": "bigint",
                    "name": "writer_id"
                },
                {
                    "type": {
                        "complex_type": "udt",
                        "value_types": {
                            "id3": "bigint",
                            "name3": "text",
                            "response_type3": "tinyint"
                        },
                        "type_name": "post_talk",
                        "frozen": true
                    },
                    "name": "talk"
                },
                {
                    "type": "blob",
                    "name": "corporates"
                },
                {
                    "type": "text",
                    "name": "consent"
                },
                {
                    "type": "timestamp",
                    "name": "edited_timestamp"
                },
                {
                    "type": {
                        "complex_type": "list",
                        "value_type": "bigint",
                        "frozen": true
                    },
                    "name": "embeds"
                },
                {
                    "type": "bigint",
                    "name": "flags"
                },
                {
                    "type": {
                        "complex_type": "udt",
                        "value_types": {
                            "id2": "bigint",
                            "name2": "text",
                            "response_type2": "tinyint"
                        },
                        "type_name": "post_inflation",
                        "frozen": true
                    },
                    "name": "inflation"
                },
                {
                    "type": "blob",
                    "name": "inflation_data"
                },
                {
                    "type": {
                        "complex_type": "set",
                        "value_type": "bigint",
                        "frozen": false
                    },
                    "name": "specify_gorge_ids"
                },
                {
                    "type": "boolean",
                    "name": "specify_everyone"
                },
                {
                    "type": {
                        "complex_type": "set",
                        "value_type": "bigint",
                        "frozen": false
                    },
                    "name": "specify_roles"
                },
                {
                    "type": {
                        "complex_type": "set",
                        "value_type": "bigint",
                        "frozen": false
                    },
                    "name": "specifys"
                },
                {
                    "type": {
                        "complex_type": "udt",
                        "value_types": {
                            "id2": "bigint",
                            "name2": "text",
                            "response_type2": "tinyint"
                        },
                        "type_name": "post_reference",
                        "frozen": true
                    },
                    "name": "post_ref"
                },
                {
                    "type": "boolean",
                    "name": "pond"
                },
                {
                    "type": "blob",
                    "name": "promo_data"
                },
                {
                    "type": {
                        "complex_type": "list",
                        "value_type": "bigint",
                        "frozen": true
                    },
                    "name": "label_ids"
                },
                {
                    "type": {
                        "complex_type": "map",
                        "key_type": "bigint",
                        "value_type": "duration",
                        "frozen": true
                    },
                    "name": "label_map"
                },
                {
                    "type": "tinyint",
                    "name": "type"
                },
                {
                    "type": {
                        "complex_type": "map",
                        "key_type": "bigint",
                        "value_type": "timestamp",
                        "frozen": true
                    },
                    "name": "used_responses"
                },
                {
                    "type": {
                        "complex_type": "map",
                        "key_type": "bigint",
                        "value_type": "blob",
                        "frozen": false
                    },
                    "name": "used_responses_by_type"
                },
                {
                    "type": {
                        "complex_type": "udt",
                        "value_types": {
                            "id1": "bigint",
                            "name1": "text",
                            "response_type1": "tinyint"
                        },
                        "type_name": "post_webbook",
                        "frozen": true
                    },
                    "name": "webbook"
                }
            ],
            "known_issues": null,
            "table_options": [
                "bloom_filter_fp_chance = 0.01",
                "caching = {'keys': 'ALL', 'rows_per_partition': 'ALL'}",
                "comment = ''",
                "compaction = {'class': 'IncrementalCompactionStrategy'}",
                "compression = {'sstable_compression': 'org.apache.cassandra.io.compress.LZ4Compressor'}",
                "crc_check_chance = 1.0",
                "dclocal_read_repair_chance = 0.0",
                "default_time_to_live = 0",
                "gc_grace_seconds = 172800",
                "max_index_interval = 2048",
                "memtable_flush_period_in_ms = 0",
                "min_index_interval = 128",
                "read_repair_chance = 0.0",
                "speculative_retry = '99.0PERCENTILE'"
            ]
        }
    ]
}
{"L":"INFO","T":"2023-07-12T12:24:35.743Z","N":"warmup cycle","M":"start jobs"}
{"L":"INFO","T":"2023-07-12T12:24:35.743Z","N":"generators","M":"starting partition key generation loop"}
{"L":"INFO","T":"2023-07-12T12:24:35.743Z","N":"warmup cycle.warmup","M":"starting warmup loop"}
{"L":"INFO","T":"2023-07-12T12:24:35.743Z","N":"warmup cycle.warmup","M":"starting warmup loop"}
{"L":"INFO","T":"2023-07-12T12:25:35.744Z","N":"warmup cycle","M":"jobs time is up, begins jobs completion"}
{"L":"INFO","T":"2023-07-12T12:25:35.826Z","N":"warmup cycle.warmup","M":"ending warmup loop"}
{"L":"INFO","T":"2023-07-12T12:25:35.827Z","N":"warmup cycle.warmup","M":"ending warmup loop"}
{"L":"INFO","T":"2023-07-12T12:25:35.827Z","N":"work cycle","M":"start jobs"}
{"L":"INFO","T":"2023-07-12T12:25:35.827Z","N":"work cycle.validation_job","M":"starting validation loop"}
{"L":"INFO","T":"2023-07-12T12:25:35.828Z","N":"work cycle.mutation_job","M":"starting mutation loop"}
{"L":"INFO","T":"2023-07-12T12:25:35.828Z","N":"work cycle.mutation_job","M":"starting mutation loop"}
{"L":"INFO","T":"2023-07-12T12:25:35.828Z","N":"work cycle.validation_job","M":"starting validation loop"}
{"L":"ERROR","T":"2023-07-12T12:25:35.830Z","N":"work cycle.mutation_job","M":"Failed! Mutation statement generation failed","error":"json: unsupported type: map[interface {}]interface {}"}
{"L":"INFO","T":"2023-07-12T12:25:35.830Z","N":"work cycle.mutation_job","M":"ending mutation loop"}
{"L":"ERROR","T":"2023-07-12T12:25:35.830Z","N":"work cycle.mutation_job","M":"Failed! Mutation statement generation failed","error":"json: unsupported type: map[interface {}]interface {}"}
{"L":"INFO","T":"2023-07-12T12:25:35.831Z","N":"work cycle.mutation_job","M":"ending mutation loop"}
{"L":"INFO","T":"2023-07-12T12:25:35.836Z","N":"work cycle.validation_job","M":"ending validation loop"}
{"L":"INFO","T":"2023-07-12T12:25:35.924Z","N":"work cycle.validation_job","M":"ending validation loop"}
{"L":"INFO","T":"2023-07-12T12:25:35.924Z","M":"test finished"}
gemini encountered errors, exiting with non zero status
Error: gemini encountered errors, exiting with non zero status
$ docker run --rm scylladb/hydra-loaders:gemini-v1.8.6 gemini --version
gemini version 1.8.6, commit 2a125f3f24cafa8d0d23298d407693cc0d42549a, date 2023-07-06T11:36:25Z

sct.log posts2.json.gz

dkropachev commented 11 months ago

It is known problem, let's address this particular instance of the issue here