search

milvus-io / milvus

A cloud-native vector database, storage for next generation AI applications
https://milvus.io
Apache License 2.0
30.49k stars 2.92k forks source link

fail to deal the insert data, error: unable to cast \ \ of type string to int64: invalid parameter[expected=Int64][actual=][Bug]: #29952

Closed lingaswami closed 8 months ago

lingaswami commented 10 months ago

Is there an existing issue for this?

Environment

- Milvus version:
- Deployment mode(standalone or cluster):
- MQ type(rocksmq, pulsar or kafka):    
- SDK version(e.g. pymilvus v2.0.0rc2):
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

curl --request POST \ --url "${MILVUS_HOST}:${MILVUS_PORT}/v1/vector/insert" \ --header "Authorization: Bearer ${TOKEN}" \ --header "accept: application/json" \ --header "content-type: application/json" \ -d '{ "collectionName": "medium_articles", "data": [{ "vector": [0.23254494, 0.01374953, 0.88497432, 0.05292784, 0.02204868, 0.21890409, 0.35428028, 0.97024438, 0.58635726, 0.67980838, 0.67202523, 0.16375636, 0.52829526, 0.80185865, 0.71167799, 0.98615784, 0.86350404, 0.64295726, 0.37624468, 0.99708253, 0.46243643, 0.32893164, 0.32094438, 0.47701896, 0.85275669, 0.13127097, 0.5889451, 0.97648346, 0.74876674, 0.66409428, 0.92279568, 0.59029588, 0.495616, 0.12791323, 0.90082737, 0.84513226, 0.47542935, 0.74928086, 0.44922073, 0.1020575, 0.37431645, 0.29738807, 0.71098564, 0.35390859, 0.87792487, 0.89928066, 0.4995833, 0.61043433, 0.55303136, 0.02036885, 0.02231103, 0.67648899, 0.72165575, 0.15671427, 0.00546115, 0.28756084, 0.15077446, 0.65105982, 0.44063386, 0.07762012, 0.59994796, 0.19935778, 0.58911788, 0.54601686, 0.47097711, 0.90082361, 0.05595469, 0.38546197, 0.91447695, 0.33456871, 0.12778749, 0.82224433, 0.3223666, 0.56243253, 0.72730363, 0.42176339, 0.02008885, 0.11265533, 0.71246733, 0.86685866, 0.5204902, 0.1653007, 0.80375364, 0.14031363, 0.76868394, 0.35325028, 0.1142984, 0.95218926, 0.37508951, 0.01396396, 0.16322817, 0.69052937, 0.30264489, 0.40555134, 0.06153988, 0.00101791, 0.18618961, 0.77599691, 0.3445008, 0.7106463, 0.13440427, 0.64690627, 0.40818622, 0.07025781, 0.89639434, 0.00494204, 0.10540909, 0.47865809, 0.47316137, 0.46836499, 0.93197388, 0.24012326, 0.49471039, 0.21283529, 0.47370547, 0.95777027, 0.50557255, 0.12809693, 0.79998351, 0.76532556, 0.3412945, 0.72270631, 0.3432966, 0.81465781, 0.6924483, 0.2885265, 0.84673871, 0.38711232, 0.18702427, 0.49496971, 0.65431764, 0.39590077, 0.31226873, 0.20910631, 0.86433119, 0.51681312, 0.77759473, 0.42447517, 0.05762998, 0.17887886, 0.41045186, 0.09120965, 0.6447974, 0.49632173, 0.72730052, 0.26646776, 0.48899696, 0.33221734, 0.98206029, 0.82591894, 0.28478645, 0.37324246, 0.35833242, 0.96558445, 0.5003729, 0.66676758, 0.7230707, 0.21599462, 0.70457393, 0.11649283, 0.03034646, 0.00318578, 0.57941155, 0.80640383, 0.30106438, 0.84618622, 0.02321722, 0.6453211, 0.31889303, 0.20069267, 0.19202631, 0.84127804, 0.06014367, 0.53307321, 0.78079442, 0.32043145, 0.30207626, 0.08691769, 0.07230655, 0.8059663, 0.03810803, 0.05415744, 0.44057945, 0.19306693, 0.75747746, 0.89299566, 0.82985846, 0.5958096, 0.89525864, 0.07336388, 0.38396764, 0.04846415, 0.56839423, 0.56106259, 0.14302027, 0.85109589, 0.6298057, 0.62168794, 0.24771729, 0.54924417, 0.9061572, 0.97241046, 0.33025088, 0.56675472, 0.72474551, 0.48314604, 0.26248324, 0.22614522, 0.13087051, 0.9292656, 0.80039537, 0.38300443, 0.78520422, 0.29857615, 0.19121419, 0.47509572, 0.35981825, 0.55131999, 0.04348036, 0.02168964, 0.80645188, 0.62876989, 0.70794394, 0.72093526, 0.85172951, 0.24799777, 0.97620833, 0.74877332, 0.92792629, 0.89200055, 0.74500415, 0.84596926, 0.97469625, 0.7171343, 0.30020491, 0.97313677, 0.241573, 0.15498676, 0.21273237, 0.58910547, 0.46249576, 0.01109894, 0.0180376, 0.80975073, 0.12900483, 0.96509751, 0.57304458, 0.73290638, 0.94211456, 0.35197941, 0.15532272, 0.76150926, 0.19317378, 0.72826792, 0.38820115, 0.94187109], "title": "Top 10 In-Demand programming languages to learn in 2020", "link": "https://towardsdatascience.com/top-10-in-demand-programming-languages-to-learn-in-2020-4462eb7d8d3e" }] }'

getting error code : 1804, message : fail to deal the insert data, error: unable to cast \ \ of type string to int64: invalid parameter[expected=Int64][actual=] at milvus

Expected Behavior

curl --request POST \ --url "${MILVUS_HOST}:${MILVUS_PORT}/v1/vector/insert" \ --header "Authorization: Bearer ${TOKEN}" \ --header "accept: application/json" \ --header "content-type: application/json" \ -d '{ "collectionName": "medium_articles", "data": [{ "vector": [0.23254494, 0.01374953, 0.88497432, 0.05292784, 0.02204868, 0.21890409, 0.35428028, 0.97024438, 0.58635726, 0.67980838, 0.67202523, 0.16375636, 0.52829526, 0.80185865, 0.71167799, 0.98615784, 0.86350404, 0.64295726, 0.37624468, 0.99708253, 0.46243643, 0.32893164, 0.32094438, 0.47701896, 0.85275669, 0.13127097, 0.5889451, 0.97648346, 0.74876674, 0.66409428, 0.92279568, 0.59029588, 0.495616, 0.12791323, 0.90082737, 0.84513226, 0.47542935, 0.74928086, 0.44922073, 0.1020575, 0.37431645, 0.29738807, 0.71098564, 0.35390859, 0.87792487, 0.89928066, 0.4995833, 0.61043433, 0.55303136, 0.02036885, 0.02231103, 0.67648899, 0.72165575, 0.15671427, 0.00546115, 0.28756084, 0.15077446, 0.65105982, 0.44063386, 0.07762012, 0.59994796, 0.19935778, 0.58911788, 0.54601686, 0.47097711, 0.90082361, 0.05595469, 0.38546197, 0.91447695, 0.33456871, 0.12778749, 0.82224433, 0.3223666, 0.56243253, 0.72730363, 0.42176339, 0.02008885, 0.11265533, 0.71246733, 0.86685866, 0.5204902, 0.1653007, 0.80375364, 0.14031363, 0.76868394, 0.35325028, 0.1142984, 0.95218926, 0.37508951, 0.01396396, 0.16322817, 0.69052937, 0.30264489, 0.40555134, 0.06153988, 0.00101791, 0.18618961, 0.77599691, 0.3445008, 0.7106463, 0.13440427, 0.64690627, 0.40818622, 0.07025781, 0.89639434, 0.00494204, 0.10540909, 0.47865809, 0.47316137, 0.46836499, 0.93197388, 0.24012326, 0.49471039, 0.21283529, 0.47370547, 0.95777027, 0.50557255, 0.12809693, 0.79998351, 0.76532556, 0.3412945, 0.72270631, 0.3432966, 0.81465781, 0.6924483, 0.2885265, 0.84673871, 0.38711232, 0.18702427, 0.49496971, 0.65431764, 0.39590077, 0.31226873, 0.20910631, 0.86433119, 0.51681312, 0.77759473, 0.42447517, 0.05762998, 0.17887886, 0.41045186, 0.09120965, 0.6447974, 0.49632173, 0.72730052, 0.26646776, 0.48899696, 0.33221734, 0.98206029, 0.82591894, 0.28478645, 0.37324246, 0.35833242, 0.96558445, 0.5003729, 0.66676758, 0.7230707, 0.21599462, 0.70457393, 0.11649283, 0.03034646, 0.00318578, 0.57941155, 0.80640383, 0.30106438, 0.84618622, 0.02321722, 0.6453211, 0.31889303, 0.20069267, 0.19202631, 0.84127804, 0.06014367, 0.53307321, 0.78079442, 0.32043145, 0.30207626, 0.08691769, 0.07230655, 0.8059663, 0.03810803, 0.05415744, 0.44057945, 0.19306693, 0.75747746, 0.89299566, 0.82985846, 0.5958096, 0.89525864, 0.07336388, 0.38396764, 0.04846415, 0.56839423, 0.56106259, 0.14302027, 0.85109589, 0.6298057, 0.62168794, 0.24771729, 0.54924417, 0.9061572, 0.97241046, 0.33025088, 0.56675472, 0.72474551, 0.48314604, 0.26248324, 0.22614522, 0.13087051, 0.9292656, 0.80039537, 0.38300443, 0.78520422, 0.29857615, 0.19121419, 0.47509572, 0.35981825, 0.55131999, 0.04348036, 0.02168964, 0.80645188, 0.62876989, 0.70794394, 0.72093526, 0.85172951, 0.24799777, 0.97620833, 0.74877332, 0.92792629, 0.89200055, 0.74500415, 0.84596926, 0.97469625, 0.7171343, 0.30020491, 0.97313677, 0.241573, 0.15498676, 0.21273237, 0.58910547, 0.46249576, 0.01109894, 0.0180376, 0.80975073, 0.12900483, 0.96509751, 0.57304458, 0.73290638, 0.94211456, 0.35197941, 0.15532272, 0.76150926, 0.19317378, 0.72826792, 0.38820115, 0.94187109], "title": "Top 10 In-Demand programming languages to learn in 2020", "link": "https://towardsdatascience.com/top-10-in-demand-programming-languages-to-learn-in-2020-4462eb7d8d3e" }] }'

get out put with out error

Steps To Reproduce

No response

Milvus Log

No response

Anything else?

No response

xiaofan-luan commented 10 months ago

please share your schema.

yanliang567 commented 10 months ago

@lingaswami besides, please share the mivus version and milvus logs refer this doc to export the whole Milvus logs for investigation? For Milvus installed with docker-compose, you can use docker-compose logs > milvus.log to export the logs.

/assign @lingaswami

lingaswami commented 10 months ago

mivus version is v2.3.4

milvus logs 2024/01/12-14:52:17.969821 24 RocksDB version: 6.29.5 2024/01/12-14:52:17.971628 24 Git sha 0 2024/01/12-14:52:17.971634 24 Compile date 2024-01-01 23:59:07 2024/01/12-14:52:17.971637 24 DB SUMMARY 2024/01/12-14:52:17.971638 24 DB Session ID: LIQCABPC1KL2CHE44MQH 2024/01/12-14:52:17.979792 24 CURRENT file: CURRENT 2024/01/12-14:52:17.979797 24 IDENTITY file: IDENTITY 2024/01/12-14:52:17.982485 24 MANIFEST file: MANIFEST-000004 size: 116 Bytes 2024/01/12-14:52:17.982496 24 SST files in /var/lib/milvus/rdb_data dir, Total Num: 0, files: 2024/01/12-14:52:17.982500 24 Write Ahead Log file in /var/lib/milvus/rdb_data: 000005.log size: 12107610 ; 2024/01/12-14:52:17.982503 24 Options.error_if_exists: 0 2024/01/12-14:52:17.982505 24 Options.create_if_missing: 1 2024/01/12-14:52:17.982507 24 Options.paranoid_checks: 1 2024/01/12-14:52:17.982508 24 Options.flush_verify_memtable_count: 1 2024/01/12-14:52:17.982510 24 Options.track_and_verify_wals_in_manifest: 0 2024/01/12-14:52:17.982512 24 Options.env: 0x7ff9ca5452c0 2024/01/12-14:52:17.982514 24 Options.fs: PosixFileSystem 2024/01/12-14:52:17.982516 24 Options.info_log: 0x7ff955650140 2024/01/12-14:52:17.982518 24 Options.max_file_opening_threads: 16 2024/01/12-14:52:17.982519 24 Options.statistics: (nil) 2024/01/12-14:52:17.982521 24 Options.use_fsync: 0 2024/01/12-14:52:17.982523 24 Options.max_log_file_size: 0 2024/01/12-14:52:17.982525 24 Options.max_manifest_file_size: 1073741824 2024/01/12-14:52:17.982526 24 Options.log_file_time_to_roll: 0 2024/01/12-14:52:17.982528 24 Options.keep_log_file_num: 1000 2024/01/12-14:52:17.982529 24 Options.recycle_log_file_num: 0 2024/01/12-14:52:17.982531 24 Options.allow_fallocate: 1 2024/01/12-14:52:17.982533 24 Options.allow_mmap_reads: 0 2024/01/12-14:52:17.982534 24 Options.allow_mmap_writes: 0 2024/01/12-14:52:17.982536 24 Options.use_direct_reads: 0 2024/01/12-14:52:17.982537 24 Options.use_direct_io_for_flush_and_compaction: 0 2024/01/12-14:52:17.982539 24 Options.create_missing_column_families: 1 2024/01/12-14:52:17.982540 24 Options.db_log_dir: 2024/01/12-14:52:17.982542 24 Options.wal_dir: 2024/01/12-14:52:17.982544 24 Options.table_cache_numshardbits: 6 2024/01/12-14:52:17.982545 24 Options.WAL_ttl_seconds: 0 2024/01/12-14:52:17.982547 24 Options.WAL_size_limit_MB: 0 2024/01/12-14:52:17.982548 24 Options.max_write_batch_group_size_bytes: 1048576 2024/01/12-14:52:17.982550 24 Options.manifest_preallocation_size: 4194304 2024/01/12-14:52:17.982552 24 Options.is_fd_close_on_exec: 1 2024/01/12-14:52:17.982553 24 Options.advise_random_on_open: 1 2024/01/12-14:52:17.982555 24 Options.experimental_mempurge_threshold: 0.000000 2024/01/12-14:52:17.982561 24 Options.db_write_buffer_size: 0 2024/01/12-14:52:17.982563 24 Options.write_buffer_manager: 0x7ff955604280 2024/01/12-14:52:17.982565 24 Options.access_hint_on_compaction_start: 1 2024/01/12-14:52:17.982566 24 Options.new_table_reader_for_compaction_inputs: 0 2024/01/12-14:52:17.982568 24 Options.random_access_max_buffer_size: 1048576 2024/01/12-14:52:17.982570 24 Options.use_adaptive_mutex: 0 2024/01/12-14:52:17.982572 24 Options.rate_limiter: (nil) 2024/01/12-14:52:17.982574 24 Options.sst_file_manager.rate_bytes_per_sec: 0 2024/01/12-14:52:17.982576 24 Options.wal_recovery_mode: 2 2024/01/12-14:52:17.982578 24 Options.enable_thread_tracking: 0 2024/01/12-14:52:17.983332 24 Options.enable_pipelined_write: 0 2024/01/12-14:52:17.983340 24 Options.unordered_write: 0 2024/01/12-14:52:17.983343 24 Options.allow_concurrent_memtable_write: 1 2024/01/12-14:52:17.983345 24 Options.enable_write_thread_adaptive_yield: 1 2024/01/12-14:52:17.983347 24 Options.write_thread_max_yield_usec: 100 2024/01/12-14:52:17.983349 24 Options.write_thread_slow_yield_usec: 3 2024/01/12-14:52:17.983350 24 Options.row_cache: None 2024/01/12-14:52:17.983352 24 Options.wal_filter: None 2024/01/12-14:52:17.983355 24 Options.avoid_flush_during_recovery: 0 2024/01/12-14:52:17.983356 24 Options.allow_ingest_behind: 0 2024/01/12-14:52:17.983358 24 Options.preserve_deletes: 0 2024/01/12-14:52:17.983360 24 Options.two_write_queues: 0 2024/01/12-14:52:17.983361 24 Options.manual_wal_flush: 0 2024/01/12-14:52:17.983363 24 Options.atomic_flush: 0 2024/01/12-14:52:17.983365 24 Options.avoid_unnecessary_blocking_io: 0 2024/01/12-14:52:17.983367 24 Options.persist_stats_to_disk: 0 2024/01/12-14:52:17.983369 24 Options.write_dbid_to_manifest: 0 2024/01/12-14:52:17.983371 24 Options.log_readahead_size: 0 2024/01/12-14:52:17.983373 24 Options.file_checksum_gen_factory: Unknown 2024/01/12-14:52:17.983382 24 Options.best_efforts_recovery: 0 2024/01/12-14:52:17.983385 24 Options.max_bgerror_resume_count: 2147483647 2024/01/12-14:52:17.983386 24 Options.bgerror_resume_retry_interval: 1000000 2024/01/12-14:52:17.983388 24 Options.allow_data_in_errors: 0 2024/01/12-14:52:17.983393 24 Options.db_host_id: hostname 2024/01/12-14:52:17.983424 24 Options.max_background_jobs: 1 2024/01/12-14:52:17.983426 24 Options.max_background_compactions: -1 2024/01/12-14:52:17.983428 24 Options.max_subcompactions: 1 2024/01/12-14:52:17.983430 24 Options.avoid_flush_during_shutdown: 0 2024/01/12-14:52:17.983432 24 Options.writable_file_max_buffer_size: 1048576 2024/01/12-14:52:17.983434 24 Options.delayed_write_rate : 16777216 2024/01/12-14:52:17.983436 24 Options.max_total_wal_size: 0 2024/01/12-14:52:17.983438 24 Options.delete_obsolete_files_period_micros: 21600000000 2024/01/12-14:52:17.983440 24 Options.stats_dump_period_sec: 600 2024/01/12-14:52:17.983442 24 Options.stats_persist_period_sec: 600 2024/01/12-14:52:17.983444 24 Options.stats_history_buffer_size: 1048576 2024/01/12-14:52:17.983446 24 Options.max_open_files: -1 2024/01/12-14:52:17.983448 24 Options.bytes_per_sync: 0 2024/01/12-14:52:17.983450 24 Options.wal_bytes_per_sync: 0 2024/01/12-14:52:17.983452 24 Options.strict_bytes_per_sync: 0 2024/01/12-14:52:17.983454 24 Options.compaction_readahead_size: 0 2024/01/12-14:52:17.983456 24 Options.max_background_flushes: 1 2024/01/12-14:52:17.983458 24 Compression algorithms supported: 2024/01/12-14:52:17.983461 24 kZSTDNotFinalCompression supported: 1 2024/01/12-14:52:17.983469 24 kZSTD supported: 1 2024/01/12-14:52:17.983471 24 kXpressCompression supported: 0 2024/01/12-14:52:17.983473 24 kLZ4HCCompression supported: 0 2024/01/12-14:52:17.983475 24 kLZ4Compression supported: 0 2024/01/12-14:52:17.983477 24 kBZip2Compression supported: 0 2024/01/12-14:52:17.983479 24 kZlibCompression supported: 0 2024/01/12-14:52:17.983482 24 kSnappyCompression supported: 0 2024/01/12-14:52:17.983489 24 Fast CRC32 supported: Not supported on x86 2024/01/12-14:52:18.005299 24 [db/version_set.cc:4888] Recovering from manifest file: /var/lib/milvus/rdb_data/MANIFEST-000004 2024/01/12-14:52:18.011287 24 [db/column_family.cc:605] --------------- Options for column family [default]: 2024/01/12-14:52:18.011298 24 Options.comparator: leveldb.BytewiseComparator 2024/01/12-14:52:18.011300 24 Options.merge_operator: None 2024/01/12-14:52:18.011301 24 Options.compaction_filter: None 2024/01/12-14:52:18.011302 24 Options.compaction_filter_factory: None 2024/01/12-14:52:18.011303 24 Options.sst_partitioner_factory: None 2024/01/12-14:52:18.011305 24 Options.memtable_factory: SkipListFactory 2024/01/12-14:52:18.011306 24 Options.table_factory: BlockBasedTable 2024/01/12-14:52:18.011342 24 table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x7ff9557bb260) cache_index_and_filter_blocks: 0 cache_index_and_filter_blocks_with_high_priority: 1 pin_l0_filter_and_index_blocks_in_cache: 0 pin_top_level_index_and_filter: 1 index_type: 0 data_block_index_type: 0 index_shortening: 1 data_block_hash_table_util_ratio: 0.750000 hash_index_allow_collision: 1 checksum: 1 no_block_cache: 0 block_cache: 0x7ff955604010 block_cache_name: LRUCache block_cache_options: capacity : 536870912 num_shard_bits : 6 strict_capacity_limit : 0 memory_allocator : None high_pri_pool_ratio: 0.500 block_cache_compressed: (nil) persistent_cache: (nil) block_size: 65536 block_size_deviation: 10 block_restart_interval: 16 index_block_restart_interval: 1 metadata_block_size: 4096 partition_filters: 0 use_delta_encoding: 1 filter_policy: nullptr whole_key_filtering: 1 verify_compression: 0 read_amp_bytes_per_bit: 0 format_version: 5 enable_index_compression: 1 block_align: 0 max_auto_readahead_size: 262144 prepopulate_block_cache: 0 2024/01/12-14:52:18.011349 24 Options.write_buffer_size: 67108864 2024/01/12-14:52:18.011351 24 Options.max_write_buffer_number: 2 2024/01/12-14:52:18.011353 24 Options.compression[0]: NoCompression 2024/01/12-14:52:18.011356 24 Options.compression[1]: NoCompression 2024/01/12-14:52:18.011357 24 Options.compression[2]: ZSTD 2024/01/12-14:52:18.011359 24 Options.compression[3]: ZSTD 2024/01/12-14:52:18.011361 24 Options.compression[4]: ZSTD 2024/01/12-14:52:18.011363 24 Options.bottommost_compression: Disabled 2024/01/12-14:52:18.011364 24 Options.prefix_extractor: nullptr 2024/01/12-14:52:18.011366 24 Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024/01/12-14:52:18.011368 24 Options.num_levels: 5 2024/01/12-14:52:18.011370 24 Options.min_write_buffer_number_to_merge: 1 2024/01/12-14:52:18.011372 24 Options.max_write_buffer_number_to_maintain: 0 2024/01/12-14:52:18.011373 24 Options.max_write_buffer_size_to_maintain: 0 2024/01/12-14:52:18.011375 24 Options.bottommost_compression_opts.window_bits: -14 2024/01/12-14:52:18.011377 24 Options.bottommost_compression_opts.level: 32767 2024/01/12-14:52:18.011379 24 Options.bottommost_compression_opts.strategy: 0 2024/01/12-14:52:18.011381 24 Options.bottommost_compression_opts.max_dict_bytes: 0 2024/01/12-14:52:18.011383 24 Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024/01/12-14:52:18.011385 24 Options.bottommost_compression_opts.parallel_threads: 1 2024/01/12-14:52:18.011387 24 Options.bottommost_compression_opts.enabled: false 2024/01/12-14:52:18.011399 24 Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024/01/12-14:52:18.011402 24 Options.compression_opts.window_bits: -14 2024/01/12-14:52:18.011404 24 Options.compression_opts.level: 32767 2024/01/12-14:52:18.011406 24 Options.compression_opts.strategy: 0 2024/01/12-14:52:18.011408 24 Options.compression_opts.max_dict_bytes: 0 2024/01/12-14:52:18.011409 24 Options.compression_opts.zstd_max_train_bytes: 0 2024/01/12-14:52:18.011412 24 Options.compression_opts.parallel_threads: 1 2024/01/12-14:52:18.012227 24 Options.compression_opts.enabled: false 2024/01/12-14:52:18.012233 24 Options.compression_opts.max_dict_buffer_bytes: 0 2024/01/12-14:52:18.012234 24 Options.level0_file_num_compaction_trigger: 4 2024/01/12-14:52:18.012236 24 Options.level0_slowdown_writes_trigger: 20 2024/01/12-14:52:18.012237 24 Options.level0_stop_writes_trigger: 36 2024/01/12-14:52:18.012238 24 Options.target_file_size_base: 67108864 2024/01/12-14:52:18.012239 24 Options.target_file_size_multiplier: 2 2024/01/12-14:52:18.012240 24 Options.max_bytes_for_level_base: 268435456 2024/01/12-14:52:18.012241 24 Options.level_compaction_dynamic_level_bytes: 0 2024/01/12-14:52:18.012242 24 Options.max_bytes_for_level_multiplier: 10.000000 2024/01/12-14:52:18.012246 24 Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024/01/12-14:52:18.012248 24 Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024/01/12-14:52:18.012249 24 Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024/01/12-14:52:18.012250 24 Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024/01/12-14:52:18.012251 24 Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024/01/12-14:52:18.012252 24 Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024/01/12-14:52:18.012253 24 Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024/01/12-14:52:18.012254 24 Options.max_sequential_skip_in_iterations: 8 2024/01/12-14:52:18.012256 24 Options.max_compaction_bytes: 1677721600 2024/01/12-14:52:18.012257 24 Options.arena_block_size: 1048576 2024/01/12-14:52:18.012258 24 Options.soft_pending_compaction_bytes_limit: 68719476736 2024/01/12-14:52:18.012259 24 Options.hard_pending_compaction_bytes_limit: 274877906944 2024/01/12-14:52:18.012260 24 Options.rate_limit_delay_max_milliseconds: 100 2024/01/12-14:52:18.012261 24 Options.disable_auto_compactions: 0 2024/01/12-14:52:18.012265 24 Options.compaction_style: kCompactionStyleLevel 2024/01/12-14:52:18.012267 24 Options.compaction_pri: kMinOverlappingRatio 2024/01/12-14:52:18.012268 24 Options.compaction_options_universal.size_ratio: 1 2024/01/12-14:52:18.012269 24 Options.compaction_options_universal.min_merge_width: 2 2024/01/12-14:52:18.012270 24 Options.compaction_options_universal.max_merge_width: 4294967295 2024/01/12-14:52:18.012271 24 Options.compaction_options_universal.max_size_amplification_percent: 200 2024/01/12-14:52:18.012272 24 Options.compaction_options_universal.compression_size_percent: -1 2024/01/12-14:52:18.012274 24 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024/01/12-14:52:18.012275 24 Options.compaction_options_fifo.max_table_files_size: 1073741824 2024/01/12-14:52:18.012276 24 Options.compaction_options_fifo.allow_compaction: 0 2024/01/12-14:52:18.012293 24 Options.table_properties_collectors: 2024/01/12-14:52:18.012294 24 Options.inplace_update_support: 0 2024/01/12-14:52:18.012295 24 Options.inplace_update_num_locks: 10000 2024/01/12-14:52:18.012296 24 Options.memtable_prefix_bloom_size_ratio: 0.000000 2024/01/12-14:52:18.012298 24 Options.memtable_whole_key_filtering: 0 2024/01/12-14:52:18.012299 24 Options.memtable_huge_page_size: 0 2024/01/12-14:52:18.012300 24 Options.bloom_locality: 0 2024/01/12-14:52:18.012301 24 Options.max_successive_merges: 0 2024/01/12-14:52:18.012302 24 Options.optimize_filters_for_hits: 0 2024/01/12-14:52:18.012303 24 Options.paranoid_file_checks: 0 2024/01/12-14:52:18.012304 24 Options.force_consistency_checks: 1 2024/01/12-14:52:18.012306 24 Options.report_bg_io_stats: 0 2024/01/12-14:52:18.012307 24 Options.ttl: 2592000 2024/01/12-14:52:18.012312 24 Options.periodic_compaction_seconds: 0 2024/01/12-14:52:18.013220 24 Options.enable_blob_files: false 2024/01/12-14:52:18.013224 24 Options.min_blob_size: 0 2024/01/12-14:52:18.013225 24 Options.blob_file_size: 268435456 2024/01/12-14:52:18.013227 24 Options.blob_compression_type: NoCompression 2024/01/12-14:52:18.013228 24 Options.enable_blob_garbage_collection: false 2024/01/12-14:52:18.013229 24 Options.blob_garbage_collection_age_cutoff: 0.250000 2024/01/12-14:52:18.013231 24 Options.blob_garbage_collection_force_threshold: 1.000000 2024/01/12-14:52:18.013232 24 Options.blob_compaction_readahead_size: 0 2024/01/12-14:52:18.016626 24 [db/column_family.cc:605] --------------- Options for column family [properties]: 2024/01/12-14:52:18.016632 24 Options.comparator: leveldb.BytewiseComparator 2024/01/12-14:52:18.016633 24 Options.merge_operator: None 2024/01/12-14:52:18.016633 24 Options.compaction_filter: None 2024/01/12-14:52:18.016634 24 Options.compaction_filter_factory: None 2024/01/12-14:52:18.016635 24 Options.sst_partitioner_factory: None 2024/01/12-14:52:18.016635 24 Options.memtable_factory: SkipListFactory 2024/01/12-14:52:18.016636 24 Options.table_factory: BlockBasedTable 2024/01/12-14:52:18.016651 24 table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x7ff9557bb260) cache_index_and_filter_blocks: 0 cache_index_and_filter_blocks_with_high_priority: 1 pin_l0_filter_and_index_blocks_in_cache: 0 pin_top_level_index_and_filter: 1 index_type: 0 data_block_index_type: 0 index_shortening: 1 data_block_hash_table_util_ratio: 0.750000 hash_index_allow_collision: 1 checksum: 1 no_block_cache: 0 block_cache: 0x7ff955604010 block_cache_name: LRUCache block_cache_options: capacity : 536870912 num_shard_bits : 6 strict_capacity_limit : 0 memory_allocator : None high_pri_pool_ratio: 0.500 block_cache_compressed: (nil) persistent_cache: (nil) block_size: 65536 block_size_deviation: 10 block_restart_interval: 16 index_block_restart_interval: 1 metadata_block_size: 4096 partition_filters: 0 use_delta_encoding: 1 filter_policy: nullptr whole_key_filtering: 1 verify_compression: 0 read_amp_bytes_per_bit: 0 format_version: 5 enable_index_compression: 1 block_align: 0 max_auto_readahead_size: 262144 prepopulate_block_cache: 0 2024/01/12-14:52:18.016654 24 Options.write_buffer_size: 67108864 2024/01/12-14:52:18.016654 24 Options.max_write_buffer_number: 2 2024/01/12-14:52:18.016655 24 Options.compression[0]: NoCompression 2024/01/12-14:52:18.016656 24 Options.compression[1]: NoCompression 2024/01/12-14:52:18.016657 24 Options.compression[2]: ZSTD 2024/01/12-14:52:18.016657 24 Options.compression[3]: ZSTD 2024/01/12-14:52:18.016658 24 Options.compression[4]: ZSTD 2024/01/12-14:52:18.016659 24 Options.bottommost_compression: Disabled 2024/01/12-14:52:18.016659 24 Options.prefix_extractor: nullptr 2024/01/12-14:52:18.016660 24 Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024/01/12-14:52:18.016660 24 Options.num_levels: 5 2024/01/12-14:52:18.016661 24 Options.min_write_buffer_number_to_merge: 1 2024/01/12-14:52:18.016662 24 Options.max_write_buffer_number_to_maintain: 0 2024/01/12-14:52:18.016662 24 Options.max_write_buffer_size_to_maintain: 0 2024/01/12-14:52:18.016663 24 Options.bottommost_compression_opts.window_bits: -14 2024/01/12-14:52:18.016664 24 Options.bottommost_compression_opts.level: 32767 2024/01/12-14:52:18.016664 24 Options.bottommost_compression_opts.strategy: 0 2024/01/12-14:52:18.016665 24 Options.bottommost_compression_opts.max_dict_bytes: 0 2024/01/12-14:52:18.016666 24 Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024/01/12-14:52:18.016666 24 Options.bottommost_compression_opts.parallel_threads: 1 2024/01/12-14:52:18.017466 24 Options.bottommost_compression_opts.enabled: false 2024/01/12-14:52:18.017470 24 Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024/01/12-14:52:18.017471 24 Options.compression_opts.window_bits: -14 2024/01/12-14:52:18.017471 24 Options.compression_opts.level: 32767 2024/01/12-14:52:18.017472 24 Options.compression_opts.strategy: 0 2024/01/12-14:52:18.017473 24 Options.compression_opts.max_dict_bytes: 0 2024/01/12-14:52:18.017473 24 Options.compression_opts.zstd_max_train_bytes: 0 2024/01/12-14:52:18.017474 24 Options.compression_opts.parallel_threads: 1 2024/01/12-14:52:18.017475 24 Options.compression_opts.enabled: false 2024/01/12-14:52:18.017475 24 Options.compression_opts.max_dict_buffer_bytes: 0 2024/01/12-14:52:18.017476 24 Options.level0_file_num_compaction_trigger: 4 2024/01/12-14:52:18.017476 24 Options.level0_slowdown_writes_trigger: 20 2024/01/12-14:52:18.017477 24 Options.level0_stop_writes_trigger: 36 2024/01/12-14:52:18.017478 24 Options.target_file_size_base: 67108864 2024/01/12-14:52:18.017478 24 Options.target_file_size_multiplier: 2 2024/01/12-14:52:18.017479 24 Options.max_bytes_for_level_base: 268435456 2024/01/12-14:52:18.017480 24 Options.level_compaction_dynamic_level_bytes: 0 2024/01/12-14:52:18.017480 24 Options.max_bytes_for_level_multiplier: 10.000000 2024/01/12-14:52:18.017482 24 Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024/01/12-14:52:18.017483 24 Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024/01/12-14:52:18.017484 24 Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024/01/12-14:52:18.017484 24 Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024/01/12-14:52:18.017485 24 Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024/01/12-14:52:18.017486 24 Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024/01/12-14:52:18.017486 24 Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024/01/12-14:52:18.017487 24 Options.max_sequential_skip_in_iterations: 8 2024/01/12-14:52:18.017487 24 Options.max_compaction_bytes: 1677721600 2024/01/12-14:52:18.017488 24 Options.arena_block_size: 1048576 2024/01/12-14:52:18.017489 24 Options.soft_pending_compaction_bytes_limit: 68719476736 2024/01/12-14:52:18.017489 24 Options.hard_pending_compaction_bytes_limit: 274877906944 2024/01/12-14:52:18.017490 24 Options.rate_limit_delay_max_milliseconds: 100 2024/01/12-14:52:18.017491 24 Options.disable_auto_compactions: 0 2024/01/12-14:52:18.017492 24 Options.compaction_style: kCompactionStyleLevel 2024/01/12-14:52:18.017494 24 Options.compaction_pri: kMinOverlappingRatio 2024/01/12-14:52:18.017494 24 Options.compaction_options_universal.size_ratio: 1 2024/01/12-14:52:18.017495 24 Options.compaction_options_universal.min_merge_width: 2 2024/01/12-14:52:18.017495 24 Options.compaction_options_universal.max_merge_width: 4294967295 2024/01/12-14:52:18.017496 24 Options.compaction_options_universal.max_size_amplification_percent: 200 2024/01/12-14:52:18.017497 24 Options.compaction_options_universal.compression_size_percent: -1 2024/01/12-14:52:18.017497 24 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024/01/12-14:52:18.017498 24 Options.compaction_options_fifo.max_table_files_size: 1073741824 2024/01/12-14:52:18.017499 24 Options.compaction_options_fifo.allow_compaction: 0 2024/01/12-14:52:18.017505 24 Options.table_properties_collectors: 2024/01/12-14:52:18.017505 24 Options.inplace_update_support: 0 2024/01/12-14:52:18.017506 24 Options.inplace_update_num_locks: 10000 2024/01/12-14:52:18.017507 24 Options.memtable_prefix_bloom_size_ratio: 0.000000 2024/01/12-14:52:18.017508 24 Options.memtable_whole_key_filtering: 0 2024/01/12-14:52:18.018310 24 Options.memtable_huge_page_size: 0 2024/01/12-14:52:18.018313 24 Options.bloom_locality: 0 2024/01/12-14:52:18.018314 24 Options.max_successive_merges: 0 2024/01/12-14:52:18.018315 24 Options.optimize_filters_for_hits: 0 2024/01/12-14:52:18.018315 24 Options.paranoid_file_checks: 0 2024/01/12-14:52:18.018316 24 Options.force_consistency_checks: 1 2024/01/12-14:52:18.018317 24 Options.report_bg_io_stats: 0 2024/01/12-14:52:18.018317 24 Options.ttl: 2592000 2024/01/12-14:52:18.018318 24 Options.periodic_compaction_seconds: 0 2024/01/12-14:52:18.018319 24 Options.enable_blob_files: false 2024/01/12-14:52:18.018320 24 Options.min_blob_size: 0 2024/01/12-14:52:18.018320 24 Options.blob_file_size: 268435456 2024/01/12-14:52:18.018321 24 Options.blob_compression_type: NoCompression 2024/01/12-14:52:18.018322 24 Options.enable_blob_garbage_collection: false 2024/01/12-14:52:18.018323 24 Options.blob_garbage_collection_age_cutoff: 0.250000 2024/01/12-14:52:18.018324 24 Options.blob_garbage_collection_force_threshold: 1.000000 2024/01/12-14:52:18.018325 24 Options.blob_compaction_readahead_size: 0 2024/01/12-14:52:18.026305 24 [db/version_set.cc:4928] Recovered from manifest file:/var/lib/milvus/rdb_data/MANIFEST-000004 succeeded,manifest_file_number is 4, next_file_number is 7, last_sequence is 0, log_number is 5,prev_log_number is 0,max_column_family is 1,min_log_number_to_keep is 0 2024/01/12-14:52:18.026316 24 [db/version_set.cc:4943] Column family [default] (ID 0), log number is 0 2024/01/12-14:52:18.026318 24 [db/version_set.cc:4943] Column family [properties] (ID 1), log number is 5 2024/01/12-14:52:18.043049 24 [db/version_set.cc:4409] Creating manifest 10 2024/01/12-14:52:18.085961 24 EVENT_LOG_v1 {"time_micros": 1705071138085950, "job": 1, "event": "recovery_started", "wal_files": [5]} 2024/01/12-14:52:18.085970 24 [db/db_impl/db_impl_open.cc:888] Recovering log #5 mode 2 2024/01/12-14:52:18.844003 24 EVENT_LOG_v1 {"time_micros": 1705071138843958, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 11, "file_size": 5472485, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 5467086, "index_size": 4470, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 0, "raw_key_size": 8304777, "raw_average_key_size": 49, "raw_value_size": 2886827, "raw_average_value_size": 17, "num_data_blocks": 84, "num_entries": 169426, "num_filter_entries": 0, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; ", "creation_time": 1705071138, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "88fdcf58-60d8-4964-b38c-13c476b26d0c", "db_session_id": "LIQCABPC1KL2CHE44MQH", "orig_file_number": 11}} 2024/01/12-14:52:18.844929 24 [db/version_set.cc:4409] Creating manifest 12 2024/01/12-14:52:18.888674 24 EVENT_LOG_v1 {"time_micros": 1705071138888663, "job": 1, "event": "recovery_finished"} 2024/01/12-14:52:18.948039 24 [file/delete_scheduler.cc:73] Deleted file /var/lib/milvus/rdb_data/000005.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024/01/12-14:52:18.948857 24 [db/db_impl/db_impl_open.cc:1820] SstFileManager instance 0x7ff955655700 2024/01/12-14:52:18.953763 24 DB pointer 0x7ff95563cc00 2024/01/12-14:52:21.955753 50 [db/db_impl/db_impl.cc:1013] ------- DUMPING STATS ------- 2024/01/12-14:52:21.955840 50 [db/db_impl/db_impl.cc:1015] DB Stats Uptime(secs): 3.9 total, 3.9 interval Cumulative writes: 42 writes, 42 keys, 28 commit groups, 1.5 writes per commit group, ingest: 0.00 GB, 0.00 MB/s Cumulative WAL: 42 writes, 0 syncs, 42.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 42 writes, 42 keys, 28 commit groups, 1.5 writes per commit group, ingest: 0.00 MB, 0.00 MB/s Interval WAL: 42 writes, 0 syncs, 42.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent

Compaction Stats [default] Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)

L0 1/0 5.22 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 27.9 0.19 0.00 1 0.187 0 0 0.0 0.0 Sum 1/0 5.22 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 27.9 0.19 0.00 1 0.187 0 0 0.0 0.0 Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 27.9 0.19 0.00 1 0.187 0 0 0.0 0.0

Compaction Stats [default] Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)

User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 27.9 0.19 0.00 1 0.187 0 0 0.0 0.0

Blob file count: 0, total size: 0.0 GB

Uptime(secs): 3.9 total, 3.9 interval Flush(GB): cumulative 0.005, interval 0.005 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 0.01 GB write, 1.32 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.2 seconds Interval compaction: 0.01 GB write, 1.32 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.2 seconds Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count Block cache LRUCache@0x7ff955604010#8 capacity: 512.00 MB collections: 1 last_copies: 2 last_secs: 0.000127 secs_since: 4 Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)

Compaction Stats [properties] Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)

Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0

Compaction Stats [properties] Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)

Blob file count: 0, total size: 0.0 GB

Uptime(secs): 3.9 total, 3.9 interval Flush(GB): cumulative 0.000, interval 0.000 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count Block cache LRUCache@0x7ff955604010#8 capacity: 512.00 MB collections: 1 last_copies: 2 last_secs: 0.000127 secs_since: 4 Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)

File Read Latency Histogram By Level [default]

File Read Latency Histogram By Level [properties]

yanliang567 commented 10 months ago

@lingaswami I don't think the logs you pasted above are milvus logs. Could you please refer this doc to export the whole Milvus logs for investigation? For Milvus installed with docker-compose, you can use docker-compose logs > milvus.log to export the logs.

xiaofan-luan commented 10 months ago

how do you create your collection? please share your collection schema of medium_articles? there should be a title field and link field right?

from the error "getting error code : 1804, message : fail to deal the insert data, error: unable to cast \ \ of type string to int64: invalid parameter[expected=Int64][actual=] at milvus" it's pretty sure that there is a field of int64 that you are trying to write varchar into it .

lingaswami commented 10 months ago

Current Behavior Create collection with the parameters

const createParams = {
  dimension: 4,
  collectionName: 'medium_articles',
  metricType: 'L2',
  primaryField: 'id',
  vectorField: 'vector',
  description: 'des',
  enableDynamic: true
};

inserting data on created collection

{ "collectionName": "medium_articles", "data": [{ "vector": [ 0.3300010334532002, 0.2812818267168886, 0.053587802596719136, 0.7707064752337092] }] }

Can not insert data

{ code: 1804, message: 'fail to deal the insert data, error: unable to cast "" of type string to int64: invalid parameter[expected=Int64][actual=]' }

yanliang567 commented 10 months ago

I think it is caused by there is no int64(primaryField: 'id') in the data you insert. Please try to 1) set auto_id=True when creating collection, then you can insert data without id; 2) or use the current collection settings, and add id values in the data @lingaswami /assign @lingaswami /unassign

lingaswami commented 10 months ago

try with creating new collection { "dbName": "default",
"collectionName": "collection1", "dimension": 4, "metricType": "L2", "primaryField": "id", "vectorField": "vector", "auto_id":true }

after changing above schema, insert data

{ "collectionName": "collection1", "data": [ { "vector": [ 0.3300010334532002, 0.2812818267168886, 0.053587802596719136, 0.7707064752337092 ] } ] }

still getting same issue

{ "code": 1804, "message": "fail to deal the insert data, error: unable to cast \"\" of type string to int64: invalid parameter[expected=Int64][actual=]" }

lingaswami commented 9 months ago

Hi any update

xiaofan-luan commented 9 months ago

should be fixed by https://github.com/milvus-io/milvus/issues/30000

xiaofan-luan commented 9 months ago

please try milvus 2.3.6

stale[bot] commented 8 months ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.