tporadowski / redis

Native port of Redis for Windows. Redis is an in-memory database that persists on disk. The data model is key-value, but many different kind of values are supported: Strings, Lists, Sets, Sorted Sets, Hashes, Streams, HyperLogLogs. This repository contains unofficial port of Redis to Windows.
http://redis.io
Other
8.88k stars 1.09k forks source link

An error occurred while inserting 3000W list data #122

Open xxxxxxming opened 2 years ago

xxxxxxming commented 2 years ago

Describe the bug/issue inserting 3000W list data system: windows10

info output [2752] 29 Oct 05:32:54.625 # PhysicalMapMemory: system error 0x000005af - PhysicalMapMemory: CreateFileMapping failed: 页面文件太小,无法完成操作。 [2752] 29 Oct 05:33:25.418 # fork operation complete [2752] 29 Oct 05:33:25.975 * Background saving terminated with success

=== REDIS BUG REPORT START: Cut & paste starting from here === Redis version: 5.0.10 [2752] 29 Oct 05:34:10.604 # --- EXCEPTION_ACCESS_VIOLATION [2752] 29 Oct 05:34:10.604 # --- STACK TRACE redis-server.exe!StackTraceInfo(D:\dev\GitHub\redis\src\Win32_Interop\Win32_StackTrace.cpp:153)(0x14018CEB0, 0x0014FF60, 0x1400DC620, 0x0014E600) redis-server.exe!UnhandledExceptiontHandler(D:\dev\GitHub\redis\src\Win32_Interop\Win32_StackTrace.cpp:186)(0x0014E600, 0x1400DC601, 0x00000000, 0x7FFC1C232563) KERNELBASE.dll!UnhandledExceptionFilter(D:\dev\GitHub\redis\src\Win32_Interop\Win32_StackTrace.cpp:186)(0x0014E6B0, 0x7FFC1D0565C0, 0x00000000, 0x0014E648) ntdll.dll!memset(D:\dev\GitHub\redis\src\Win32_Interop\Win32_StackTrace.cpp:186)(0x7FFC1D0839A0, 0x7FFC1CF10000, 0x0014E6B0, 0x7FFC1CF3225B) ntdll.dll!_C_specific_handler(D:\dev\GitHub\redis\src\Win32_Interop\Win32_StackTrace.cpp:186)(0x00000000, 0x0014EBB0, 0x0014F270, 0x00000000) ntdll.dll!_chkstk(D:\dev\GitHub\redis\src\Win32_Interop\Win32_StackTrace.cpp:186)(0x00000000, 0x0014EBB0, 0x0014F270, 0x00000000) ntdll.dll!RtlRaiseException(D:\dev\GitHub\redis\src\Win32_Interop\Win32_StackTrace.cpp:186)(0x03AA5B70, 0x7FCD3D4000A0, 0x00006EB0, 0x7FFC1CF25D21) ntdll.dll!KiUserExceptionDispatcher(D:\dev\GitHub\redis\src\Win32_Interop\Win32_StackTrace.cpp:186)(0x02130000, 0x1400C753A, 0x7FCD33411200, 0x00000000) redis-server.exe!memset_repmovs(D:\agent_work\9\s\src\vctools\crt\vcruntime\src\string\amd64\memset.asm:67)(0x7FCD33411200, 0x00000000, 0x01400000, 0x7FCD33411200) redis-server.exe!AllocHeapBlock(D:\dev\GitHub\redis\src\Win32_Interop\Win32_QFork.cpp:940)(0x7FCD34C00008, 0x00000000, 0x01400000, 0x0000000C) redis-server.exe!extent_alloc_mmap(D:\dev\GitHub\redis\deps\jemalloc-5.2.1\src\extent_mmap.c:25)(0x7FCD34C00008, 0x00000000, 0x00400000, 0x01400000) redis-server.exe!extent_alloc_wrapper_hard(D:\dev\GitHub\redis\deps\jemalloc-5.2.1\src\extent.c:1504)(0x7FCD34C00008, 0x01400000, 0x00000000, 0x7FCD38C04DE8) redis-server.exe!arena_slab_alloc(D:\dev\GitHub\redis\deps\jemalloc-5.2.1\src\arena.c:1247)(0x7FCD33688300, 0x7FCD33417E50, 0x00000001, 0x00000000) redis-server.exe!arena_bin_malloc_hard(D:\dev\GitHub\redis\deps\jemalloc-5.2.1\src\arena.c:1319)(0x7FCD33417E50, 0x00000001, 0x7FCD34C00008, 0x14008A5EC) redis-server.exe!arena_tcache_fill_small(D:\dev\GitHub\redis\deps\jemalloc-5.2.1\src\arena.c:1414)(0x7FCD33411200, 0x7FCD33411200, 0x7FCD34C00220, 0x7FCD34C00008) redis-server.exe!tcache_alloc_small(D:\dev\GitHub\redis\deps\jemalloc-5.2.1\include\jemalloc\internal\tcache_inlines.h:60)(0x7FCD34C00008, 0x7FCD34C00008, 0x00000089, 0x00000000) redis-server.exe!imalloc_no_sample(D:\dev\GitHub\redis\deps\jemalloc-5.2.1\src\jemalloc.c:1949)(0x7FCD34C00008, 0x0014F879, 0x000000A0, 0x00000089) redis-server.exe!malloc_default(D:\dev\GitHub\redis\deps\jemalloc-5.2.1\src\jemalloc.c:2289)(0x0000000B, 0x00000089, 0x00000001, 0x0014F950) redis-server.exe!zmalloc(D:\dev\GitHub\redis\src\zmalloc.c:111)(0x00000003, 0x1400642E3, 0x00000001, 0x617B1752) redis-server.exe!sdsRemoveFreeSpace(D:\dev\GitHub\redis\src\sds.c:286)(0x17CC8D31AA4, 0x7FCD3AC96000, 0x00000000, 0x220000000A) redis-server.exe!clientsCronResizeQueryBuffer(D:\dev\GitHub\redis\src\server.c:881)(0x007B1752, 0x00000000, 0x7FCD3D4000A0, 0x7FCD3D4000A0) redis-server.exe!clientsCron(D:\dev\GitHub\redis\src\server.c:1008)(0x007B1752, 0x7FCD3D4000A0, 0x007B1752, 0x7FCD3D4000A0) redis-server.exe!serverCron(D:\dev\GitHub\redis\src\server.c:1242)(0x1D7CC438B7F3917, 0x14003DA30, 0x7FCD3D4000A0, 0x7FCD00000000) redis-server.exe!processTimeEvents(D:\dev\GitHub\redis\src\ae.c:355)(0x617B1752, 0x00000254, 0x7FCD3D4000A0, 0x00000001) redis-server.exe!aeProcessEvents(D:\dev\GitHub\redis\src\ae.c:498)(0x00000000, 0x0000000B, 0x00000000, 0x105B800000000) redis-server.exe!aeMain(D:\dev\GitHub\redis\src\ae.c:530)(0x00000AC0, 0x140187330, 0x00191200, 0x00000001) redis-server.exe!redis_main(D:\dev\GitHub\redis\src\server.c:4376)(0x004D92F0, 0x004D92F0, 0x004E58C0, 0x00000002) redis-server.exe!main(D:\dev\GitHub\redis\src\Win32_Interop\Win32_QFork.cpp:1139)(0x00000000, 0x00000000, 0x004D92F0, 0x00000000) redis-server.exe!__scrt_common_main_seh(D:\agent_work\9\s\src\vctools\crt\vcstartup\src\startup\exe_common.inl:288)(0x00000000, 0x00000000, 0x00000000, 0x00000000) KERNEL32.DLL!BaseThreadInitThunk(D:\agent_work\9\s\src\vctools\crt\vcstartup\src\startup\exe_common.inl:288)(0x00000000, 0x00000000, 0x00000000, 0x00000000) ntdll.dll!RtlUserThreadStart(D:\agent_work\9\s\src\vctools\crt\vcstartup\src\startup\exe_common.inl:288)(0x00000000, 0x00000000, 0x00000000, 0x00000000) ntdll.dll!RtlUserThreadStart(D:\agent_work\9\s\src\vctools\crt\vcstartup\src\startup\exe_common.inl:288)(0x00000000, 0x00000000, 0x00000000, 0x00000000) [2752] 29 Oct 05:34:10.635 # --- INFO OUTPUT

Server

redis_version:5.0.10 redis_git_sha1:1c047b68 redis_git_dirty:0 redis_build_id:76de97c74f6945e9 redis_mode:standalone os:Windows
arch_bits:64 multiplexing_api:WinSock_IOCP atomicvar_api:pthread-mutex process_id:2752 run_id:3a7d075bbe36e34a0a43112bbde47a82f0acfbe0 tcp_port:6379 uptime_in_seconds:68402 uptime_in_days:0 hz:10 configured_hz:10 lru_clock:8066898 executable:D:\Redis\redis-server.exe config_file:D:\Redis\redis.windows-service.conf

Clients

connected_clients:11 client_recent_max_input_buffer:2 client_recent_max_output_buffer:0 blocked_clients:0

Memory

used_memory:6695493960 used_memory_human:6.24G used_memory_rss:6695492936 used_memory_rss_human:6.24G used_memory_peak:6695493960 used_memory_peak_human:6.24G used_memory_peak_perc:100.00% used_memory_overhead:915430 used_memory_startup:660280 used_memory_dataset:6694578530 used_memory_dataset_perc:100.00% allocator_allocated:6696660176 allocator_active:7306477568 allocator_resident:7419723776 total_system_memory:0 total_system_memory_human:0B used_memory_lua:37888 used_memory_lua_human:37.00K used_memory_scripts:0 used_memory_scripts_human:0B number_of_cached_scripts:0 maxmemory:0 maxmemory_human:0B maxmemory_policy:noeviction allocator_frag_ratio:1.09 allocator_frag_bytes:609817392 allocator_rss_ratio:1.02 allocator_rss_bytes:113246208 rss_overhead_ratio:0.90 rss_overhead_bytes:-724230840 mem_fragmentation_ratio:1.00 mem_fragmentation_bytes:0 mem_not_counted_for_evict:0 mem_replication_backlog:0 mem_clients_slaves:0 mem_clients_normal:254502 mem_aof_buffer:0 mem_allocator:jemalloc-5.2.1-redis active_defrag_running:0 lazyfree_pending_objects:0

Persistence

loading:0 rdb_changes_since_last_save:62917 rdb_bgsave_in_progress:0 rdb_last_save_time:1635456805 rdb_last_bgsave_status:ok rdb_last_bgsave_time_sec:34 rdb_current_bgsave_time_sec:-1 rdb_last_cow_size:0 aof_enabled:0 aof_rewrite_in_progress:0 aof_rewrite_scheduled:0 aof_last_rewrite_time_sec:-1 aof_current_rewrite_time_sec:-1 aof_last_bgrewrite_status:ok aof_last_write_status:ok aof_last_cow_size:0

Stats

total_connections_received:69 total_commands_processed:12211223 instantaneous_ops_per_sec:151 total_net_input_bytes:10251338091 total_net_output_bytes:587305906665 instantaneous_input_kbps:172.19 instantaneous_output_kbps:583.56 rejected_connections:0 sync_full:0 sync_partial_ok:0 sync_partial_err:0 expired_keys:0 expired_stale_perc:0.00 expired_time_cap_reached_count:0 evicted_keys:0 keyspace_hits:3654207 keyspace_misses:562 pubsub_channels:0 pubsub_patterns:0 latest_fork_usec:64616 migrate_cached_sockets:0 slave_expires_tracked_keys:0 active_defrag_hits:0 active_defrag_misses:0 active_defrag_key_hits:0 active_defrag_key_misses:0

Replication

role:master connected_slaves:0 master_replid:028a231dab125a6d08b1624f3e739dc6db3d694c master_replid2:0000000000000000000000000000000000000000 master_repl_offset:0 second_repl_offset:-1 repl_backlog_active:0 repl_backlog_size:1048576 repl_backlog_first_byte_offset:0 repl_backlog_histlen:0

CPU

used_cpu_sys:608.468750 used_cpu_user:2446.015625 used_cpu_sys_children:0.000000 used_cpu_user_children:0.000000

Commandstats

cmdstat_set:calls=4320239,usec=4198824,usec_per_call=0.97 cmdstat_command:calls=1,usec=523,usec_per_call=523.00 cmdstat_del:calls=42,usec=59440,usec_per_call=1415.24 cmdstat_keys:calls=1,usec=12,usec_per_call=12.00 cmdstat_llen:calls=1154605,usec=4497293,usec_per_call=3.90 cmdstat_lrange:calls=1146634,usec=2282769461,usec_per_call=1990.84 cmdstat_publish:calls=11,usec=18,usec_per_call=1.64 cmdstat_get:calls=1353530,usec=5249508,usec_per_call=3.88 cmdstat_rpush:calls=4236160,usec=42345323,usec_per_call=10.00