search

eBay / HomeObject

Replicated BLOB Store built upon HomeStore
Apache License 2.0
6 stars 15 forks source link

io_uring fails when creating shard. #153

Closed JacksonYao287 closed 5 months ago

JacksonYao287 commented 8 months ago

[ RUN ] ShardManagerTestingRecovery.ShardManagerRecovery [03/11/24 02:27:07+00:00] [E] [3434] [drive_interface.cpp:80:get_major_minor] Unable to stat the path root, ignoring to get major/minor, ret:-1 [03/11/24 02:27:08+00:00] [E] [3911] [uring_drive_interface.cpp:502:handle_completions] Error in completion of io, iocb=0x55730dce4ce0, result=-22, retry=0 [03/11/24 02:27:08+00:00] [E] [3911] [uring_drive_interface.cpp:502:handle_completions] Error in completion of io, iocb=0x55730dce4ce0, result=-22, retry=1 [03/11/24 02:27:08+00:00] [E] [3911] [uring_drive_interface.cpp:502:handle_completions] Error in completion of io, iocb=0x55730dce4ce0, result=-22, retry=2 [03/11/24 02:27:08+00:00] [E] [3911] [uring_drive_interface.cpp:502:handle_completions] Error in completion of io, iocb=0x55730dce4ce0, result=-22, retry=3 [03/11/24 02:27:08+00:00] [E] [3911] [uring_drive_interface.cpp:502:handle_completions] Error in completion of io, iocb=0x55730dce4ce0, result=-22, retry=4 [03/11/24 02:27:08+00:00] [C] [3911] Don't expect op=WRITE retry exceed limit=3 homestore_test: /home/runner/.conan/data/iomgr/11.1.1/oss/master/build/33d8264345a44b38910d1ef69c4aa8cfab220fa8/src/lib/interfaces/uring_drive_interface.cpp:506: void iomgr::UringDriveInterface::handle_completions(): Assertion `0' failed. Aborted at 1710124028 (Unix time, try 'date -d @1710124028') Signal 6 (SIGABRT) (0x3e900000d6a) received by PID 3434 (pthread TID 0x7f76b3ff7600) (linux TID 3911) (maybe from PID 3434, UID 1001) (code: -6), stack trace: @ 000000000386bb58 _ZN5folly10symbolizer12_GLOBALN_118innerSignalHandlerEiP9siginfotPv /home/runner/.conan/data/folly/nu2.2023.12.18.00//_/build/544aa6f60fd65ca05acaa5d692aa40636124c932/src/folly/experimental/symbolizer/SignalHandler.cpp:449 @ 000000000386bc3e _ZN5folly10symbolizer12_GLOBALN_113signalHandlerEiP9siginfotPv /home/runner/.conan/data/folly/nu2.2023.12.18.00//_/build/544aa6f60fd65ca05acaa5d692aa40636124c932/src/folly/experimental/symbolizer/SignalHandler.cpp:470 @ 000000000004251f (unknown) @ 00000000000969fc pthread_kill @ 0000000000042475 raise @ 00000000000287f2 abort @ 000000000002871a (unknown) @ 0000000000039e95 assert_fail @ 000000000341aa32 _ZN5iomgr19UringDriveInterface18handle_completionsEv /home/runner/.conan/data/iomgr/11.1.1/oss/master/build/33d8264345a44b38910d1ef69c4aa8cfab220fa8/src/lib/interfaces/uring_drive_interface.cpp:506 @ 0000000003419679 _ZN5iomgr19UringDriveInterface21on_event_notificationEPNS_8IODeviceEPvi /home/runner/.conan/data/iomgr/11.1.1/oss/master/build/33d8264345a44b38910d1ef69c4aa8cfab220fa8/src/lib/interfaces/uring_drive_interface.cpp:450 @ 00000000034251e8 _ZSt13invoke_implIvRMN5iomgr19UringDriveInterfaceEFvPNS0_8IODeviceEPviERPS1_JS3_S4_iEET_St21invoke_memfun_derefOT0_OT1DpOT2 /usr/include/c++/11/bits/invoke.h:74 -> /home/runner/.conan/data/iomgr/11.1.1/oss/master/build/33d8264345a44b38910d1ef69c4aa8cfab220fa8/src/lib/interfaces/uring_drive_interface.cpp @ 000000000342506c _ZSt8invokeIRMN5iomgr19UringDriveInterfaceEFvPNS0_8IODeviceEPviEJRPS1_S3_S4_iEENSt15invoke_resultIT_JDpT0_EE4typeEOSBDpOSC /usr/include/c++/11/bits/invoke.h:96 -> /home/runner/.conan/data/iomgr/11.1.1/oss/master/build/33d8264345a44b38910d1ef69c4aa8cfab220fa8/src/lib/interfaces/uring_drive_interface.cpp @ 0000000003424dbe _ZNSt5_BindIFMN5iomgr19UringDriveInterfaceEFvPNS0_8IODeviceEPviEPS1_St12_PlaceholderILi1EES8_ILi2EES8_ILi3EEEE6callIvJOS3_OS4_OiEJLm0ELm1ELm2ELm3EEEET_OSt5tupleIJDpT0_EESt12_Index_tupleIJXspT1_EEE /usr/include/c++/11/functional:420 -> /home/runner/.conan/data/iomgr/11.1.1/oss/master/build/33d8264345a44b38910d1ef69c4aa8cfab220fa8/src/lib/interfaces/uring_drive_interface.cpp @ 00000000034244b3 _ZNSt5_BindIFMN5iomgr19UringDriveInterfaceEFvPNS0_8IODeviceEPviEPS1_St12_PlaceholderILi1EES8_ILi2EES8_ILi3EEEEclIJS3_S4_iEvEET0DpOT /usr/include/c++/11/functional:503 -> /home/runner/.conan/data/iomgr/11.1.1/oss/master/build/33d8264345a44b38910d1ef69c4aa8cfab220fa8/src/lib/interfaces/uring_drive_interface.cpp @ 00000000034226a6 _ZSt13invoke_implIvRSt5_BindIFMN5iomgr19UringDriveInterfaceEFvPNS1_8IODeviceEPviEPS2_St12_PlaceholderILi1EES9_ILi2EES9_ILi3EEEEJS4_S5_iEET_St14invoke_otherOT0DpOT1 /usr/include/c++/11/bits/invoke.h:61 -> /home/runner/.conan/data/iomgr/11.1.1/oss/master/build/33d8264345a44b38910d1ef69c4aa8cfab220fa8/src/lib/interfaces/uring_drive_interface.cpp @ 0000000003421ce8 _ZSt10invoke_rIvRSt5_BindIFMN5iomgr19UringDriveInterfaceEFvPNS1_8IODeviceEPviEPS2_St12_PlaceholderILi1EES9_ILi2EES9_ILi3EEEEJS4_S5_iEENSt9enable_ifIX16is_invocable_r_vIT_T0_DpT1_EESH_E4typeEOSIDpOSJ /usr/include/c++/11/bits/invoke.h:111 -> /home/runner/.conan/data/iomgr/11.1.1/oss/master/build/33d8264345a44b38910d1ef69c4aa8cfab220fa8/src/lib/interfaces/uring_drive_interface.cpp @ 0000000003420c3e _ZNSt17_Function_handlerIFvPN5iomgr8IODeviceEPviESt5_BindIFMNS0_19UringDriveInterfaceEFvS2_S3_iEPS6_St12_PlaceholderILi1EESA_ILi2EESA_ILi3EEEEE9_M_invokeERKSt9_Any_dataOS2_OS3_Oi /usr/include/c++/11/bits/std_function.h:290 -> /home/runner/.conan/data/iomgr/11.1.1/oss/master/build/33d8264345a44b38910d1ef69c4aa8cfab220fa8/src/lib/interfaces/uring_drive_interface.cpp @ 00000000034380d8 _ZNKSt8functionIFvPN5iomgr8IODeviceEPviEEclES2_S3_i /usr/include/c++/11/bits/std_function.h:590 -> /home/runner/.conan/data/iomgr/11.1.1/oss/master/build/33d8264345a44b38910d1ef69c4aa8cfab220fa8/src/lib/epoll/reactor_epoll.cpp @ 0000000003434cc3 _ZN5iomgr14IOReactorEPoll26on_user_iodev_notificationEPNS_8IODeviceEi /home/runner/.conan/data/iomgr/11.1.1/oss/master/build/33d8264345a44b38910d1ef69c4aa8cfab220fa8/src/lib/epoll/reactor_epoll.cpp:261 @ 000000000343197c _ZN5iomgr14IOReactorEPoll6listenEv /home/runner/.conan/data/iomgr/11.1.1/oss/master/build/33d8264345a44b38910d1ef69c4aa8cfab220fa8/src/lib/epoll/reactor_epoll.cpp:155 @ 000000000344438b _ZN5iomgr9IOReactor11listen_onceEv /home/runner/.conan/data/iomgr/11.1.1/oss/master/build/33d8264345a44b38910d1ef69c4aa8cfab220fa8/src/lib/reactor/reactor.cpp:116 @ 00000000034438e0 _ZN5iomgr9IOReactor3runEimjRKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKSt8functionIFbRKSt10shared_ptrIKNS_8IODeviceEEEEOS9_IFvbEE /home/runner/.conan/data/iomgr/11.1.1/oss/master/build/33d8264345a44b38910d1ef69c4aa8cfab220fa8/src/lib/reactor/reactor.cpp:71 @ 0000000003359ee4 _ZN5iomgr9IOManager12_run_io_loopEimjRKNSt7cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKSt8functionIFbRKSt10shared_ptrIKNS_8IODeviceEEEEOS9_IFvbEE /home/runner/.conan/data/iomgr/11.1.1/oss/master/build/33d8264345a44b38910d1ef69c4aa8cfab220fa8/src/lib/iomgr.cpp:334 @ 000000000342acaf _ZZN5iomgr18IOManagerEpollImpl19create_reactor_implERKNSt7cxx1112basic_stringIcSt11char_traitsIcESaIcEEEmjiOSt8functionIFvbEEENUlvE_clEv /home/runner/.conan/data/iomgr/11.1.1/oss/master/build/33d8264345a44b38910d1ef69c4aa8cfab220fa8/src/lib/epoll/iomgr_impl_epoll.cpp:17 @ 000000000342ba71 _ZSt13invoke_implIvZN5iomgr18IOManagerEpollImpl19create_reactor_implERKNSt7cxx1112basic_stringIcSt11char_traitsIcESaIcEEEmjiOSt8functionIFvbEEEUlvE_JEET_St14invoke_otherOT0DpOT1 /usr/include/c++/11/bits/invoke.h:61 -> /home/runner/.conan/data/iomgr/11.1.1/oss/master/build/33d8264345a44b38910d1ef69c4aa8cfab220fa8/src/lib/epoll/iomgr_impl_epoll.cpp @ 000000000342ba34 _ZSt8invokeIZN5iomgr18IOManagerEpollImpl19create_reactor_implERKNSt7cxx1112basic_stringIcSt11char_traitsIcESaIcEEEmjiOSt8functionIFvbEEEUlvE_JEENSt15invoke_resultIT_JDpT0_EE4typeEOSGDpOSH /usr/include/c++/11/bits/invoke.h:96 -> /home/runner/.conan/data/iomgr/11.1.1/oss/master/build/33d8264345a44b38910d1ef69c4aa8cfab220fa8/src/lib/epoll/iomgr_impl_epoll.cpp @ 000000000342b9e1 _ZNSt6thread8_InvokerISt5tupleIJZN5iomgr18IOManagerEpollImpl19create_reactor_implERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEEmjiOSt8functionIFvbEEEUlvE_EEE9_M_invokeIJLm0EEEEvSt12_Index_tupleIJXspT_EEE /usr/include/c++/11/bits/std_thread.h:259 -> /home/runner/.conan/data/iomgr/11.1.1/oss/master/build/33d8264345a44b38910d1ef69c4aa8cfab220fa8/src/lib/epoll/iomgr_impl_epoll.cpp @ 000000000342b9b5 _ZNSt6thread8_InvokerISt5tupleIJZN5iomgr18IOManagerEpollImpl19create_reactor_implERKNSt7cxx1112basic_stringIcSt11char_traitsIcESaIcEEEmjiOSt8functionIFvbEEEUlvE_EEEclEv /usr/include/c++/11/bits/std_thread.h:266 -> /home/runner/.conan/data/iomgr/11.1.1/oss/master/build/33d8264345a44b38910d1ef69c4aa8cfab220fa8/src/lib/epoll/iomgr_impl_epoll.cpp @ 000000000342b999 _ZNSt6thread11_State_implINS_8_InvokerISt5tupleIJZN5iomgr18IOManagerEpollImpl19create_reactor_implERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEEmjiOSt8functionIFvbEEEUlvE_EEEEE6_M_runEv /usr/include/c++/11/bits/std_thread.h:211 -> /home/runner/.conan/data/iomgr/11.1.1/oss/master/build/33d8264345a44b38910d1ef69c4aa8cfab220fa8/src/lib/epoll/iomgr_impl_epoll.cpp @ 00000000000e62b2 (unknown) @ 0000000000094ac2 (unknown) @ 000000000012684f (unknown)

JacksonYao287 commented 5 months ago

it has been fixed at homestore side.