Open jeremybarnes opened 3 years ago
. virtualenv/bin/activate; PYTHONPATH=build/arm64/bin build/arm64/bin/mldb_runner -h localhost -p '11700-12700' --run-script mldb/testing/MLDB-1433-random-forest.py --mute-final-output --config-path mldb/container_files/mldb.conf --watchdog-timeout=120
Environment option NUM_CPUS set to 1
reading configuration from file: 'mldb/container_files/mldb.conf'
MLDB ready
context.resources = ["/v1","/types","/plugins","/javascript","javascript","/routes/run","run"]
creating SYMLINK /var/folders/ch/fv_rwtr97j55bhh8lz6p2dl80000gp/T/MRYyu6/main.js -> /Users/jeremy/projects/mldb/mldb/testing/MLDB-1755-column-execution-memory-use.js
loading from: /var/folders/ch/fv_rwtr97j55bhh8lz6p2dl80000gp/T/MRYyu6/main.js
exception in accept: Operation canceled
ServicePeer [2021-08-30T09:15:21.848-4:00] warning WARNING: peer mldb lost its own entry in discovery. Letting it come back
peer mldb connection to mldb changed state to 3
peer mldb connection to mldb changed state to 3
ImportTextProcedure [2021-08-30T09:15:22.050-4:00] info reading 9 columns ["Month","DayofMonth","DayOfWeek","DepTime","UniqueCarrier","Origin","Dest","Distance","dep_delayed_15min"]
ImportTextProcedure [2021-08-30T09:15:22.050-4:00] info writing 9 columns ["Month","DayofMonth","DayOfWeek","DepTime","UniqueCarrier","Origin","Dest","Distance","dep_delayed_15min"]
ImportTextProcedure [2021-08-30T09:15:22.228-4:00] info imported 10000 in 0.177239s at 0.056421M lines/second on 0.438901 CPUs
ImportTextProcedure [2021-08-30T09:15:22.228-4:00] info done 0.488846 megabytes at 2.75703 megabytes/sec
ImportTextProcedure [2021-08-30T09:15:22.228-4:00] info processed 10000 lines
commiting 1 frozen chunks
indexing 1 chunks
0 possible collisions
rowIndex.memusage() = 42,160
row index took elapsed: [0.00s cpu, 0.0849 mticks, 0.00s wall, 1.18 cores]TabularDataset [2021-08-30T09:15:22.231-4:00] info row name usage is 1480 bytes at 0.148 per row with MLDB::IntegerFrozenColumn
TabularDataset [2021-08-30T09:15:22.231-4:00] info timestamp usage is 224 bytes at 0.0224 per row with MLDB::IntegerFrozenColumn
TabularDataset [2021-08-30T09:15:22.232-4:00] info column Month used 5499 bytes at 0.5499 per row with MLDB::TableFrozenColumn
TabularDataset [2021-08-30T09:15:22.232-4:00] info column DayofMonth used 6858 bytes at 0.6858 per row with MLDB::TableFrozenColumn
TabularDataset [2021-08-30T09:15:22.232-4:00] info column DayOfWeek used 4228 bytes at 0.4228 per row with MLDB::TableFrozenColumn
TabularDataset [2021-08-30T09:15:22.232-4:00] info column DepTime used 15224 bytes at 1.5224 per row with MLDB::IntegerFrozenColumn
TabularDataset [2021-08-30T09:15:22.232-4:00] info column UniqueCarrier used 6770 bytes at 0.677 per row with MLDB::TableFrozenColumn
TabularDataset [2021-08-30T09:15:22.232-4:00] info column Origin used 11492 bytes at 1.1492 per row with MLDB::TableFrozenColumn
TabularDataset [2021-08-30T09:15:22.232-4:00] info column Dest used 12776 bytes at 1.2776 per row with MLDB::TableFrozenColumn
TabularDataset [2021-08-30T09:15:22.232-4:00] info column Distance used 16480 bytes at 1.648 per row with MLDB::IntegerFrozenColumn
TabularDataset [2021-08-30T09:15:22.232-4:00] info column dep_delayed_15min used 1708 bytes at 0.1708 per row with MLDB::TableFrozenColumn
TabularDataset [2021-08-30T09:15:22.232-4:00] info row index usage is 42160 bytes at 4.216 per row
TabularDataset [2021-08-30T09:15:22.232-4:00] info total mem usage is 124995 bytes for 10000 rows and 9 columns for 12.4995 bytes/row
TabularDataset [2021-08-30T09:15:22.232-4:00] info column memory is 81035
TabularDataset [2021-08-30T09:15:22.233-4:00] info row name usage is 1480 bytes at 0.148 per row with MLDB::IntegerFrozenColumn
TabularDataset [2021-08-30T09:15:22.233-4:00] info timestamp usage is 224 bytes at 0.0224 per row with MLDB::IntegerFrozenColumn
TabularDataset [2021-08-30T09:15:22.233-4:00] info column Month used 5499 bytes at 0.5499 per row with MLDB::TableFrozenColumn
TabularDataset [2021-08-30T09:15:22.233-4:00] info column DayofMonth used 6858 bytes at 0.6858 per row with MLDB::TableFrozenColumn
TabularDataset [2021-08-30T09:15:22.233-4:00] info column DayOfWeek used 4228 bytes at 0.4228 per row with MLDB::TableFrozenColumn
TabularDataset [2021-08-30T09:15:22.233-4:00] info column DepTime used 15224 bytes at 1.5224 per row with MLDB::IntegerFrozenColumn
TabularDataset [2021-08-30T09:15:22.233-4:00] info column UniqueCarrier used 6770 bytes at 0.677 per row with MLDB::TableFrozenColumn
TabularDataset [2021-08-30T09:15:22.233-4:00] info column Origin used 11492 bytes at 1.1492 per row with MLDB::TableFrozenColumn
TabularDataset [2021-08-30T09:15:22.233-4:00] info column Dest used 12776 bytes at 1.2776 per row with MLDB::TableFrozenColumn
TabularDataset [2021-08-30T09:15:22.233-4:00] info column Distance used 16480 bytes at 1.648 per row with MLDB::IntegerFrozenColumn
TabularDataset [2021-08-30T09:15:22.233-4:00] info column dep_delayed_15min used 1708 bytes at 0.1708 per row with MLDB::TableFrozenColumn
TabularDataset [2021-08-30T09:15:22.233-4:00] info row index usage is 42160 bytes at 4.216 per row
TabularDataset [2021-08-30T09:15:22.233-4:00] info total mem usage is 124995 bytes for 10000 rows and 9 columns for 12.4995 bytes/row
TabularDataset [2021-08-30T09:15:22.233-4:00] info column memory is 81035
mldb/rest/rest_collection.cc:409:32: runtime error: member call on null pointer of type 'MLDB::RestEntity'
#0 0x10600615c in MLDB::RestEntity::getPath() const rest_collection.cc:409
#1 0x106005fe8 in MLDB::RestEntity::getPath() const rest_collection.cc:409
#2 0x10486f63c in MLDB::RestConfigurableCollection<MLDB::Utf8String, MLDB::ProcedureRun, MLDB::ProcedureRunConfig, MLDB::ProcedureRunStatus>::RouteManager::addPostRoute()::'lambda'(MLDB::RestConnection&, MLDB::RestRequest const&, MLDB::RestRequestParsingContext const&)::operator()(MLDB::RestConnection&, MLDB::RestRequest const&, MLDB::RestRequestParsingContext const&) const rest_collection_impl.h:1615
#3 0x1053a551c in MLDB::RestRequestRouter::Route::process(MLDB::RestRequest const&, MLDB::RestRequestParsingContext&, MLDB::RestConnection&) const rest_request_router.cc:521
#4 0x1053a4a04 in MLDB::RestRequestRouter::processRequest(MLDB::RestConnection&, MLDB::RestRequest const&, MLDB::RestRequestParsingContext&) const rest_request_router.cc:393
#5 0x1053a551c in MLDB::RestRequestRouter::Route::process(MLDB::RestRequest const&, MLDB::RestRequestParsingContext&, MLDB::RestConnection&) const rest_request_router.cc:521
#6 0x1053a4a04 in MLDB::RestRequestRouter::processRequest(MLDB::RestConnection&, MLDB::RestRequest const&, MLDB::RestRequestParsingContext&) const rest_request_router.cc:393
#7 0x1053a551c in MLDB::RestRequestRouter::Route::process(MLDB::RestRequest const&, MLDB::RestRequestParsingContext&, MLDB::RestConnection&) const rest_request_router.cc:521
#8 0x1053a4a04 in MLDB::RestRequestRouter::processRequest(MLDB::RestConnection&, MLDB::RestRequest const&, MLDB::RestRequestParsingContext&) const rest_request_router.cc:393
#9 0x1053a551c in MLDB::RestRequestRouter::Route::process(MLDB::RestRequest const&, MLDB::RestRequestParsingContext&, MLDB::RestConnection&) const rest_request_router.cc:521
#10 0x1053a4a04 in MLDB::RestRequestRouter::processRequest(MLDB::RestConnection&, MLDB::RestRequest const&, MLDB::RestRequestParsingContext&) const rest_request_router.cc:393
#11 0x1053a551c in MLDB::RestRequestRouter::Route::process(MLDB::RestRequest const&, MLDB::RestRequestParsingContext&, MLDB::RestConnection&) const rest_request_router.cc:521
#12 0x1053a4a04 in MLDB::RestRequestRouter::processRequest(MLDB::RestConnection&, MLDB::RestRequest const&, MLDB::RestRequestParsingContext&) const rest_request_router.cc:393
#13 0x1053a46a4 in MLDB::RestRequestRouter::handleRequest(MLDB::RestConnection&, MLDB::RestRequest const&) const rest_request_router.cc:326
#14 0x1048026d8 in MLDB::ProcedureCollection::handlePutWithFirstRun(MLDB::Utf8String, MLDB::PolyConfig, bool, bool) procedure_collection.cc:176
#15 0x10480240c in MLDB::ProcedureCollection::handlePutSync(MLDB::Utf8String, MLDB::PolyConfig, bool) procedure_collection.cc:155
#16 0x106095a0c in MLDB::RestConfigurableCollection<MLDB::Utf8String, MLDB::PolyEntity, MLDB::PolyConfig, MLDB::PolyStatus>::RouteManager::addPutRoute()::'lambda0'(MLDB::RestConnection&, MLDB::RestRequest const&, MLDB::RestRequestParsingContext const&)::operator()(MLDB::RestConnection&, MLDB::RestRequest const&, MLDB::RestRequestParsingContext const&) const rest_collection_impl.h:1548
#17 0x1053a551c in MLDB::RestRequestRouter::Route::process(MLDB::RestRequest const&, MLDB::RestRequestParsingContext&, MLDB::RestConnection&) const rest_request_router.cc:521
#18 0x1053a4a04 in MLDB::RestRequestRouter::processRequest(MLDB::RestConnection&, MLDB::RestRequest const&, MLDB::RestRequestParsingContext&) const rest_request_router.cc:393
#19 0x1053a551c in MLDB::RestRequestRouter::Route::process(MLDB::RestRequest const&, MLDB::RestRequestParsingContext&, MLDB::RestConnection&) const rest_request_router.cc:521
#20 0x1053a4a04 in MLDB::RestRequestRouter::processRequest(MLDB::RestConnection&, MLDB::RestRequest const&, MLDB::RestRequestParsingContext&) const rest_request_router.cc:393
#21 0x1053a551c in MLDB::RestRequestRouter::Route::process(MLDB::RestRequest const&, MLDB::RestRequestParsingContext&, MLDB::RestConnection&) const rest_request_router.cc:521
#22 0x1053a4a04 in MLDB::RestRequestRouter::processRequest(MLDB::RestConnection&, MLDB::RestRequest const&, MLDB::RestRequestParsingContext&) const rest_request_router.cc:393
#23 0x1053a551c in MLDB::RestRequestRouter::Route::process(MLDB::RestRequest const&, MLDB::RestRequestParsingContext&, MLDB::RestConnection&) const rest_request_router.cc:521
#24 0x1053a4a04 in MLDB::RestRequestRouter::processRequest(MLDB::RestConnection&, MLDB::RestRequest const&, MLDB::RestRequestParsingContext&) const rest_request_router.cc:393
#25 0x1053a46a4 in MLDB::RestRequestRouter::handleRequest(MLDB::RestConnection&, MLDB::RestRequest const&) const rest_request_router.cc:326
#26 0x10e6f0e08 in MLDB::MldbJS::Methods::doPerform(MLDB::MldbEngine*, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, MLDB::Utf8String const&, MLDB::RestParams const&, Json::Value, MLDB::RestParams const&) mldb_js.cc:730
#27 0x10e6e8728 in MLDB::MldbJS::Methods::put(v8::FunctionCallbackInfo<v8::Value> const&) mldb_js.cc:779
#28 0x10ec8dff4 in v8::internal::FunctionCallbackArguments::Call(v8::internal::CallHandlerInfo)+0x234 (libv8.dylib:arm64+0x1bdff4)
#29 0x10ec8d580 in v8::internal::MaybeHandle<v8::internal::Object> v8::internal::(anonymous namespace)::HandleApiCallHelper<false>(v8::internal::Isolate*, v8::internal::Handle<v8::internal::HeapObject>, v8::internal::Handle<v8::internal::HeapObject>, v8::internal::Handle<v8::internal::FunctionTemplateInfo>, v8::internal::Handle<v8::internal::Object>, v8::internal::BuiltinArguments)+0x2bc (libv8.dylib:arm64+0x1bd580)
#30 0x10ec8cc54 in v8::internal::Builtin_Impl_HandleApiCall(v8::internal::BuiltinArguments, v8::internal::Isolate*)+0xf4 (libv8.dylib:arm64+0x1bcc54)
#31 0x10eb4e788 in Builtins_CEntry_Return1_DontSaveFPRegs_ArgvOnStack_BuiltinExit+0x68 (libv8.dylib:arm64+0x7e788)
#32 0xb9c000481d4 (<unknown module>)
#33 0x10eade2e4 in Builtins_JSEntryTrampoline+0xa4 (libv8.dylib:arm64+0xe2e4)
#34 0x10eaddf84 in Builtins_JSEntry+0xa4 (libv8.dylib:arm64+0xdf84)
#35 0x10ed41890 in v8::internal::(anonymous namespace)::Invoke(v8::internal::Isolate*, v8::internal::(anonymous namespace)::InvokeParams const&)+0xb68 (libv8.dylib:arm64+0x271890)
#36 0x10ed40d0c in v8::internal::Execution::Call(v8::internal::Isolate*, v8::internal::Handle<v8::internal::Object>, v8::internal::Handle<v8::internal::Object>, int, v8::internal::Handle<v8::internal::Object>*)+0xd0 (libv8.dylib:arm64+0x270d0c)
#37 0x10ec25140 in v8::Script::Run(v8::Local<v8::Context>)+0x3a8 (libv8.dylib:arm64+0x155140)
#38 0x10e67ec1c in MLDB::JavascriptPlugin::runJavascriptScript(MLDB::MldbEngine*, MLDB::PluginResource const&) js_plugin.cc:703
#39 0x10e67d07c in MLDB::JavascriptPlugin::handleTypeRoute(MLDB::RestDirectory*, MLDB::RestConnection&, MLDB::RestRequest const&, MLDB::RestRequestParsingContext&) js_plugin.cc:461
#40 0x1047958d4 in std::__1::function<MLDB::RestRequestMatchResult (MLDB::RestDirectory*, MLDB::RestConnection&, MLDB::RestRequest const&, MLDB::RestRequestParsingContext&)>::operator()(MLDB::RestDirectory*, MLDB::RestConnection&, MLDB::RestRequest const&, MLDB::RestRequestParsingContext&) const functional:2555
#41 0x10495ecdc in MLDB::PolyCollection<MLDB::Plugin>::Registry::handleCustomRequest(MLDB::RestDirectory*, MLDB::Utf8String const&, MLDB::RestConnection&, MLDB::RestRequest const&, MLDB::RestRequestParsingContext const&) poly_collection_impl.h:311
#42 0x10494fccc in MLDB::TypeCollection<MLDB::Plugin>::initRoutes(MLDB::RestCollection<MLDB::Utf8String, MLDB::TypeEntry>::RouteManager&)::'lambda1'(MLDB::RestConnection&, MLDB::RestRequest const&, MLDB::RestRequestParsingContext const&)::operator()(MLDB::RestConnection&, MLDB::RestRequest const&, MLDB::RestRequestParsingContext const&) const type_collection.cc:139
#43 0x1053a551c in MLDB::RestRequestRouter::Route::process(MLDB::RestRequest const&, MLDB::RestRequestParsingContext&, MLDB::RestConnection&) const rest_request_router.cc:521
#44 0x1053a4a04 in MLDB::RestRequestRouter::processRequest(MLDB::RestConnection&, MLDB::RestRequest const&, MLDB::RestRequestParsingContext&) const rest_request_router.cc:393
#45 0x1053a551c in MLDB::RestRequestRouter::Route::process(MLDB::RestRequest const&, MLDB::RestRequestParsingContext&, MLDB::RestConnection&) const rest_request_router.cc:521
#46 0x1053a4a04 in MLDB::RestRequestRouter::processRequest(MLDB::RestConnection&, MLDB::RestRequest const&, MLDB::RestRequestParsingContext&) const rest_request_router.cc:393
#47 0x1053a551c in MLDB::RestRequestRouter::Route::process(MLDB::RestRequest const&, MLDB::RestRequestParsingContext&, MLDB::RestConnection&) const rest_request_router.cc:521
#48 0x1053a4a04 in MLDB::RestRequestRouter::processRequest(MLDB::RestConnection&, MLDB::RestRequest const&, MLDB::RestRequestParsingContext&) const rest_request_router.cc:393
#49 0x1053a551c in MLDB::RestRequestRouter::Route::process(MLDB::RestRequest const&, MLDB::RestRequestParsingContext&, MLDB::RestConnection&) const rest_request_router.cc:521
#50 0x1053a4a04 in MLDB::RestRequestRouter::processRequest(MLDB::RestConnection&, MLDB::RestRequest const&, MLDB::RestRequestParsingContext&) const rest_request_router.cc:393
#51 0x1053a551c in MLDB::RestRequestRouter::Route::process(MLDB::RestRequest const&, MLDB::RestRequestParsingContext&, MLDB::RestConnection&) const rest_request_router.cc:521
#52 0x1053a4a04 in MLDB::RestRequestRouter::processRequest(MLDB::RestConnection&, MLDB::RestRequest const&, MLDB::RestRequestParsingContext&) const rest_request_router.cc:393
#53 0x1053a46a4 in MLDB::RestRequestRouter::handleRequest(MLDB::RestConnection&, MLDB::RestRequest const&) const rest_request_router.cc:326
#54 0x1053df2c0 in std::__1::__function::__func<MLDB::HttpRestService::init()::$_1, std::__1::allocator<MLDB::HttpRestService::init()::$_1>, void (std::__1::shared_ptr<MLDB::HttpRestEndpoint::RestConnectionHandler>, MLDB::HttpHeader const&, MLDB::Utf8String const&)>::operator()(std::__1::shared_ptr<MLDB::HttpRestEndpoint::RestConnectionHandler>&&, MLDB::HttpHeader const&, MLDB::Utf8String const&) functional:1727
#55 0x1053cbec0 in MLDB::HttpRestEndpoint::RestConnectionHandler::handleHttpPayload(MLDB::HttpHeader const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) http_rest_endpoint.cc:151
#56 0x106fe9578 in MLDB::HttpLegacySocketHandler::onDone(bool) http_socket_handler.cc:269
#57 0x10700b1a8 in std::__1::function<void (bool)>::operator()(bool) const functional:2555
#58 0x10700a1c4 in MLDB::HttpParser::finalizeParsing() http_parsers.cc:434
#59 0x107009aa8 in MLDB::HttpParser::feed(char const*, unsigned long) http_parsers.cc:204
#60 0x106fe84e8 in MLDB::HttpSocketHandler::onReceivedData(char const*, unsigned long) http_socket_handler.cc:106
#61 0x107128418 in std::__1::function<void (boost::system::error_code const&, unsigned long)>::operator()(boost::system::error_code const&, unsigned long) const functional:2555
#62 0x107128088 in boost::asio::detail::reactive_socket_recv_op<boost::asio::mutable_buffers_1, std::__1::function<void (boost::system::error_code const&, unsigned long)>, boost::asio::any_io_executor>::do_complete(void*, boost::asio::detail::scheduler_operation*, boost::system::error_code const&, unsigned long) reactive_socket_recv_op.hpp:145
#63 0x1070e0910 in boost::asio::detail::scheduler::do_run_one(boost::asio::detail::conditionally_enabled_mutex::scoped_lock&, boost::asio::detail::scheduler_thread_info&, boost::system::error_code const&) scheduler.ipp:486
#64 0x1070e065c in boost::asio::detail::scheduler::run(boost::system::error_code&) scheduler.ipp:204
#65 0x1070e0400 in MLDB::AsioThreadPool::Impl::run(int) asio_thread_pool.cc:84
#66 0x1070e0204 in void* std::__1::__thread_proxy<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct> >, MLDB::AsioThreadPool::Impl::Impl(boost::asio::io_context&, double)::'lambda'()> >(void*) thread:291
#67 0x18e887874 in _pthread_start+0x13c (libsystem_pthread.dylib:arm64e+0x7874)
#68 0x18e8825dc in thread_start+0x4 (libsystem_pthread.dylib:arm64e+0x25dc)
SUMMARY: UndefinedBehaviorSanitizer: undefined-behavior mldb/rest/rest_collection.cc:409:32 in
build/arm64/bin/mldb_runner -h localhost -p '11700-12700' --run-script mldb/testing/MLDB-1755-column-execution-memory-use.js --mute-final-output --config-path mldb/container_files/mldb.conf --watchdog-timeout=120