catboost / catboost

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
https://catboost.ai
Apache License 2.0
8.07k stars 1.19k forks source link

RStudio crashes for certain set of hyperparameters #1670

Open vidarsumo opened 3 years ago

vidarsumo commented 3 years ago

Problem: RStudio crashes when tuning Catboost with GPU using treesnip and tidymodels.

This seems to happen for certain set of hyperparameters. The first two sets in the screenshot below runs just fine but when the hyperparameter tuning starts with the third set of parameters RStudio crashes.

image

catboost version: 25.1 Operating System: Windows Server 2019 Datacenter CPU: Intel Xeon CPU E5-2690 v4 @ 2.60GHz GPU: NVIDIA Tesla V100-PCIE-16GB

I guess you'll need reprex for further investigation. I'll post it as soon as I can.

vidarsumo commented 3 years ago

It's not easy to reproduce this. If I'm using, say, 5-fold cross validation with 10 sets of hyperparameters the code might run through all the 10 parameters in fold 1 and 2 but fail on fold 3. So the crash of RStudio is not related to the parameter itself it seems. I will continue to reproduce this so I can post an example.

vidarsumo commented 3 years ago

Not sure if this is Catboost or RStudio related (or something else). But this keeps happening, i.e. RStudio crashing when tuning Catboost with GPU.

From the diagnostics in RStudio I got this (if it's of any help):

19 May 2021 14:58:04 [rsession-vidar] ERROR CLIENT EXCEPTION (rsession-vidar): (TypeError) : Cannot read property 'L' of null;
org/rstudio/studio/client/workbench/views/source/editors/text/AceEditor.java#4486::setScrollSpeed
org/rstudio/studio/client/workbench/views/source/editors/text/AceEditorMonitor.java#46::monitor
org/rstudio/studio/client/workbench/views/source/editors/text/AceEditorMonitor.java#70::execute
com/google/gwt/core/client/impl/SchedulerImpl.java#140::execute
com/google/gwt/core/client/impl/Impl.java#306::apply
com/google/gwt/core/client/impl/Impl.java#345::entry0
rstudio-0.js#-1::eval
com/google/gwt/cell/client/AbstractEditableCell.java#41::viewDataMap
Client-ID: xxxx
User-Agent: Mozilla/5.0 (Windows NT 10.0  Win64  x64) AppleWebKit/537.36 (KHTML, like Gecko) QtWebEngine/5.12.8 Chrome/69.0.3497.128 Safari/537.36