Is there any way to debug SynapseML?

microsoft / SynapseML

Simple and Distributed Machine Learning

http://aka.ms/spark

MIT License

5.07k stars 831 forks source link

Is there any way to debug SynapseML? #1630

Open TT568 opened 2 years ago

TT568 commented 2 years ago

Is there any way to debug SynapseML(LightGBM)?

AB#1945020

github-actions[bot] commented 2 years ago

Hey @TT568 :wave:! Thank you so much for reporting the issue/feature request :rotating_light:. Someone from SynapseML Team will be looking to triage this issue soon. We appreciate your patience.

mhamilton723 commented 2 years ago

You can debug locally in intellij or pycharm following the developer readme here. You can also view spark logs on your cluster or SparkUI to learn more about the issue

https://microsoft.github.io/SynapseML/docs/reference/developer-readme/

svotaw commented 2 years ago

What in particular do you want to debug? Note that SynapseML is a scala wrapper around a native C++ LightGBM library, so there are different levels of "debugging".

nitishpshah20 commented 1 year ago

I have an issue where lightgbm spark training is taking much longer than I expected. how do I debug issues in the c++ Lightgbm native library?

svotaw commented 1 year ago

use logs mainly. To debug the c++ code directly see the microsoft/LightGBM repo.