dmlc / xgboost

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow
https://xgboost.readthedocs.io/en/stable/
Apache License 2.0
26.33k stars 8.73k forks source link

Simplify the GPU memory logger. #10927

Closed trivialfis closed 4 weeks ago

trivialfis commented 4 weeks ago

Simplify the logger to only keep tracker of the current and peak memory usage. The current locking mechanism doesn't guarantee the ordering of the lock and it's difficult to fix.

We can use rmm or nsys for detailed memory profiling in the future.

trivialfis commented 4 weeks ago

cc @rongou .