xorbitsai / xorbits

Scalable Python DS & ML, in an API compatible & lightning fast way.
https://xorbits.readthedocs.io
Apache License 2.0
1.11k stars 67 forks source link

BUG: xorbits.shutdown occur some error #767

Open simplew2011 opened 7 months ago

simplew2011 commented 7 months ago

Describe the bug

xorbits.init(init_local=True, 
                 n_cpu=4)
# do something code

xorbits.shutdown()
2024-02-23 12:11:33,782 xorbits._mars.services.cluster.uploader 24675 ERROR    Failed to upload node info
Traceback (most recent call last):
  File "/home/wzp/anaconda3/envs/python3.8/lib/python3.8/site-packages/xorbits/_mars/services/cluster/uploader.py", line 137, in upload_node_info
    band_resources = await asyncio.to_thread(
  File "/home/wzp/anaconda3/envs/python3.8/lib/python3.8/site-packages/xorbits/_mars/lib/aio/_threads.py", line 36, in to_thread
    return await loop.run_in_executor(None, func_call)
asyncio.exceptions.CancelledError
/home/wzp/anaconda3/envs/python3.8/lib/python3.8/multiprocessing/resource_tracker.py:216: UserWarning: resource_tracker: There appear to be 1 leaked semaphore objects to clean up at shutdown
  warnings.warn('resource_tracker: There appear to be %d '

To Reproduce

To help us to reproduce this bug, please provide information below:

  1. Your Python version 3.8
  2. The version of Xorbits you use 0.7.1
  3. Versions of crucial packages, such as numpy, scipy and pandas
  4. Full stack of the error.
  5. Minimized code to reproduce the error.