search

microsoft / DeepSpeed-MII

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
Apache License 2.0
1.91k stars 175 forks source link

FileExistsError: [Errno 17] File exists: '/tmp/mii_cache' ` on generate function call #516

Open krishnanpooja opened 3 months ago

krishnanpooja commented 3 months ago

` File "/opt/conda/envs/ptca/lib/python3.10/site-packages/mii/score/generate.py", line 36, in generated_score_path generated_score_path(mii_config.deployment_name, File "/opt/conda/envs/ptca/lib/python3.10/site-packages/mii/score/generate.py", line 36, in generated_score_path score_path = os.path.join(mii.utils.mii_cache_path(), deployment_name)generated_score_path(mii_config.deployment_name,

File "/opt/conda/envs/ptca/lib/python3.10/site-packages/mii/utils.py", line 103, in mii_cache_path File "/opt/conda/envs/ptca/lib/python3.10/site-packages/mii/score/generate.py", line 36, in generated_score_path score_path = os.path.join(mii.utils.mii_cache_path(), deployment_name) File "/opt/conda/envs/ptca/lib/python3.10/site-packages/mii/utils.py", line 103, in mii_cache_path os.makedirs(cache_path)
score_path = os.path.join(mii.utils.mii_cache_path(), deployment_name) File "/opt/conda/envs/ptca/lib/python3.10/os.py", line 225, in makedirs

  File "/opt/conda/envs/ptca/lib/python3.10/site-packages/mii/utils.py", line 103, in mii_cache_path

os.makedirs(cache_path) File "/opt/conda/envs/ptca/lib/python3.10/os.py", line 225, in makedirs os.makedirs(cache_path) File "/opt/conda/envs/ptca/lib/python3.10/os.py", line 225, in makedirs mkdir(name, mode) FileExistsError: [Errno 17] File exists: '/tmp/mii_cache' `