mlcommons / training

Reference implementations of MLPerf™ training benchmarks
https://mlcommons.org/en/groups/training
Apache License 2.0
1.62k stars 560 forks source link

Access to Rclone Download Instructions for llama2_70b_lora #768

Closed conde-amd closed 4 weeks ago

conde-amd commented 1 month ago

I have followed the instructions in the README to access the [Dataset/Model Name] data and model. I have:

However, I am still awaiting access to the Rclone download instructions.

nnasirinvidia commented 1 month ago

I have similar issue. Here is the issue that I see on my side: rclone copy mlc-llama2:Llama2-70b-fused-qkv-mlperf ./Llama2-70b-fused-qkv-mlperf -P 2024/10/10 21:14:01 ERROR : Google drive root 'Llama2-70b-fused-qkv-mlperf': error reading source root directory: directory not found 2024/10/10 21:14:01 ERROR : Attempt 1/3 failed with 1 errors and: directory not found 2024/10/10 21:14:01 ERROR : Google drive root 'Llama2-70b-fused-qkv-mlperf': error reading source root directory: directory not found 2024/10/10 21:14:01 ERROR : Attempt 2/3 failed with 1 errors and: directory not found 2024/10/10 21:14:01 ERROR : Google drive root 'Llama2-70b-fused-qkv-mlperf': error reading source root directory: directory not found 2024/10/10 21:14:01 ERROR : Attempt 3/3 failed with 1 errors and: directory not found Transferred: 0 B / 0 B, -, 0 B/s, ETA - Errors: 1 (retrying may help) Elapsed time: 1.8s 2024/10/10 21:14:01 Failed to copy: directory not found

When I run rclone ls mlc-llama2, I see these two files: 12666 llm_inference_post_process_script/llm_inference_post_processing.ipynb 21350 llm_inference_post_process_script/analyze_gpt_result_summary.ipynb

hiwotadese commented 1 month ago

@nathanw-mlc can you take a look at this?

nathanw-mlc commented 1 month ago

@conde-amd Please email systems@mlcommons.org with the email address you used to submit the confidentiality agreement.