HabanaAI / Model-References

Reference models for Intel(R) Gaudi(R) AI Accelerator
155 stars 80 forks source link

Using the method provided below, I am unable to download the datasets and models. #54

Open wenchao987 opened 1 week ago

wenchao987 commented 1 week ago

When I tried to download datasets and models, I found that my account did not have the necessary permissions. When I attempted to apply for permissions, I did not receive approval. My site is in mainland China, which may be related to certain policies. Could we create specific models and datasets that are dedicated to serving the China region?

Download Data and Model

MLCommons hosts the model for download exclusively by MLCommons Members. You must first agree to the confidentiality notice, then follow the [link[(https://drive.google.com/drive/folders/11tBZvvrh0FCm3XuR5E849K42TqftYdUF)] to a directory containing Rclone download instructions. Follow steps 1-3 to install and activate Rclone. Finally, download the model to the desired download directory (default ./models): Log into mlperf4.0 container and run:

rclone copy mlc-llama2:Llama2-70b-fused-qkv-mlperf /root/model/Llama2-70b-fused-qkv-mlperf -P

Similarly download the data to the desired download directory (default ./dataset):

rclone copy mlc-llama2:training/scrolls_gov_report_8k /root/datasets/scrolls_gov_report_8k -P
wenchao987 commented 4 days ago

@mandy-li Would you help about this?