I am trying to pre-train the spectrum model. I have already downloaded the data using the following command:
"""
from datasets import load_dataset
dset = load_dataset('astroclip/data/dataset.py')
"""
However, I am unsure how to load the data when pre-training the spectrum model. Do I need to copy the downloaded data to the "astroclip/datasets/astroclip_file" directory?
I am trying to pre-train the spectrum model. I have already downloaded the data using the following command: """ from datasets import load_dataset dset = load_dataset('astroclip/data/dataset.py') """ However, I am unsure how to load the data when pre-training the spectrum model. Do I need to copy the downloaded data to the "astroclip/datasets/astroclip_file" directory?
Looking forward to your response. Thank you.