When I use the download code below, it return the git-lfs.
data = MsDataset.load(
'Youku-AliceMind',
namespace='modelscope',
download_mode=DownloadMode.FORCE_REDOWNLOAD, # if you need to clean the cache , please use it
subset_name='pretrain',
split='train', # Options: train, test, validation
use_streaming=True)
fanbooo
commented
12 months ago
When I use the download code below, it return the git-lfs.
data = MsDataset.load( 'Youku-AliceMind', namespace='modelscope', download_mode=DownloadMode.FORCE_REDOWNLOAD, # if you need to clean the cache , please use it subset_name='pretrain', split='train', # Options: train, test, validation use_streaming=True)
print(next(iter(data)))
How to download all 36TB video from git-lfs