-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Description
When uploading an XLS(X) file via the FilePicker widget and setting the **Data format** property t…
-
Thank you for your work.
When will the code and dataset be released?
-
@hadjisma @lavenderrz
Your code mentions a directory containing shard files formatted as tar.
https://github.com/SamsungLabs/StepFormer/blob/31f62679536177e7bc8e132b5611ee596f427fab/data/tar_loader…
-
wds no longer has the attribute Dataset?
Can still find wds.Dataset in the following document: https://webdataset.github.io/webdataset/gettingstarted/
-
I am not able to understand the logic of the code
"
if suffix in current_sample:
raise ValueError(f"{fname}: duplicate file name in tar file {suffix} {current_sample.keys()})
"
in the group_…
-
### Search before asking
- [X] I searched the [issues](https://github.com/WeBankFinTech/DataSphereStudio/issues) and found no similar issues.
### DSS Component
dss-framework
### What happened + W…
-
I'm reading the code in `https://github.com/tmbdev-archive/webdataset-examples/blob/master/main-wds.py`, I'm confused about in Line 332, you write `train_loader.repeat(2).slice(number_of_batches)`. Ho…
-
I can not understand about this plugin's purpose, But strangely, when I used web-dev-server, my native HTML importmap function completely disappeared, so I was forced to install this plugin, and it wo…
-
I creat a webdataset below, where ResampledShards is defiend to repeat tar files to make sure every gpu and every worker could load different tar file. But i found that dataset will not load the compl…
-
Originally reported by: **Anonymous**
----------------------------------------
This is my biggest pet peeve with WDS, it makes the task of file cleaning more difficult, especially with large directo…