search

OpenCSGs / csghub

CSGHub is an open-source large model platform just like on-premise version of Hugging Face. You can easily manage models and datasets, deploy model applications and setup model finetune or inference jobs with user interface. CSGHub also provides Python SDK with full compatibility of hf sdk. Join us together to build a safer and more open platform⭐️
https://opencsg.com
Apache License 2.0
3.01k stars 466 forks source link

Uploading one data set works fine, pushing multiple data sets will not be visible #669

Closed HuangLuGuang closed 1 month ago

HuangLuGuang commented 1 month ago
image image

Each file is about 800M, CSV format

ganisback commented 1 month ago

@HuangLuGuang can you help update the title to english? We have some foreign contributors who will look at this issue

HuangLuGuang commented 1 month ago

The connection to the git serve may have timed out, but I thought I'd find out where to set the timeout

Rader commented 1 month ago

how many files in this dataset?

HuangLuGuang commented 1 month ago

how many files in this dataset?

About 50 files, each about 800MB, CSV file

Rader commented 1 month ago

could you help list the hareware info like CPU, MEM?

and, which version of csghub used?

HuangLuGuang commented 1 month ago

could you help list the hareware info like CPU, MEM?

and, which version of csghub used?

CPU info Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Address sizes: 43 bits physical, 48 bits virtual Byte Order: Little Endian CPU(s): 4 On-line CPU(s) list: 0-3 Vendor ID: GenuineIntel Model name: Intel(R) Xeon(R) CPU E5-2678 v3 @ 2.50GHz CPU family: 6 Model: 63

MEM: 8G

csghub version is latest

Rader commented 1 month ago

@HuangLuGuang issue is closed, did you find the root cause?

HuangLuGuang commented 1 month ago

@HuangLuGuang issue is closed, did you find the root cause?

csv files are not tracked by lfs by default，dataset tree api response time is too long.

Rader commented 1 month ago

@HuangLuGuang issue is closed, did you find the root cause?

csv files are not tracked by lfs by default，dataset tree api response time is too long.

get it, thanks!