search

xtreme1-io / xtreme1

Xtreme1 is an all-in-one data labeling and annotation platform for multimodal data training and supports 3D LiDAR point cloud, image, and LLM.
https://www.basic.ai
Apache License 2.0
839 stars 134 forks source link

1GB Upload limit #219

Closed MaxPRon closed 5 months ago

MaxPRon commented 5 months ago

Hi :)

I'm using Xtreme v0.9 locally on my workstation and want to label a Lidar Fusion Dataset.

When uploading a dataset it gets stuck at 0% pending (see screenshot)

image

From the cloud version I know that there is a 1GB limit for the upload. Does this also apply when running the annotation tool locally ?

I tried it also with a < 1GB dataset and it works. So I assume there is this limitation even though the tool doesn't directly complain.

Is there a way around this when running the tool locally ?

Any help is appreciated :)

Thanks a lot already!

jaggerwang commented 5 months ago

We have already adjust the nginx body size limit to 1TB in this PR #220, but at present, we are adopting a simple overall transmission method. Due to the memory limit of the browser, you can only transfer about 2GB of files. We plan to optimize the upload here for streaming upload in the future to break through the memory limit of the browser.

MaxPRon commented 5 months ago

@jaggerwang Understood! Thanks a lot for the reply