xtreme1-io / xtreme1

Xtreme1 is an all-in-one data labeling and annotation platform for multimodal data training and supports 3D LiDAR point cloud, image, and LLM.
https://www.basic.ai
Apache License 2.0
778 stars 123 forks source link

Load Resource Error #248

Open sayyedasif444 opened 1 month ago

sayyedasif444 commented 1 month ago

Describe the bug Large LiDAR dataset above 800 mb, does not get extracted in backend on low configuration servers (4 core, 8GB) hence giving error on PC-tool as the file was not found. Once the Server capacity is increased it works file on uploading but the PC-tool UI fails to load the data stating the same error message 'Load Resource Error'

To Reproduce Steps to reproduce the behavior:

  1. Go to LiDAR data tool
  2. Upload a large LiDAR dataset
  3. Once the upload is complete, click on annotation tool to load the data in pc-tool.
  4. pc-tool will open new tab and throws the error

Expected behavior System specification should be mentioned to process the LiDAR data and data should be loaded in PC-TOOL for viewing or annotating

Screenshots image

Desktop (please complete the following information):

jaggerwang commented 1 month ago

Which version are you using? Please try the latest version. If it still exist, please provide the console log of backend.

jaggerwang commented 1 month ago

We can successfully upload a lidar fusion package more than 2GB in our test environment, which have 4GB memory limit, it will consume about 3GB memory to process this package.

sayyedasif444 commented 1 month ago

Tried locally with latest docker version of xtreme1. not even the 811 mb file is getting parsed and extracted from zip. Please check the screenshot below for the reference. image

Tried on a system with Specification: 16 GB memory, 8 core processor

please find a file link which i am trying with. (given file worked on basic AI online tool) https://drive.google.com/file/d/1lttUpLcw8y4vmKG2Rjpy5xn7_hxSTQGZ/view?usp=sharing

Please check the error log for backend image