xtreme1-io / xtreme1

Xtreme1 is an all-in-one data labeling and annotation platform for multimodal data training and supports 3D LiDAR point cloud, image, and LLM.
https://www.basic.ai
Apache License 2.0
853 stars 141 forks source link

Copy Feature v.09 #221

Open MaxPRon opened 6 months ago

MaxPRon commented 6 months ago

Hi,

I'm using the Xtreme Version 0.9 locally to label a lidar-(fusion) dataset.

I wanted to ask if there is a copy feature available ?

It would already be super helpful just be able to simply copy the labels into the next frame. If seen it's possible in the cloud version. In https://github.com/xtreme1-io/xtreme1/issues/100 (March, 2023) it was mentioned that tracking is not planned to be included in the community version.

Does this still apply ? Again a simple copy feature without any compensation etc. would already be nice.

Maybe there is also a workaround.

Thanks a lot!

MaxPRon commented 6 months ago

Hi :) @jotamotk Is there any update on that issue ?

jotamotk commented 6 months ago

Hi @MaxPRon , Sorry to reply to you late. I was otherwise engaged.

Copy features are currently unavailable in Xtreme1 but are planned in the future. Our new roadmap will include integrating and open-sourcing almost all of the BasicAI cloud toolsets into Xtreme1.

Due to limited resources, our next priority will be integrating extensive toolsets like text, LiDAR Segmentation, and LLM into Xtreme1 instead of advanced features like copy. So it will probably be late. If you want this feature shortly, any PRs will be appreciated.

Best, James

MaxPRon commented 6 months ago

Hi @jotamotk ,

thanks a lot for the update.

Regarding the feature, I could give it a try but we super helpful if you would be able to give some pointers where in the code I should get started.

I would aim for a simple copy feature with the following funcitonality:

Best,

Max

jotamotk commented 6 months ago

Sure, @guhaomine will give you some pointers to start

guhaomine commented 6 months ago

@MaxPRon image In the point cloud continuous frame data set annotation, we implemented the function of copying the results to the next frame. In the code, there is a method called "track" that you may need. The file path is 'frontend\pc-tool\src\packages\pc-editor\common\DataManager.ts' image

MaxPRon commented 6 months ago

@guhaomine Thanks for the pointer. Another quick question. The screenshot you're showing is from the cloud or community version ?

The code snipped you mentioned you used is currently not used, correct ?

guhaomine commented 5 months ago

@MaxPRon No, the community version has this feature, you need to upload a continuous frame data set. The timeline will be displayed image

chanyoung1998 commented 5 months ago

@MaxPRon is there any update? our team is planning to implement that object tracking function for our own. If you have any update or progress about it, let me know!

MaxPRon commented 5 months ago

@chanyoung1998 Not really, the hint @guhaomine gave was actually what I was looking for. Although l would still be interested in an object tracking/interpolation feature.

@guhaomine Also thanks a lot for the hint :)

chanyoung1998 commented 4 months ago

@guhaomine , if you happen to know model request format for Tracking Object ? I'd like to know http call request format for tracking model.

jaggerwang commented 4 months ago

@chanyoung1998 Right now, only object detection models can be customized, the object tracking model is a little complicated, as it need to call the object detection model first, it will be simplified and allow customize in the future.

You can find the related docs here. image