Annotating Custom Data

[MCemGunes]

Hello, I’m Cem Gunes

I have questions about labeling my custom models. I have read the paper, checked other closed issues; however, I could not apply a clear pipeline to prepare my models as parts of an assembly. Since I am out of the computer science community, I might be skipping some basic steps. Thanks for your understanding.

Firstly, I want to clarify what I aim to do. As an architect and computational designer, I want to prepare point cloud or mesh models of buildings as parts of a whole and train some deep learning models to see part segmentation performance to evaluate part-whole relations. So I created my custom mesh models using Rhinoceros 3D software and exported the 3d mesh models (.obj) with 4 labels. Likely, I will experiment with hierarchical tree-hier structures to identify sub-elements in further steps. To illustrate, I can segment the wall then identify the bricks. Nevertheless, I would be glad to create a dataset using the labels in the same hierarchy levels.

After some research, this annotator tool seems promising, but I could not manage to import my models and annotate them. Also, I have some problems using the sample models.

The main problem here is I could not even visualize the sample data properly except for one of them.

I see only one ID of the chair models. When I try to annotate it, I can not pick any specific point, so I can not cut the model as I wanted.

When I push ‘s’ it selects the whole part, I can not use ‘c' cut command. Moreover, requesting remeshing 'm' returns an error. You can see the backend and frontend errors when I try to re-mesh the model.

So I can not figure out why I can not see all the sample models you provided in the ShapeNet format and why I can not annotate them properly.

Finally, if it is genuinely possible for other researchers to annotate their custom models and use the format you have created, please explain it to me step by step from scratch. It seems like we can not transform our data to the ShapeNet format. So it seems like there is a strict limitation. Please inform me if I’m wrong. If somebody has already tried and succeeded, I am totally open to any guidance.

Here is my system I use Ubuntu 20.04.3 LTS focal. (amd64) I installed MySQL 5.7.36, as mentioned in the instructions. I installed Manifold and defined it as Globally executable in the model-fixer name. I installed npm ( 8.3.0) and node (17.3.0) Copied geometry_utils.py to “/partnet_anno_system/storage/data” Installed, mysql.connector, progressbar

server/config/server.js

// SET UP HERE!
server.HOST = 'http://localhost';
server.PORT = 3000;
server.DB_HOST = "localhost";
server.DB_USER = "mucemgunes";
server.DB_PASSWORD = "****";
server.DB_NAME = "partnet_anno_system";
server.CODE_DIR = "/home/ubuntuoslo/git_repo/partnet_anno___/partnet_ubuntu/partnet_anno_system"

client/config/backend.js

// Host and Port Information (SET UP HERE!)
be_config.remoteHost = 'http://localhost';
be_config.remotePort = '3000';

I can provide any additional information if required.

Thanks for your immense documentation and publishing this work,

Greetings

[Mdemerdash]

@MCemGunes Hi, were you able to figure out this pipeline?

[maxerbubba]

@maxerbubba Hi, were you able to figure out this pipeline?

I don’t know anything I don’t work on this project

[Mdemerdash]

@maxerbubba Hi, were you able to figure out this pipeline?

I don’t know anything I don’t work on this project

Sorry for the inconvenience, i mentioned you by mistake

[MCemGunes]

@Mdemerdash Hi! Sorry for the late response, unfortunately, I gave up after several tries.

[Mdemerdash]

Hi @MCemGunes thank you for your reply. were you able to find similar alternatives? I'm about to give up too :D

[MCemGunes]

@Mdemerdash No, not really, I changed my method to classical semantic segmentation without part hierarchies. :)

[Mdemerdash]

@MCemGunes that's sad..I'm actually making some progress..now able to cur the parts in the anno system. I also created a new category where i actually used some files of the chair category that i can produce on my own and I'm able to annotate my "own" chair category. If you still have some slight interest feel free to drop me an email. mdemerdash89@hotmail.com

[MCemGunes]

Thank you for being so friendly and helpful. Nowadays I'm busy with other tasks, but when I'm free I am definitely going to check it again and let you know if I got stuck in one of the steps.