LiuShihHung / GICN

52 stars 7 forks source link

issue with low prec and rec in model predictions, need of some assistance #12

Open EMADASZ opened 2 years ago

EMADASZ commented 2 years ago

Hi,

I've been trying to test your code but I can;t retrieve results on level which is declared in readme and article.

Each time I do the evaluation result are on level of 1-2% in prec and less than 1% in rec. I've tried to run main_eval on trained model included in repository, on s3dis dataset available in jsis3d repository. (zip which can be downloaded according to your readme file)

Like others I've met several issues during code setup, what made me do some minor changes, but I have no idea if these had influence on results which I receive.

So here is the short list of changes in code and reason why I did it:

  1. "Unable to open object (object 'semIns_labels' doesn't exist)" - I have change the names of column to labels, since in jsis3d database has no such column: semIns_labels

  2. ModuleNotFoundError: No module named 'new_bonet' - since new_bonet doesn;t exist I have changed the import to gicn_model

  3. "Unable to open object (object 'pc_indices' doesn't exist)" - I have change reading of this column into arange in following manner: pc_indices = np.arange(block_id4096, block_id4096 + 4096)#fin['pc_indices'][block_id] # [4096] due to fact that, this column doesn;t exist

  4. input_bat_pc_indices = copy.deepcopy(bat_pc_indices[0].squeeze(1)) numpy.AxisError: axis 1 is out of bounds for array of dimension 1 - what I did was deleteing the squeeze, since array has a single dimension

  5. FileNotFoundError: [Errno 2] No such file or directory: '/media/marcin/StorageForData/GICN-master/./data_s3dis/SCN_prediction/area5_2/WC_1.txt' - I have change the path to area5 without _2, since such directory doesn;t exist.

  6. pc_indices_raw = scene_result[block][0]['pc_indices_raw'][0].squeeze(1) ValueError: cannot select an axis to squeeze out which has size not equal to one - I have changed squeese to axis 0 (squeeze(0)), since this is the only axis possible to squeeze and without squeezing it I fell on another issue.

  7. ModuleNotFoundError: No module named 'helper_data_plot' - I have simply change the import to data_plot since helper doesn;t exist

Could you give me some hint or help on the reason of such unexpected prec and rec results? Any help will be much apreciated.

Best Regards