zigvu / khajuri

Video Pipeline
0 stars 0 forks source link

Post-processing use threshold earlier to reduce computation. #78

Closed regmiz closed 9 years ago

regmiz commented 9 years ago

Post-processing use threshold earlier to reduce computation.

arpgh commented 9 years ago

Running post processing only in existing json. (in config, run_caffe: false, run_postprocess: true) Something missing in config?

Branch: issue78 Video: wc14-BraNed-HLTS.mkv Path: gpu2:/mnt/data/wc14cls/training/0seed-cleaned/vdo-test/tests-issue78/wc14-BraNed-HLTS/ Log with error: runlog-process_video-postProcessOnly.txt Json folder used: json Error:

Traceback (most recent call last):
  File "/home/ubuntu/khajuri/Logo/PipelineBin/process_video.py", line 21, in <module>
    videoProcessThread.run()
  File "/home/ubuntu/khajuri/Logo/PipelineThread/VideoProcessThread.py", line 201, in run
    self.configReader, imageWidth, imageHeight)
  File "/home/ubuntu/khajuri/Logo/PipelineCore/PostProcessManager.py", line 70, in getAllCellBoundariesDict
    allCellBoundariesDict = PixelMap.getCellBoundaries(staticBoundingBoxes, scales)
  File "/home/ubuntu/khajuri/Logo/PipelineMath/PixelMap.py", line 145, in getCellBoundaries
    if allCellBoundaries[ "frameDim" ][ "width" ] != staticBoundingBoxes.imageDim.width:
KeyError: 'frameDim'
regmiz commented 9 years ago

Will have to delete the /tmp/saveBoundaries.p - looks like there was an old one there.

regmiz commented 9 years ago

once you delete the old one then it should continue fine on repeated runs.

arpgh commented 9 years ago

After Sudip's latest change of filtering right at json read, combined post processing speed for 14min video is at ~3x which is closer to caffe-only runtime. And produced localization scores match with those from earlier runs - so this is great!

When curation and/or heatmap is true, process needs to revert to existing method of using all patch scores. Currently, compare-json is showing discrepancy in curation part.

Lots of log is being produced now, so some cosmetic changes would help result analysis -

regmiz commented 9 years ago

Fixed the above issues at: 936f2dd4356e41794fdcf13e44f3ca479f7ff638

regmiz commented 9 years ago
regmiz commented 9 years ago

Fixed at 8c026edcde270e942749b8657005e9891ac67a68

arpgh commented 9 years ago

Both localization & curation are missing after this change.

regmiz commented 9 years ago

Updated log messages: a12ccabbd11f0bee3ab8d00ef82d2b05be0decd0

arpgh commented 9 years ago

Json scores with localization and curation match. Log now shows localization and/or curation and/or heatmap based on config.