search

Lightning-Universe / Pose-app

A Lightning app for animal pose estimation.
https://pose-app.readthedocs.io/
Apache License 2.0
18 stars 1 forks source link

Connetion Error After Uploading Videos on Extract Frames Tab #98

Closed renaissance12138 closed 1 month ago

renaissance12138 commented 2 months ago

We failed to extract frames after uploading our videos on browser lightening app. What should we do next.

WechatIMG1784
themattinthehatt commented 2 months ago

@renaissance12138 if you navigate back to the command line where you launched the app there should be a bunch of logging outputs. can you copy/paste the end of that output, where the error was raised?

renaissance12138 commented 2 months ago

INFO:APP.EXTRACT_FRAMES:============== extracting frames from data/0716-treeshaw-pose-example/videos/recording_1_jump_4.mp4 ================ INFO:APP.EXTRACT_FRAMES:video file exists? True 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████| 79/79 [00:00<00:00, 210.11it/s] Process ForkProcess-8: Traceback (most recent call last): File "/home/zeus/miniconda3/envs/cloudspace/lib/python3.10/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/home/zeus/miniconda3/envs/cloudspace/lib/python3.10/multiprocessing/process.py", line 108, in run self._target(*self._args, self._kwargs) File "/home/zeus/miniconda3/envs/cloudspace/lib/python3.10/site-packages/lightning/app/utilities/proxies.py", line 433, in call raise ex File "/home/zeus/miniconda3/envs/cloudspace/lib/python3.10/site-packages/lightning/app/utilities/proxies.py", line 414, in call self.run_once() File "/home/zeus/miniconda3/envs/cloudspace/lib/python3.10/site-packages/lightning/app/utilities/proxies.py", line 566, in run_once self.work.on_exception(ex) File "/home/zeus/miniconda3/envs/cloudspace/lib/python3.10/site-packages/lightning/app/core/work.py", line 644, in on_exception raise exception File "/home/zeus/miniconda3/envs/cloudspace/lib/python3.10/site-packages/lightning/app/utilities/proxies.py", line 531, in run_once ret = self.run_executor_cls(self.work, work_run, self.delta_queue)(*args, *kwargs) File "/home/zeus/miniconda3/envs/cloudspace/lib/python3.10/site-packages/lightning/app/utilities/proxies.py", line 364, in call return self.work_run(args, kwargs) File "/teamspace/studios/this_studio/Pose-app/lightning_pose_app/ui/extract_frames.py", line 323, in run self._extract_frames(method="random", **kwargs) File "/teamspace/studios/this_studio/Pose-app/lightning_pose_app/ui/extract_frames.py", line 123, in _extract_frames idxs_selected = select_frame_idxs_kmeans( File "/teamspace/studios/this_studio/Pose-app/lightning_pose_app/backend/extract_frames.py", line 103, in select_frame_idxs_kmeans assert (end_frame - beg_frame) >= n_frames_to_select, "valid video segment too short!" AssertionError: valid video segment too short! INFO: Your Lightning App is being stopped. This won't take long. INFO: Received SIGTERM signal. Gracefully terminating fiftyone... INFO: Received SIGTERM signal. Gracefully terminating tensorboard... INFO: Received SIGTERM signal. Gracefully terminating label_studio.label_studio... INFO: Received SIGTERM signal. Gracefully terminating train_ui.work... INFO: Received SIGTERM signal. Gracefully terminating streamlit_video.work... INFO: Received SIGTERM signal. Gracefully terminating streamlit_frame.work... INFO: Your Lightning App has been stopped successfully!

themattinthehatt commented 2 months ago

@renaissance12138 the error here says that your video segment is too short for the number of frames you'd like to extract - how long is the video that you uploaded?

renaissance12138 commented 2 months ago

Most of them are around 2 seconds.

On Wed, Jul 17, 2024 at 8:49 PM Matt Whiteway @.***> wrote:

@renaissance12138 https://github.com/renaissance12138 the error here says that your video segment is too short for the number of frames you'd like to extract - how long is the video that you uploaded?

— Reply to this email directly, view it on GitHub https://github.com/Lightning-Universe/Pose-app/issues/98#issuecomment-2234943038, or unsubscribe https://github.com/notifications/unsubscribe-auth/A4CCJKCLEPK6XFYQIKSVWYDZM4GKRAVCNFSM6AAAAABK7JVIQSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMZUHE2DGMBTHA . You are receiving this because you were mentioned.Message ID: @.***>

-- He/His Undergraduate [Neuroscience & Statistics] University of Virginia

themattinthehatt commented 1 month ago

what's the framerate of those videos (i.e., how many frames per vid roughly)? and how many frames are you requesting to label per video?

renaissance12138 commented 1 month ago

The recording is 100 frames per second and we are trying to label 40 or so.

On Thu, Jul 18, 2024 at 1:54 PM Matt Whiteway @.***> wrote:

what's the framerate of those videos (i.e., how many frames per vid roughly)? and how many frames are you requesting to label per video?

— Reply to this email directly, view it on GitHub https://github.com/Lightning-Universe/Pose-app/issues/98#issuecomment-2237168897, or unsubscribe https://github.com/notifications/unsubscribe-auth/A4CCJKERG5JGO7BL5SMVZ33ZM76NFAVCNFSM6AAAAABK7JVIQSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMZXGE3DQOBZG4 . You are receiving this because you were mentioned.Message ID: @.***>

-- He/His Undergraduate [Neuroscience & Statistics] University of Virginia

themattinthehatt commented 1 month ago

ok final question - did you change the slider on the right-hand side, where you can crop off the beginning/end of the video? somehow the video looks too short to the frame extraction function

renaissance12138 commented 1 month ago

I don't think there is any slider shown. When I uploaded my video, the whole app was just disconnected.

On Thu, Jul 18, 2024 at 3:19 PM Matt Whiteway @.***> wrote:

ok final question - did you change the slider on the right-hand side, where you can crop off the beginning/end of the video? somehow the video looks too short to the frame extraction function

— Reply to this email directly, view it on GitHub https://github.com/Lightning-Universe/Pose-app/issues/98#issuecomment-2237359336, or unsubscribe https://github.com/notifications/unsubscribe-auth/A4CCJKEFPP7EELDSYG2L2ETZNAIKRAVCNFSM6AAAAABK7JVIQSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMZXGM2TSMZTGY . You are receiving this because you were mentioned.Message ID: @.***>

-- He/His Undergraduate [Neuroscience & Statistics] University of Virginia

themattinthehatt commented 1 month ago

Can you try extracting 20 instead of 40 frames and see if that works? Also, if you don't have a problem sending me the video I can play around with it on my side; sending through discord is probably easiest.

renaissance12138 commented 1 month ago

Yeah, I can do that.

On Fri, Jul 19, 2024 at 9:37 AM Matt Whiteway @.***> wrote:

Can you try extracting 20 instead of 40 frames and see if that works? Also, if you don't have a problem sending me the video I can play around with it on my side; sending through discord https://discord.gg/tDUPdRj4BM is probably easiest.

— Reply to this email directly, view it on GitHub https://github.com/Lightning-Universe/Pose-app/issues/98#issuecomment-2239202483, or unsubscribe https://github.com/notifications/unsubscribe-auth/A4CCJKCV72D64VXQAJ4FTW3ZNEJBXAVCNFSM6AAAAABK7JVIQSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMZZGIYDENBYGM . You are receiving this because you were mentioned.Message ID: @.***>

-- He/His Undergraduate [Neuroscience & Statistics] University of Virginia

renaissance12138 commented 1 month ago

I have already sent that in the discord question.

On Fri, Jul 19, 2024 at 2:54 PM Yanbin Xu @.***> wrote:

Yeah, I can do that.

On Fri, Jul 19, 2024 at 9:37 AM Matt Whiteway @.***> wrote:

Can you try extracting 20 instead of 40 frames and see if that works? Also, if you don't have a problem sending me the video I can play around with it on my side; sending through discord https://discord.gg/tDUPdRj4BM is probably easiest.

— Reply to this email directly, view it on GitHub https://github.com/Lightning-Universe/Pose-app/issues/98#issuecomment-2239202483, or unsubscribe https://github.com/notifications/unsubscribe-auth/A4CCJKCV72D64VXQAJ4FTW3ZNEJBXAVCNFSM6AAAAABK7JVIQSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMZZGIYDENBYGM . You are receiving this because you were mentioned.Message ID: @.***>

-- He/His Undergraduate [Neuroscience & Statistics] University of Virginia

-- He/His Undergraduate [Neuroscience & Statistics] University of Virginia

themattinthehatt commented 1 month ago

@renaissance12138 thanks for sending the video - one issue is that the video is 41 frames long, and we don't allow you to label the final two frames so that they can be reserved as context frames - so the max you could possibly label from this video is 39 frames. There was another patch I needed to make as well, so if you run git pull from inside of your Pose-app directory you'll get the new updates.

There's a lot of redundancy in the frames so I'd recommend labeling 20 frames from 2 such videos (either different trials or different animals) rather than labeling 40 frames from a single video.