make this a widget: source file, start/stop, seek

[ShootingStarDragon]

old title: make sure I deal with: video EOS

SURE FIRE, SUREFIRE

• [x] Start
• [x] Update (seek/play/ fast forward buttons) #209
• [x] Reset #272
• [x] Exit
  • [x] look at #269 for when to exit
• [x] First test: is it possible?
• [x] incrementally test while you code
• [x] Reliability/redundancy test
• [x] Edge case test =-=-=-=-=-=-==-=-=-=-=-=-==-=-=-=-=-=-==-=-=-=-=-=-==-=-=-=-=-=-==-=-=-=-=-=-= rewriting this became insanely complicated, time to make issues so I don't forget to do things and begrudgingly move all my notes here now

issues for later:

• [x] what is a widget lifecycle?
  • [x] steps to code custom widget:
    • [x] Make class
      • [x] import ur base widget... (problem with mp)
    • [x] Add to kv
    • [x] load kv and return it
  • [x] problems:
    • [x] doesnt even work
      • [x] im trying to overload the class
        • [x] there is a class for the widget
          • [x] should only be loaded in the subprocess btw
        • [x] im also using the class to hold the kv string to load
      • [x] AttributeError: 'NoneType' object has no attribute 'FCVAWidget_string'
    • [x] doing it normally fucks with multiprocessing... (loading too much)
    • [x] my approach"" > you modify the kv string...
      • [x] make a kv file > add to spec file > leave it in the temp dir (dont let user see it)
      • [x] I HAVE TO HANDLE RUNNING KIVY AS SUBPROCESS ANYWAYS (ATM)
    • [x] regular approach"" > you drop in the widget... <--- WHAT I WANT TO MOVE TO AS A FRAMEWORK.....
      • [x] NEED:
        • [x] play nice with multiprocessing
          • [x] define custom class in kivy subprocess
          • [x] WHAT DID I DO?
            • [x] I treated the if/except block in the target function mentally as a separate file that gets run in the subprocess code
            • [x] I then imported from kivy.uix.boxlayout import BoxLayout, added the : rule to the kv string and initialized using
• [x] PLAN:
  • [x] get FCVAWidget abstracted and running first
  • [x] PROBLEMS:
    • [x] EXPOSING WIDGET:
      • [x] place it in the actual FCVA class and use this trick for subprocessing
        • [x] you CAN target class method using multiprocessing process
          • [x] https://stackoverflow.com/questions/45311398/python-multiprocessing-class-methods
      • [x] since i run it in hidden code, I can't expose the FCVAWidget class.... unless.....
        • [x] make the thing into a class with 2 parts:
          • [x] running FCVA kivy app (in my example this will run first then call FCVA widget)
          • [x] running FCVA widget (split it off in the class)
            • [x] MULTIPROCESSING ISSUES....
          • [x] later(init subprocesses)
      • [x] WIDGET AND SUBPROCESS COMMS (same as IDS FUCKERY):
        • [x] how does kivy and subprocesses communicate > you don't, only the widget needs to know anyways
      • [x] IDS FUCKERY:
        • [x] solution: just call self lmao... in the the KV lang you define stuff like this and iirc all the ids are available through self: i.e., self of FCVAWidget class gets u id StartScreenButtonID (CONFIRMED)

<FCVAWidget>:
    orientation: 'vertical'
    id: FCVAWidgetID
    Image:
        id: image_textureID
    Slider:
        id: vidsliderID
        min: 0
        max: 1111111 #should be 30*total_seconds
        step: 1
        value_track: True
        value_track_color: 1, 0, 0, 1
        size_hint: (1, 0.1)
        orientation: 'horizontal'
    BoxLayout:
        id: subBoxLayoutID1
        orientation: 'horizontal'
        size_hint: (1, 0.1)
        Button:
            id: StartScreenButtonID
            text: "Play"
            on_release: FCVAWidgetID.toggleCV()
        Label:
            text: str(vidsliderID.value) #convert slider label to a time

• [x] MANY PROBLEMS:
  • [x] getting things by ID (as per recycleview, just do everything class wise, self.id chain can do the trick)
    • [x] https://kivy.org/doc/stable/api-kivy.uix.recycleview.html
    • [x] 'FCVAWidget' object has no attribute 'shared_globalindex_dictVAR'
    • [x] problem:
      • [x] I want a drop in widget
      • [x] this shared dictionary is NOT untangled from my code... what do I do???
      • [x] Get FCVA widget to init the code instead and store all the shared dicts on THAT widget specifically
      • [x] plan: move initdatalist to being init from the fcvawidgetinit func. this isn't a problem since you only need to call init once to add to kv and define the class/start the subprocesses. After that, all u have to do is to use the widget as so, the subprocessing code isn't run in an init either so u can run the widget as much as u want
      • [x] PROBLEMA AGAIN:
        • [x] class exists BUT IS NOT INSTANTIATED... WTFFFFFFF (that's ok? we'll force the instantiation from the class somehow, just but another def and MAKE SURE TO CALL IT ONCE AND ONLY UNDER AN IF NAME IS MAIN WITH FREEZE SUBPROCESS GUARD CODE)
        • [x] NEED TO ALSO UNTANGLE DICTIONARIES LIKE METADATA DICT....
• [x] WHAT AM I DOING
  • [x] RESET
  • [x] 1: male sure it works by uncommenting init code in open kivy
    • [x] works (subprocess run and stuff, it's just the shared dicts that are an issue since kivy subprocess is being untangled)
  • [x] 2: decouple shareddicts between kivy and cc subprocess
    • [x] 2a: delete all the duplicate code, everything is hard to read....
    • [x] remove:
      • [x] shared_analysis_dict
      • [x] shared_metadata_dict
        • [x] "mp_ready"
        • [x] "kivy_run_state"
        • [x] stuff u can just straight supply to open kivy instance:
          • [x] "title"
          • [x] "colorfmt"
          • [x] "kvstring"
        • [x] "toggleCV"
      • [x] shared_globalindex_dict
        • [x] shared_globalindex_dictVAR["subprocess" + str(pid)]
        • [x] "starttime"
        • [x] "curframe"
        • [x] "pausedtime" (not really used tho)
  • [x] 3a:
    • [x] #269
  • [x] 3: need to rewrite relevant functions:
    • [x] toggleCV #266
    • [x] open_cvpipelin #265
    • [x] blit from shared mem #268
    • [x] update the block that holds kivy everything open #267
  • [x] 4: THEN u detatch it to fcva widget
  • [x] Create func called init cv subprocesses once that makes sure repeat calls dont fuck u
  • [x] Run cv subprocesses
  • [x] decouple reliance on shared dicts between kivy and fcva widget
  • [x] =-=-=-=-=-==-=-=-=-=-==-=-=-=-=-==-=-=-=-=-==-=-=-=-=-==-=-=-=-=-=
  • [x] too many things that are nested...
  • [x] first I was moving code to fcvawidget init func
    • [x] PROBLEM WAS I COULDNT PICKLE THE FCVA MODULE TO PASS TO KIVY SUBPROCESS RIP
      • [x] SOLVE THIS FIRST LMAO
        • [x] https://stackoverflow.com/questions/2790828/python-cant-pickle-module-objects-error
        • [x] solved as per #263
  • [x] then now I need to move the shared dicts as well...
  • [x] metadatadict:
    • [x] (unnecessary now imo)
      • [x] kivy run state
      • [x] title, colorfmt, kvstring (can just raw supply it, u dont need it in a shared dict just give it to the kivy subprocess func def)
  • [x] shared anlysis dict <-- DELETE THIS, unused
  • [x] shared globalindex dict <-- delete this and replace with a local shareddict created from subprocess init
    • [x] 2: FCVAWidget needs to call blit_from_shared_memory
      • [x] required func calls:
        • [x] toggleCV
          • [x] just fix it and follow through....
        • [x] on_start
        • [x] blit_from_shared_memory
        • [x] populate_texture (in the future...) already in #36
        • [x] etc...
      • [x] but now tf is this possible without having the kivy instance....
      • [x] JUST GIVE IT THE INSTANCE DUMBASS....
      • [x] NEED TO FIX THIS (getting things by id...)
      • [x] App.get_running_app().root.get_screen("start_screen_name").ids['FCVAWidget_id'].ids["image_textureID"]
      • [x] https://stackoverflow.com/a/67570163
      • [x] most likely can use self.id chain....
    • [x] #271
      • [x] make ppl inherit from FCVApp (all it does is have the subprocess exit commands...)
  • [x] figure out how to give access to ppl > moved to #261
    • [x] most likely I will need to make it a class and then expose it for ppl to import and use
      • [x] class will do the if name == fcva trick
      • [x] then import the required stuff
      • [x] HERE I should init the subprocesses... (when to exit tho???)
      • [x] then provide the kv code so u can just append it to ur kv
      • [x] what YOU neeed to do is just use FCVAWidget: in ur kv
    • [x] MEANS:
      • [x] be able to change the kv string
      • [x] drop it in to kivy main subprocess
• [x] ADD CONDENSED NOTES TO GITHUB (retitle one issue and place on top/1st comment)
• [x] STILL NEED THE INNER WIDGET EVEN IN THIS CASE: since u want ppl to modify the kv string/file I still need to play nice
  • [x] name of name so if name is main works (currently is if name FCVA, which I think is ok)
  • [x] NOT RELEVANT because if name FCVA will always run since it's a module...
  • [x] kivy will be main process (kinda bad?)
  • [x] run the subprocess shit on init
  • [x] multiprocessing will be hell because it doesn't know what name to check for, etc....
  • [x] create the widget that has the boxlayout of texture, slider, etc....
  • [x] could also make open_kivy func part of a class.... (because oop needs fucking classes to pass references...)
• [x] How to widget?
  • [x] steps to use:
    • [x] init class and load to builder
    • [x] then init the kvstring of app
    • [x] then hope it works
  • [x] write an init function
    • [x] If subprocess not exist>make
    • [x] pass to kivy somehow (nope, widget should know...)
    • [x] How to reset? #272
    • [x] How to seek? #209
    • [x] remember to get cv maxframes... #208
    • [x] seekdelay should be 0.02*number of skipped frames+3 sec #209 as well

=-=-=-=-=-=-==-=-=-=-=-=-==-=-=-=-=-=-==-=-=-=-=-=-==-=-=-=-=-=-==-=-=-=-=-=-=

• [x] START (works) > moved to #275
  • [x] make a start function that: takes any file as input, and starts at a specified time, that way resume will work
  • [x] init:
    • [x] spin up subprocess if they aren't already started > easier thanks to #204
    • [x] set up shared dicts
  • [x] continue:
    • [x] 1 sec buffer to read to the right spot
    • [x] play
  • [x] LATER: take a file-like as input
• [x] STOP/PAUSE button (at any point in the video) moved to #274
  • [x] know time paused
  • [x] pause subprocesses
  • [x] add paused time to starttime
  • [x] resume
  • [x] resume needs to delay a bit because it needs to read up to that point...:
  • [x] 522 [330, 331, 332, 333, 334, 335, 336, 337, 338, 339] [340, 341, 342, 343, 344, 345, 346, 347, 348, 349] [350, 351, 352, 353, 354, 355, 356, 357, 358, 359]
• [x] update the seek slider > issue is #209
  • [x] add some sanity checks so everybody is at the same frame, etc
• [x] SEEK > also #209
  • [x] #this needs to be updated with seek... (this is in toggleCV)
• [x] https://stackoverflow.com/questions/33650974/opencv-python-read-specific-frame-using-videocapture
• [x] https://stackoverflow.com/questions/2974625/opencv-seek-function-rewind
• [x] set another source file #272
• [x] DON'T FORGET (from #269): > #271 more relevant
  • [x] HOW TO TURN OFF SUBPROCESS:
  • [x] 3xample:

    for subprocessVAR in subprocess_list:
    subprocessVAR.join()

[ShootingStarDragon]

• [x] 2 issues:
• [x] trying to keep up with initial values of -1 (it's erroring)
• [x] what to do when numpy goes to nonetype? (EOS) (pause subprocesses, blit will be on but keep last frame)
• [x] How to deal with EOS?
  • [x] it needs to know when to stop...
  • [x] what does stopping look like -> when all subprocesses have paused
• [x] pause could be a variable in metadata dict where I set it and then code just passes
• [x] first I need to know how to RESET the thing...

[ShootingStarDragon]

• [x] EOS/Nonetype
• [x] flag in metadata that says EOS -> stop/pause subprocess (might be too early, maybe stop when entire queue is Nonetype), blit buffer kinda stops, but make it actually stop
• [x] 2 things:
• [x] pause subprocess
  • [x]
• [x] pause blitfromsharedmem
• [x] RESETTING:
  • [x] if "starttime" in shared_globalindexVAR

[ShootingStarDragon]

• [x] FEAR OF USING SHARED METADATA DICT TOO MUCH: too many processes lock up the memory too much....

[ShootingStarDragon]

• [x] Eos> pause blit buffer (skip, let blit go since no way of getting EOS properly)
• [x] use python ffmpeg or ???. tbh can just leave it alone
• [x] another problem: at the last second, subprocesses stop and don't commit the last frames...

[ShootingStarDragon]

• [x] START (works)
  • [ ] make a start function that: takes any file as input, and starts at a specified time, that was resume will work
  • [ ] init:
    • [ ] spin up subprocess if they aren't already started > easier thanks to #204
    • [ ] set up shared dicts
  • [ ] continue:
    • [ ] 1 sec buffer to read to the right spot
    • [ ] play
  • [ ] LATER: take a file-like as input
• [ ] STOP/PAUSE button (at any point in the video)
  • [x] know time paused
  • [ ] pause subprocesses
  • [ ] add paused time to starttime
  • [ ] resume
  • [ ] resume needs to delay a bit because it needs to read up to that point...:
  • [ ] 522 [330, 331, 332, 333, 334, 335, 336, 337, 338, 339] [340, 341, 342, 343, 344, 345, 346, 347, 348, 349] [350, 351, 352, 353, 354, 355, 356, 357, 358, 359]
• [ ] update the seek slider
  • [ ] add some sanity checks so everybody is at the same frame, etc
• [ ] SEEK
• [ ] https://stackoverflow.com/questions/33650974/opencv-python-read-specific-frame-using-videocapture
• [ ] https://stackoverflow.com/questions/2974625/opencv-seek-function-rewind
• [ ] set another source file
• [ ] (moved this to top comment so I can see number of tasks)

[ShootingStarDragon]

legitimate hell trying to pass list arguments correctly since I want to make it so modular....

[ShootingStarDragon]

problem is at the end the widget isn't really instantiated/ i don't know how kivy instantiates it so i'm not sure how to pass the args....

this sucks, this is my comfortable nested depth (~4-5 but if I try REALLY hard I can go 6-7, freaking geniuses can do like nesting of 14 from my observations). it also could be because my strategy is flawed and requires too much nesting, but let's be real, im trying to do a drop in widget that does multiprocessing that you can just append to kivy, that's not really an easy task imo...

[ShootingStarDragon]

rewriting this became insanely complicated, time to make issues so I don't forget to do things and begrudgingly move all my notes here now

issues for later:

• [ ] what is a widget lifecycle?
  • [x] steps to code custom widget:
    • [x] Make class
      • [x] import ur base widget... (problem with mp)
    • [x] Add to kv
    • [x] load kv and return it
  • [x] problems:
    • [x] doesnt even work
      • [x] im trying to overload the class
        • [x] there is a class for the widget
          • [x] should only be loaded in the subprocess btw
        • [x] im also using the class to hold the kv string to load
      • [x] AttributeError: 'NoneType' object has no attribute 'FCVAWidget_string'
    • [x] doing it normally fucks with multiprocessing... (loading too much)
    • [x] my approach"" > you modify the kv string...
      • [x] make a kv file > add to spec file > leave it in the temp dir (dont let user see it)
      • [x] I HAVE TO HANDLE RUNNING KIVY AS SUBPROCESS ANYWAYS (ATM)
    • [ ] regular approach"" > you drop in the widget... <--- WHAT I WANT TO MOVE TO AS A FRAMEWORK.....
      • [ ] NEED:
        • [ ] play nice with multiprocessing
          • [ ] define custom class in kivy subprocess
          • [ ] WHAT DID I DO?
            • [ ] I treated the if/except block in the target function mentally as a separate file that gets run in the subprocess code
            • [ ] I then imported from kivy.uix.boxlayout import BoxLayout, added the : rule to the kv string and initialized using
• [ ] PLAN:
  • [x] get FCVAWidget abstracted and running first
  • [ ] PROBLEMS:
    • [ ] EXPOSING WIDGET:
      • [x] place it in the actual FCVA class and use this trick for subprocessing
        • [x] you CAN target class method using multiprocessing process
          • [x] https://stackoverflow.com/questions/45311398/python-multiprocessing-class-methods
      • [x] since i run it in hidden code, I can't expose the FCVAWidget class.... unless.....
        • [x] make the thing into a class with 2 parts:
          • [x] running FCVA kivy app (in my example this will run first then call FCVA widget)
          • [x] running FCVA widget (split it off in the class)
            • [x] MULTIPROCESSING ISSUES....
          • [x] later(init subprocesses)
      • [x] WIDGET AND SUBPROCESS COMMS (same as IDS FUCKERY):
        • [x] how does kivy and subprocesses communicate > you don't, only the widget needs to know anyways
      • [ ] IDS FUCKERY:
        • [ ] MANY PROBLEMS:
          • [ ] getting things by ID (as per recycleview, just do everything class wise, self.id chain can do the trick)
            • [ ] https://kivy.org/doc/stable/api-kivy.uix.recycleview.html
            • [ ] 'FCVAWidget' object has no attribute 'shared_globalindex_dictVAR'
            • [ ] problem:
              • [ ] I want a drop in widget
              • [ ] this shared dictionary is NOT untangled from my code... what do I do???
              • [ ] Get FCVA widget to init the code instead and store all the shared dicts on THAT widget specifically
              • [ ] plan: move initdatalist to being init from the fcvawidgetinit func. this isn't a problem since you only need to call init once to add to kv and define the class/start the subprocesses. After that, all u have to do is to use the widget as so, the subprocessing code isn't run in an init either so u can run the widget as much as u want
              • [ ] PROBLEMA AGAIN:
                • [ ] class exists BUT IS NOT INSTANTIATED... WTFFFFFFF (that's ok? we'll force the instantiation from the class somehow, just but another def and MAKE SURE TO CALL IT ONCE AND ONLY UNDER AN IF NAME IS MAIN WITH FREEZE SUBPROCESS GUARD CODE)
                • [ ] NEED TO ALSO UNTANGLE DICTIONARIES LIKE METADATA DICT....
• [ ] WHAT AM I DOING
  • [ ] RESET
  • [x] 1: male sure it works by uncommenting init code in open kivy
    • [x] works (subprocess run and stuff, it's just the shared dicts that are an issue since kivy subprocess is being untangled)
  • [ ] 2: decouple shareddicts between kivy and cc subprocess
    • [x] 2a: delete all the duplicate code, everything is hard to read....
    • [ ] remove:
      • [x] shared_analysis_dict
      • [x] shared_metadata_dict
        • [x] "mp_ready"
        • [x] "kivy_run_state"
        • [x] stuff u can just straight supply to open kivy instance:
          • [x] "title"
          • [x] "colorfmt"
          • [x] "kvstring"
        • [x] "toggleCV"
      • [x] shared_globalindex_dict
        • [x] shared_globalindex_dictVAR["subprocess" + str(pid)]
        • [x] "starttime"
        • [x] "curframe"
        • [x] "pausedtime" (not really used tho)
  • [ ] 3: THEN u detatch it to fcva widget
  • [ ]
  • [ ] Create func called init cv subprocesses once that makes sure repeat calls dont fuck u
  • [ ]
  • [ ] Run cv subprocesses
  • [ ] decouple reliance on shared dicts between kivy and fcva widget
  • [ ] =-=-=-=-=-==-=-=-=-=-==-=-=-=-=-==-=-=-=-=-==-=-=-=-=-==-=-=-=-=-=
  • [ ] too many things that are nested...
  • [ ] first I was moving code to fcvawidget init func
    • [ ] PROBLEM WAS I COULDNT PICKLE THE FCVA MODULE TO PASS TO KIVY SUBPROCESS RIP
      • [ ] SOLVE THIS FIRST LMAO
        • [ ] https://stackoverflow.com/questions/2790828/python-cant-pickle-module-objects-error
  • [ ] then now I need to move the shared dicts as well...
  • [ ] metadatadict:
    • [ ] (unnecessary now imo)
      • [ ] kivy run state
      • [ ] title, colorfmt, kvstring (can just raw supply it, u dont need it in a shared dict just give it to the kivy subprocess func def)
  • [ ] shared anlysis dict <-- DELETE THIS, unused
  • [ ] shared globalindex dict <-- delete this and replace with a local shareddict created from subprocess init
    • [ ] 2: FCVAWidget needs to call blit_from_shared_memory
      • [ ] required func calls:
        • [ ] toggleCV
          • [ ] just fix it and follow through....
        • [ ] on_start
        • [ ] blit_from_shared_memory
        • [ ] populate_texture (in the future...)
        • [ ] etc...
      • [ ] but now tf is this possible without having the kivy instance....
      • [ ] JUST GIVE IT THE INSTANCE DUMBASS....
      • [ ] NEED TO FIX THIS (getting things by id...)
      • [ ] App.get_running_app().root.get_screen("start_screen_name").ids['FCVAWidget_id'].ids["image_textureID"]
      • [ ] https://stackoverflow.com/a/67570163
      • [ ] most likely can use self.id chain....
    • [ ] Who is going to call close?
      • [ ] make ppl inherit from FCVApp (all it does is have the subprocess exit commands...)
  • [ ] figure out how to give access to ppl
    • [ ] most likely I will need to make it a class and then expose it for ppl to import and use
      • [ ] class will do the if name == fcva trick
      • [ ] then import the required stuff
      • [ ] HERE I should init the subprocesses... (when to exit tho???)
      • [ ] then provide the kv code so u can just append it to ur kv
      • [ ] what YOU neeed to do is just use FCVAWidget: in ur kv
    • [ ] MEANS:
      • [ ] be able to change the kv string
      • [ ] drop it in to kivy main subprocess
• [ ] ADD CONDENSED NOTES TO GITHUB (retitle one issue and place on top/1st comment)
• [ ] STILL NEED THE INNER WIDGET EVEN IN THIS CASE: since u want ppl to modify the kv string/file I still need to play nice
  • [x] name of name so if name is main works (currently is if name FCVA, which I think is ok)
  • [x] NOT RELEVANT because if name FCVA will always run since it's a module...
  • [x] kivy will be main process (kinda bad?)
  • [x] run the subprocess shit on init
  • [x] multiprocessing will be hell because it doesn't know what name to check for, etc....
  • [x] create the widget that has the boxlayout of texture, slider, etc....
  • [x] could also make open_kivy func part of a class.... (because oop needs fucking classes to pass references...)
  • [ ]
  • [ ]
• [ ]
• [ ] How to widget?
  • [ ] steps to use:
    • [ ] init class and load to builder
    • [ ] then init the kvstring of app
    • [ ] then hope it works
  • [ ] write an init function
    • [ ] If subprocess not exist>make
    • [ ] pass to kivy somehow (nope, widget should know...)
    • [ ] How to reset and seek?
    • [ ] remember to get cv maxframes...
    • [ ] seekdelay should be 0.02*number of skipped frames+3 sec MOVED THIS TO TOP COMMENT SO I CAN SEE NUMBER OF TASKS