cloud-platform-insights / autologger

📠 friction log bot
Apache License 2.0
0 stars 0 forks source link

Streamline repeat executions #12

Closed davidstanke closed 16 hours ago

davidstanke commented 2 weeks ago

The main autologger process involves three steps:

  1. split input into chunks
  2. upload to GCS
  3. process with gemini

If the process fails in step 3, subsequent executions need to re-do steps 1 and 2, which can be slow.

I propose the following:

...this will make it faster to re-process a source video (maybe because step 3 didn't work, or maybe because they want to try a different model, or maybe who knows why)

*let's assume for now that if step 1 worked, so did step 2; but we should revisit that

davidstanke commented 2 weeks ago

Hey @askmeegs WDYT? If you're in favor, I can work on this.

davidstanke commented 20 hours ago

Update: I split the "multi-execution" idea (this issue) apart from "multi-file" idea (which is here: #15)