cache errors + progress regression - is this typical behavior?

[N72826]

I am consistently receiving the cache error errors that are mentioned in #148 & #150 every time I run ab-av1 auto-encode

These are the parameters I'm using: ab-av1 auto-encode -e av1_qsv --input ""

I have the latest version of ab-av1 and ffmpeg version 6.0-full_build

I tried deleting these cache folders because it was suggested in a reply to #148

looks like the sample-encode cache has become corrupted. I think the warning output isn't playing nicely with the progress bar.

You can "fix" by deleting the cache usually in .cache/ab-av1.

Additionally, I am running into this strange regression behavior with the ETA. You can see below at 00:12:40 into the search, the progress reverts back to before the progress at 00:12:02

Not sure if this is expected behavior because it's an ETA which is susceptible to change, but just thought I would mention it.

Encoding "2019-12-06 22-52-40-13_MERGED.av1_qsv.mp4"
⠐ Searching 00:00:02 ------------------------------------------------------------------------------------- (sampling crf 32, eta 0s)
cache error: Read corrupted data at file offset None backtrace ()
⠤ Searching 00:00:40 #####------------------------------------------------------------------------------- (sampling crf 32, eta 21m)
cache error: Read corrupted data at file offset None backtrace ()
⠠ Searching 00:01:18 #########--------------------------------------------------------------------------- (sampling crf 32, eta 20m)
cache error: Read corrupted data at file offset None backtrace ()
⠁ Searching 00:01:54 #############----------------------------------------------------------------------- (sampling crf 32, eta 18m)
cache error: Read corrupted data at file offset None backtrace ()
⠁ Searching 00:02:30 #################------------------------------------------------------------------- (sampling crf 32, eta 17m)
cache error: Read corrupted data at file offset None backtrace ()
⠁ Searching 00:03:08 ######################-------------------------------------------------------------- (sampling crf 21, eta 17m)
cache error: Read corrupted data at file offset None backtrace ()
⠓ Searching 00:03:47 ##########################---------------------------------------------------------- (sampling crf 21, eta 17m)
cache error: Read corrupted data at file offset None backtrace ()
⠈ Searching 00:04:27 ##############################------------------------------------------------------ (sampling crf 21, eta 15m)
cache error: Read corrupted data at file offset None backtrace ()
⠉ Searching 00:05:03 ##################################-------------------------------------------------- (sampling crf 21, eta 13m)
cache error: Read corrupted data at file offset None backtrace ()
⠚ Searching 00:05:40 ######################################---------------------------------------------- (sampling crf 21, eta 12m)
cache error: Read corrupted data at file offset None backtrace ()
⠈ Searching 00:06:20 ###########################################----------------------------------------- (sampling crf 23, eta 12m)
cache error: Read corrupted data at file offset None backtrace ()
⠦ Searching 00:06:58 ###############################################------------------------------------- (sampling crf 23, eta 10m)
cache error: Read corrupted data at file offset None backtrace ()
⠋ Searching 00:07:38 ####################################################--------------------------------- (sampling crf 23, eta 9m)
cache error: Read corrupted data at file offset None backtrace ()
⠒ Searching 00:08:15 ########################################################----------------------------- (sampling crf 23, eta 8m)
cache error: Read corrupted data at file offset None backtrace ()
⠄ Searching 00:08:52 ############################################################------------------------- (sampling crf 23, eta 6m)
cache error: Read corrupted data at file offset None backtrace ()
⠁ Searching 00:09:31 ################################################################--------------------- (sampling crf 24, eta 6m)
cache error: Read corrupted data at file offset None backtrace ()
⠖ Searching 00:10:10 #####################################################################---------------- (sampling crf 24, eta 5m)
cache error: Read corrupted data at file offset None backtrace ()
⠒ Searching 00:10:48 #########################################################################------------ (sampling crf 24, eta 3m)
cache error: Read corrupted data at file offset None backtrace ()
⠈ Searching 00:11:25 #############################################################################-------- (sampling crf 24, eta 2m)
cache error: Read corrupted data at file offset None backtrace ()
⠉ Searching 00:12:02 ################################################################################---- (sampling crf 24, eta 63s)
cache error: Read corrupted data at file offset None backtrace ()
⠓ Searching 00:12:40 #####################################################################---------------- (sampling crf 25, eta 0s)
cache error: Read corrupted data at file offset None backtrace ()
⠋ Searching 00:13:19 ########################################################################------------- (sampling crf 25, eta 4m)
cache error: Read corrupted data at file offset None backtrace ()
⠈ Searching 00:13:58 ###########################################################################---------- (sampling crf 25, eta 3m)
cache error: Read corrupted data at file offset None backtrace ()
⠒ Searching 00:14:08 ############################################################################-------- (sampling crf 25, eta 76s)```

[alexheretic]

The .ab-av1-xxxxxxx dirs are where the sample-encoding takes place. It's a different sort of cache. They should also be removed automatically, unless you use --keep or the process is killed in a certain way that prevents cleanup.

The sample-encode cached results are stored in, e.g. ~/.cache/ab-av1. That's the one you are seeing a cache error for. Deleting that dir will fix the error. As you mentioned #150 details the planned improvements.

[N72826]

ah wow that makes much more sense. I manually killed it when I was testing my bat script. thank you for the quick reply and thank you for the work you put into this. I really appreciate it.

I'm on windows not linux so I found it in appdata/local/ab-av1