Open PeterCodar opened 2 months ago
i have the same issues when i use -i.gpu true, and when this error vdx appear i have to start from the beginning, gpu the options is bugged a lot, for normal mode you can speed up the process a little, use link to the local folder "mklink" and use -i.links true anyway i think this project is abandoned sad. its my command .\cbird.exe -p.alg video -p.types v -p.eg 1 -i.algos 16 -p.vtrim 3700 -i.links true -p.vfm 200 -p.dht 3 -use Y:\lotsdupes -similar -show
the _index folder is on disc c:\ (ssd)
Thanks for the feedback. Unfortunately video search needs to decode all video frames, it is the most reliable method I know of. Probably something to use remote indexers so multiple machines can get involved would be good. At the moment you would have to divide up your files into clusters you want to manage separately and index each one on a different machine.
-i.gpu 1
enables gpu decoding for NVidia only, -i.gputhr 2
says to use at most 2 parallel gpu decoders, using more is usually needed to saturate the gpu codecs, but it depends on the video dimensions/codec.-i.idxthr
so you can reduce the cpu load that way.ffplay.exe -codecs
and look for codecs with "cuvid" in the name. It is probably not there but could be made to work.-i.decthr 1
will give one thread per decoder/job, for a total of 16 inflight jobs in your case. This should be more efficient, but you lose 16 jobs worth of work if you cancel indexing to do something else. If you run out of RAM or the network can't keep up (it probably can for 16 jobs), increase in multiples of two.-i.idxthr <n>
, the default is the cpu core countThank you for helpful answer!
Just a short comment:
There is no ffplay.exe
included in the cbird-windows-0.7.0-x86_64.zip
What about my question "how to create the database and index files locally"?
For windows users, it is a little bit difficult to get started.
I have downloaded
cbird-windows-0.7.0-x86_64.zip
and extracted it locally. Then I found this minimalistic working command linecbird -use \\192.168.1.2\share\folder\subfolder -update
Unfortunately, indexing a single video file on my NAS seems to take about 30 seconds to finish. With about 27'500 video files in different formats and sizes, this would need about 229 hours...
What can I do to speed up this indexing process?
I read something about
skip-loop-filter
but can't find the working syntax. How exactly do I useskip-loop-filter
?I read something about
gpu <bool> Enable gpu video decoding (Nvidia) [false]
but can't find the working syntax. How exactly do I use gpu? In the CMD line help there is a section "Index Parameters (for -update)" but the examples talk about-p.types
. Should that not be-i.types
andi.gpu
? Whatever I try to enable my Nvidia RTX gpu, it does not seem to work no hw codec, trying sw and does not speed up the index process:I also think that saving the database and
*.vdx
files locally on a fast internal SSD would speed up the process (instead of writing the _index folder and the files over LAN and on a "slow" NAS hard drive.) How can I tell cbird to create the database and index files locally?Do you know any other CMD line hints that would speed up the process with files over 1 Gbit/s-LAN saved on a NAS?