Liryna
commented
2 years ago Hi @adropit ,
The benchmarks were run against memfs 5 times and in a clean environment without antivirus (even with the Windows defender disabled) to actually avoid having resources taken, requests being disrupted by other components and most stable results. Mirror is totally contrary as it is under the mirrored disk activity constraint. If you add an antivirus, you will have biased results.
The Admin rights thing you are describing could be a sign of an antivirus or another app that interacts differently with the user filesystem.
You provided some benchmark results for MemFS. Were the test run with elevated rights (both memfs.exe and your benchmark program)? (Can memfs.exe be run without elevated rights?)
They were all run with admin rights but I do not expect to see a difference as memfs is not under external resource constraint and no antivirus was enabled.
Could you run the same benchmark using mirror.exe? (both with and without elevated rights) Could you provide some benchmarks (Dokany 1.x vs Dokany 2.x) using the mirror.exe putting the accent on reading/writing files sequentially/random?
As said previously, mirror is really not what should be used for benchmarks. It is really just a sample and it was never focused on perf.
Read/Write improvements were not specially improved in v2 compared in other scenarios and the results I shared are reflecting it. A real Read/Write improvement would be to implement caching. See https://github.com/dokan-dev/dokany/discussions/1047
Small remarks as I would not expect it to have any impact on your results: In your v1 benchmark you are using /t 8 which I imagine is due to the system having 8 cores. This is exactly what the v2 is fixing, using a system thread pool to use the right number of threads depending on the system it is run on. Most filesystems were just using the default 5 thread value.
adropit
vs head:
Feature request can skip this form. Bug report must complete it.
Check Listmust be 100% match or it will be automatically closed without further discussion. Please remove this line.Environment
Check List
Description
Hello, We upgraded our program from Dokany1.4.1 to Dokany2.0.0.2000 (later added a test using Dokany 2.0.1.1000). Unfortunately, instead of a performance improvement, we noticed actually a performance drop…
In some tests using your mirror.exe example run with Dokany1.4.1 vs Dokany2.0.0.2000 vs Dokany2.0.1.1000 we noticed that the administrative rights play a big role in the performance. The tests implied reading over 9000 files sequentially using the mirror.exe provided by the Dokany release. The reading of files in our test program was done using three different C/C++ methods. If both mirror.exe and our test program were run with administrator rights, the performance difference was slightly in favor of Dokany2.0.1.1000. But if both, mirror.exe and the test program (client), were run without administrative rights there was a massive performance drop when using Dokany 2.0.1.1000 if the files were read in chunks of 4KB. (See the attached document – section “DifferentRights”)
We also run a different set of tests using a Disk-Benchmark tool “ATTO”. This also shows some performance drop when using Dokany2.0.1.2000 compared to Dokany1.4.1. (See the attached document – section “Disk benchmark”). The Disk-Benchmark tool could only be run with elevated rights and we assume that without administrative rights the difference in performance drop would be bigger. The last test was done reading (different) over 9000 files with the same three C/C++ methods where both the mirror.exe and the test program (client) were run without administrative rights. There was also a performance drop between Dokany1.4.1 and Dokany2.0.1.2000 in the case of sequentially reading in chunks of 4KB. (See the attached document – section “Own benchmark”).
So here are some questions from our side: You provided some benchmark results for MemFS. Were the test run with elevated rights (both memfs.exe and your benchmark program)? (Can memfs.exe be run without elevated rights?) Could you run the same benchmark using mirror.exe? (both with and without elevated rights) Could you provide some benchmarks (Dokany 1.x vs Dokany 2.x) using the mirror.exe putting the accent on reading/writing files sequentially/random? Performance_dokany.xlsx