We have been trying to build the parallel processing of experiments in Sciunit and here are the problems that we faced.
While creating the experiments we try to launch multiple threads to create multiple executions (e1,e2,e3,....,en) to work on multiple parts of the datafile parallelly (either through multithreading or multiprocessing). However this throws out an error :
sciunit: exec: b'ERROR: database is locked\n'
We would need to make Sciunit work parallelly with the db locking. When executing multiple executions in parallel with Sciunit, it involves multiple processes simultaneously writing to the same database file. This concurrent access can lead to non-deterministic behavior and is resulting in parallel access to database issues.
We have been trying to build the parallel processing of experiments in Sciunit and here are the problems that we faced.
While creating the experiments we try to launch multiple threads to create multiple executions (e1,e2,e3,....,en) to work on multiple parts of the datafile parallelly (either through multithreading or multiprocessing). However this throws out an error :
sciunit: exec: b'ERROR: database is locked\n'
We would need to make Sciunit work parallelly with the db locking. When executing multiple executions in parallel with Sciunit, it involves multiple processes simultaneously writing to the same database file. This concurrent access can lead to non-deterministic behavior and is resulting in parallel access to database issues.