Multithreaded option for the benchmarking tool on linear codes

1861b8a9-77f0-4f35-8431-8514a75b40d1 commented 8 years ago

This ticket adds support for parallel computation for benchmarks object on linear codes (introduced in #20526)

Depends on #20684

CC: @johanrosenkilde @ClementPernet

Component: coding theory

Branch/Commit: u/dlucas/multithreaded_benchmarks @ e6acad4

Issue created by migration from https://trac.sagemath.org/ticket/20786

1861b8a9-77f0-4f35-8431-8514a75b40d1 commented 8 years ago

Branch: u/dlucas/multithreaded_benchmarks

1861b8a9-77f0-4f35-8431-8514a75b40d1 commented 8 years ago

Commit: b419d91

1861b8a9-77f0-4f35-8431-8514a75b40d1 commented 8 years ago

comment:2

I pushed a first version of my patch.

Known issues & remarks:

Verbosity option is completely broken
Scheduling in task_master method can be improved
Code duplication (_perform_experiments_for_single_id and _perform_parallel_experiments_for_single_id.
Some names can probably be improved.

I'm leaving this in new state for now.

Last 10 new commits:

`bc29f26`	`Refined experimental_data method, which now allows request for specific data`
`a82a477`	`Fixed syntax errors in documentation`
`0ab93ec`	`Changes and fixes to docstrings and doctests`
`d2d6e26`	`Improved data selection in experimental_data method`
`8e363dd`	`Switched definition of decoding error and decoding failure`
`fe0b956`	`Merge branch 't/20601/20601_experimental' into benchmarking_tool`
`272d251`	`Update to 7.3b1`
`20523d0`	`Added a stop and start mechanism for benchmarks`
`c2a7980`	`Merge branch 'stop_and_restart_feature_for_benchmarking' into multithreaded_benchmarks`
`b419d91`	`First version: working support for parallel computation`

7ed8c4ca-6d56-4ae9-953a-41e42b4ed313 commented 8 years ago

Branch pushed to git repo; I updated commit sha1. New commits:

`471f8e6`	`Changed the behaviour of verbosity option if parallel is active`
`8f71eeb`	`chunk_size is now number_of_chunks: this parameter now represents the number of tasks a run for a given benchmark will be splitted into`
`e8340b6`	`Rewrote task_master method to support dynamic chunk size`

7ed8c4ca-6d56-4ae9-953a-41e42b4ed313 commented 8 years ago

Changed commit from b419d91 to e8340b6

7ed8c4ca-6d56-4ae9-953a-41e42b4ed313 commented 8 years ago

Branch pushed to git repo; I updated commit sha1. New commits:

`0984627`	`Fixed a bug which prevented all experiments to be run when using parallel option`
`a7bf30d`	`Implemented dynamic setting of chunk_size`

7ed8c4ca-6d56-4ae9-953a-41e42b4ed313 commented 8 years ago

Changed commit from e8340b6 to a7bf30d

7ed8c4ca-6d56-4ae9-953a-41e42b4ed313 commented 8 years ago

Branch pushed to git repo; I updated commit sha1. New commits:

9d2b717 New strategy: each task is now sized such that it takes a fixed, predetermined amount of time

7ed8c4ca-6d56-4ae9-953a-41e42b4ed313 commented 8 years ago

Changed commit from a7bf30d to 9d2b717

7ed8c4ca-6d56-4ae9-953a-41e42b4ed313 commented 8 years ago

Changed commit from 9d2b717 to 69f74dc

7ed8c4ca-6d56-4ae9-953a-41e42b4ed313 commented 8 years ago

Branch pushed to git repo; I updated commit sha1. New commits:

`1dac338`	`Tweaked the previous strategy so it now considers the (very slow) first run of each task to size the aforementioned tasks`
`1036ee1`	`Fixed stop and restart behaviour with parallel option`
`69f74dc`	`Added documentation and some comments`

7ed8c4ca-6d56-4ae9-953a-41e42b4ed313 commented 8 years ago

Branch pushed to git repo; I updated commit sha1. New commits:

e6acad4 Fixed speed issue

7ed8c4ca-6d56-4ae9-953a-41e42b4ed313 commented 8 years ago

Changed commit from 69f74dc to e6acad4

johanrosenkilde commented 8 years ago

comment:8

This will probably be superseded by the BleacherMark project.

sagemath / sage

Multithreaded option for the benchmarking tool on linear codes #20786