opencog / benchmark

Benchmarking the AtomSpace, the pattern matcher and other OpenCog systems
GNU Affero General Public License v3.0
6 stars 9 forks source link

Move make_benchmark_graphs.py scripts from atomspace to benchmark repo #7

Closed vsbogd closed 6 years ago

vsbogd commented 6 years ago

File make_benchmark_graphs.py is part of opencog/benchmark/atomspace/atomspace benchmarkin. Todo:

linas commented 6 years ago

Yeah, move the contents of https://github.com/opencog/atomspace/blob/master/scripts/query as well. Honestly, I didn't even know that these scripts existed, until just now. The vast, incredible power of cruft-accumulation.

vsbogd commented 6 years ago

Only two of them are related to benchmarking:

ngeiswei commented 6 years ago

I see two problems with moving them to the benchmark repo

  1. it's harder to find the build directory of the atomspace repo from the benchmark repo,
  2. unit tests performances are not intended to reflect real world performances.

So if they are being moved, to minimize these problems I suppose one could

  1. assume by default that the atomspace repo folder is beside the benchmark repo folder, that will probably work for most people,
  2. printing a big warning of its shortcomings in the corresponding README.md and/or as a message at script launch.

If that is respected I think it would be acceptable to move them to the benchmark repo.

vsbogd commented 6 years ago

@ngeiswei, I didn't mean these scripts should be literally "moved". I think more proper way is adding new benchmarks (for instance under https://github.com/opencog/benchmark/issues/8) and removing these shell scripts.

linas commented 6 years ago

this has been done, so this bug can be closed, right?

vsbogd commented 6 years ago

Yes, closing it, new tests to be added under https://github.com/opencog/benchmark/issues/8