`sacredboard -F path/to/experiments/dir` displays "No matching records found" but recognizes all entries

[SumNeuron]

I see that this is experimental, but I would like to bring this to your attention.

I run sacredboard -F ./experiments and then a browser is opened which shows a table saying 612 entries (which under ./experiments/ there are sub-directories 1 - 612). but just says "No matching records found". I don't have any filters so whats going on?

[chovanecm]

Hi, would you mind sharing your folder for which Sacredboard gets into this problem? Or please just produce some dummy experiments results that cause that issue. Thank you.

[SumNeuron]

experiments/
-- 1/
-- 2/
...
-- 612/
-- + -- config.json
-- + -- metrics.json
-- + -- experiment.log
-- + -- cout.txt
-- + -- run.json

[SumNeuron]

@chovanecm is that what you meant?

[chovanecm]

I was hoping for an actual directory I could test against but never mind. Sacredboard can indeed claim there are 612 entries, but actually this number is nothing else but the number of subdirectories it has found.

I think the reason for what you are experiencing is missing info.json file in each of the directories. This issue (#103) has been fixed some time ago, but it didn't make it to the current "stable" version yet. The "official" version has some new features (e.g. browsing experiment source files) that don't work with the filestore backend yet, which was the reason why I haven't published a new version so far. Maybe I'll release it "as is" if I don't manage to implement it today.

Nevertheless, you can get the latest development version which includes the fix (please refer to README for installing it).

[SumNeuron]

@chovanecm using the dev version it displays experiments, but metric plots do not load.

e.g. in experiments/1/metrics.json

{
  "cosine": {
    "steps": [
      0,
      1,
      2,
      3,
      4
    ],
    "timestamps": [
      "2019-03-28T09:55:46.826987",
      "2019-03-28T09:55:46.849116",
      "2019-03-28T09:55:46.871558",
      "2019-03-28T09:55:46.895558",
      "2019-03-28T09:55:46.918864"
    ],
    "values": [
      0.29999999701976776,
      0.10000000596046447,
      0.2,
      0.5,
      -0.09999998807907104
    ]
  },
...
}

and sacredboard states "no metrics to show"