openforcefield / openff-benchmark

Comparison benchmarks between public force fields and Open Force Field Initiative force fields
MIT License
11 stars 2 forks source link

[WIP] Coverage Report #27

Closed jthorton closed 3 years ago

jthorton commented 3 years ago

Description

Adds a coverage report function which is exposed to the CLI preprocess group. I think this should possibly come after step 1 as we do not want to spend time making conformers for molecules that will latter fail?

The function labels each molecule and tries to generate an openmm system this way we can also check for charge failures as well as missing parameters.

The past molecules are moved to the specified output folder and a coverage report json file is made which should be easy to combine.

Todos

Notable points that this PR has either accomplished or will accomplish.

Questions

Status

j-wags commented 3 years ago

Started reviewing this today, which turned into "eh, I could just add that...", which turned into a kinda beefy commit. I really like how you did this. If tests pass I think this is good to merge in an initial form.

A few notes --

j-wags commented 3 years ago

Oh, and I mostly tested the exception/file handling. We should add a test with something like ethanol and really go through the resulting dict with a fine-toothed comb to ensure that every value is correct.