Introduce a way to perform variants of tests in Datalog fact tests in Raksha.

markww commented 3 years ago

There are a few different places where we would like to run different variants of tests in Raksha:

The arcs manifest tests we inherited from the Arcs repo, which @bgogul pointed out have a lot of duplicated code.
The arcs_fact_tests, in which we may want to run the same dataflow structure with different authorization logic fact variants.

This issue tracks coming up with a non-hacky way to handle these cases. If we end up needing different tools for these different cases, this issue may be split up.

bgogul commented 3 years ago

Isn't this related or duplicate of #64?

markww commented 3 years ago

Thank you for pointing that one out; I thought we had an issue about this already but I didn't see it when I looked. This is related to #64 for sure. I was prompted to create this issue because I wanted to introduce variants in fact tests, whereas that talks of manifest tests. I'm going to alter this bug to make it scoped only for fact tests and let #64 track manifest tests.

google-research / raksha

Introduce a way to perform variants of tests in Datalog fact tests in Raksha. #146