Refactor of test_remove.py with changes from 4549

[bherrin3]

Problems

With the refactor of the docker importer's remove function to increase performance, content removal needs to be functional verified.

Solution

The cases covered with content post-count verification for all units:

1. Remove all manifest_lists sequentially.
2. Remove all manifests sequentially.
3. Remove all blobs sequentially.
4. Remove all manifest_lists batch.
5. Remove all manifests batch.
6. Remove all blobs batch.
7. Remove some non-shared manifest lists.
8. Remove some non-shared manifest.
9. Remove some shared manifests lists and verify shared units are not
   recursively removed.
10. Remove some shared manifests and verify shared units are not
    recursively removed.

Fixture Information

The fixture includes:

* 2 relatively independent manifest lists (no shared manifests,
  no shared blobs between them)
* 2 manifest lists that share some (but not all) manifests, and those
  manifest share some (but not all) blobs. This only requires the creation
  of 1 manifest list that shares some content with one of the first
  “independent manifest lists”.
* 2 relatively independent manifests
* 2 manifests that share (some but not all) blobs

In order to sync the content, each content unit must be recursively related
to at least 1 tag.

Test Run

2.20 or +

Test session starts (platform: linux, Python 3.7.3, pytest 4.1.0, pytest-sugar 0.9.2)
cachedir: .pytest_cache
rootdir: /home/herring/git/Pulp-2-Tests, inifile: pytest.ini
plugins: sugar-0.9.2
collecting ... 
 pulp_2_tests/tests/docker/api_v2/test_remove.py::RemoveV2ContentTestCase.test_01_remove_manifest_list_all_sequential ✓10% █         
 pulp_2_tests/tests/docker/api_v2/test_remove.py::RemoveV2ContentTestCase.test_02_remove_manifest_all_sequential ✓20% ██        
 pulp_2_tests/tests/docker/api_v2/test_remove.py::RemoveV2ContentTestCase.test_03_remove_blob_all_sequential ✓30% ███       
 pulp_2_tests/tests/docker/api_v2/test_remove.py::RemoveV2ContentTestCase.test_04_remove_manifest_list_all_batch ✓40% ████      
 pulp_2_tests/tests/docker/api_v2/test_remove.py::RemoveV2ContentTestCase.test_05_remove_manifest_all_batch ✓50% █████     
 pulp_2_tests/tests/docker/api_v2/test_remove.py::RemoveV2ContentTestCase.test_06_remove_blob_all_batch ✓60% ██████    
 pulp_2_tests/tests/docker/api_v2/test_remove.py::RemoveV2ContentTestCase.test_07_remove_manifest_list_not_shared ✓70% ███████   
 pulp_2_tests/tests/docker/api_v2/test_remove.py::RemoveV2ContentTestCase.test_08_remove_manifest_list_shared ✓80% ████████  
 pulp_2_tests/tests/docker/api_v2/test_remove.py::RemoveV2ContentTestCase.test_09_remove_manifest_not_shared ✓90% █████████ 
 pulp_2_tests/tests/docker/api_v2/test_remove.py::RemoveV2ContentTestCase.test_10_remove_manifest_shared ✓100% ██████████

Results (89.11s):
      10 passed
pytest -svv test_remove.py --disable-warnings  3.40s user 0.21s system 4% cpu 1:29.54 total

< 2.20

pytest -svv test_remove.py --disable-warnings  2.80s user 0.16s system 6% cpu 48.751 total
Test session starts (platform: linux, Python 3.7.3, pytest 4.1.0, pytest-sugar 0.9.2)
cachedir: .pytest_cache
rootdir: /home/herring/git/Pulp-2-Tests, inifile: pytest.ini
plugins: sugar-0.9.2
collecting ... 
 pulp_2_tests/tests/docker/api_v2/test_remove.py::RemoveV2ContentTestCase.test_01_remove_manifest_list_all_sequential ✓10% █         
 pulp_2_tests/tests/docker/api_v2/test_remove.py::RemoveV2ContentTestCase.test_02_remove_manifest_all_sequential ✓20% ██        
 pulp_2_tests/tests/docker/api_v2/test_remove.py::RemoveV2ContentTestCase.test_03_remove_blob_all_sequential ✓30% ███       
 pulp_2_tests/tests/docker/api_v2/test_remove.py::RemoveV2ContentTestCase.test_04_remove_manifest_list_all_batch s40% ████      
 pulp_2_tests/tests/docker/api_v2/test_remove.py::RemoveV2ContentTestCase.test_05_remove_manifest_all_batch s50% █████     
 pulp_2_tests/tests/docker/api_v2/test_remove.py::RemoveV2ContentTestCase.test_06_remove_blob_all_batch s60% ██████    
 pulp_2_tests/tests/docker/api_v2/test_remove.py::RemoveV2ContentTestCase.test_07_remove_manifest_list_not_shared ✓70% ███████   
 pulp_2_tests/tests/docker/api_v2/test_remove.py::RemoveV2ContentTestCase.test_08_remove_manifest_list_shared ✓80% ████████  
 pulp_2_tests/tests/docker/api_v2/test_remove.py::RemoveV2ContentTestCase.test_09_remove_manifest_not_shared ✓90% █████████ 
 pulp_2_tests/tests/docker/api_v2/test_remove.py::RemoveV2ContentTestCase.test_10_remove_manifest_shared ✓100% ██████████

Results (46.12s):
       7 passed
       3 skipped

Notes

• Batch removal functionality is skipped unless 2.21 where more than one parent is recursively removed
• Tested against: RHEL 7.6 only Pulp 2.21-nightly, 2.20-stable, 2.19-stable
• Testing of tags was removed from the scope of this testing. There is already a test_tags.py that can/should cover this testing. Count and behavior of tags relative to other removals is verified as an ancillary effect.

Refs and Tags

• https://github.com/PulpQE/pulp-qe-tools/tree/master/pulp2/tools/pulp-docker-inspector ** Note: the inspector MUST be edited to the local API or it will not function
• https://github.com/PulpQE/pulp-fixtures/tree/master/docker/hub

refs #4549 #5161 closes #5181

[nixocio]

Good job @bherrin3. I specially like all the comments, and permutations.

I have a few minor suggestions. Not blockers.