kloczek
commented
1 year ago Looks like it it second unit which runs forever and it is tests/spec/Spec/equality_test.py::test_equality_of_specs_with_recursive_definition[True].
After add those two units to --deselect list I found that another unit is failing. Here is pytest output:
```console
+ PYTHONPATH=/home/tkloczko/rpmbuild/BUILDROOT/python-bravado-core-5.17.1-2.fc35.x86_64/usr/lib64/python3.8/site-packages:/home/tkloczko/rpmbuild/BUILDROOT/python-bravado-core-5.17.1-2.fc35.x86_64/usr/lib/python3.8/site-packages
+ /usr/bin/pytest -ra -m 'not network' --deselect tests/spec/Spec/deref_flattened_spec_test.py::test_build_spec_object_with_recursive_specs_and_fully_dereference --deselect 'tests/spec/Spec/equality_test.py::test_equality_of_specs_with_recursive_definition[True]'
==================================================================================== test session starts ====================================================================================
platform linux -- Python 3.8.17, pytest-7.3.1, pluggy-1.0.0
benchmark: 4.0.0 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /home/tkloczko/rpmbuild/BUILD/bravado-core-5.17.1
configfile: tox.ini
plugins: benchmark-4.0.0
collected 912 items / 2 deselected / 910 selected
tests/_decorators_test.py ......... [ 0%]
tests/security_test.py ...... [ 1%]
tests/util_test.py .......................... [ 4%]
tests/docstring/create_operation_docstring_test.py ....... [ 5%]
tests/docstring/create_param_docstring_test.py ...... [ 5%]
tests/docstring/formatted_type_test.py ..... [ 6%]
tests/exception/wrap_exception_test.py .. [ 6%]
tests/formatter/to_python_test.py ............... [ 8%]
tests/formatter/to_wire_test.py .................. [ 10%]
tests/marshal/marshal_array_test.py ........... [ 11%]
tests/marshal/marshal_model_test.py ........ [ 12%]
tests/marshal/marshal_object_test.py ...................... [ 14%]
tests/marshal/marshal_primitive_test.py ....... [ 15%]
tests/marshal/marshal_schema_object_test.py ....... [ 16%]
tests/model/bless_models_test.py ....... [ 17%]
tests/model/collect_models_test.py .... [ 17%]
tests/model/compare_test.py ... [ 17%]
tests/model/create_model_docstring_test.py .. [ 18%]
tests/model/create_model_repr_test.py ..s. [ 18%]
tests/model/create_model_type_test.py ......... [ 19%]
tests/model/get_model_name_test.py .... [ 20%]
tests/model/is_model_test.py .... [ 20%]
tests/model/is_object_test.py ...... [ 21%]
tests/model/model_constructor_test.py ....... [ 21%]
tests/model/model_discovery_test.py ... [ 22%]
tests/model/model_test.py .................................. [ 25%]
tests/model/pickling_test.py .. [ 26%]
tests/model/post_process_spec_test.py ... [ 26%]
tests/model/tag_models_test.py ....... [ 27%]
tests/operation/build_params_test.py ....... [ 28%]
tests/operation/consumes_test.py .... [ 28%]
tests/operation/equality_test.py ....... [ 29%]
tests/operation/operation_id_test.py ............ [ 30%]
tests/operation/produces_test.py .... [ 30%]
tests/operation/security_object_test.py ................................. [ 34%]
tests/param/add_file_test.py .... [ 35%]
tests/param/cast_request_param_test.py ........... [ 36%]
tests/param/get_param_type_spec_test.py .... [ 36%]
tests/param/marshal_collection_format_test.py .... [ 37%]
tests/param/marshal_param_test.py ................................ [ 40%]
tests/param/string_to_boolean_test.py ... [ 40%]
tests/param/stringify_body_test.py .. [ 41%]
tests/param/unmarshal_collection_format_test.py ........... [ 42%]
tests/param/unmarshal_param_test.py ........................ [ 45%]
tests/profiling/marshal_profiler_test.py ............ [ 46%]
tests/profiling/unmarshal_profiler_test.py ............ [ 47%]
tests/profiling/unmarshal_response_profiler_test.py ........................ [ 50%]
tests/request/IncomingRequest_test.py ... [ 50%]
tests/request/unmarshal_request_test.py .... [ 51%]
tests/resource/build_resources_test.py ............ [ 52%]
tests/resource/convert_path_to_resource_test.py ... [ 52%]
tests/resource/deepcopy_test.py . [ 52%]
tests/resource/equality_test.py ...... [ 53%]
tests/response/IncomingResponse_test.py .... [ 53%]
tests/response/get_response_spec_test.py ... [ 54%]
tests/response/unmarshal_response_test.py ......... [ 55%]
tests/response/validate_response_body_test.py ....... [ 56%]
tests/response/validate_response_headers_test.py .... [ 56%]
tests/response/validate_response_test.py .. [ 56%]
tests/schema/collapsed_properties_test.py .. [ 56%]
tests/schema/collapsed_required_test.py . [ 57%]
tests/schema/get_format_test.py .... [ 57%]
tests/schema/get_spec_for_prop_test.py .......... [ 58%]
tests/schema/handle_null_value_test.py ... [ 58%]
tests/schema/has_format_test.py .... [ 59%]
tests/schema/is_param_spec_test.py .... [ 59%]
tests/schema/is_prop_nullable_test.py ..... [ 60%]
tests/schema/is_required_test.py ...... [ 60%]
tests/spec/build_api_serving_url_test.py ................. [ 62%]
tests/spec/build_http_handlers_test.py ........ [ 63%]
tests/spec/from_dict_test.py ......... [ 64%]
tests/spec/pickling_test.py ..... [ 65%]
tests/spec/Spec/build_test.py ................ [ 67%]
tests/spec/Spec/deepcopy_test.py . [ 67%]
tests/spec/Spec/deref_flattened_spec_test.py .. [ 67%]
tests/spec/Spec/deref_test.py ..... [ 67%]
tests/spec/Spec/equality_test.py ............. [ 69%]
tests/spec/Spec/flattened_spec_test.py .................................... [ 73%]
tests/spec/Spec/get_op_for_request_test.py ..... [ 73%]
tests/swagger20_validator/enum_validator_test.py ...... [ 74%]
tests/swagger20_validator/format_validator_test.py ......... [ 75%]
tests/swagger20_validator/ref_validator_test.py .. [ 75%]
tests/swagger20_validator/required_validator_test.py ... [ 76%]
tests/swagger20_validator/type_validator_test.py ..... [ 76%]
tests/unmarshal/unmarshal_array_test.py ........ [ 77%]
tests/unmarshal/unmarshal_model_test.py ................... [ 79%]
tests/unmarshal/unmarshal_object_test.py ......................................................... [ 85%]
tests/unmarshal/unmarshal_primitive_test.py .............. [ 87%]
tests/unmarshal/unmarshal_schema_object_test.py ........ [ 88%]
tests/validate/validate_array_test.py ........... [ 89%]
tests/validate/validate_object_test.py ....................................... [ 93%]
tests/validate/validate_primitive_test.py ..............................F........ [ 98%]
tests/validate/validate_schema_object_test.py .... [ 98%]
tests/validate/validate_security_object_test.py .............. [100%]
========================================================================================= FAILURES ==========================================================================================
__________________________________________________________________________ test_string_datetime_invalid_exception ___________________________________________________________________________
minimal_swagger_spec = , string_spec = {'format': 'date-time', 'type': 'string'}
def test_string_datetime_invalid_exception(minimal_swagger_spec, string_spec):
string_spec['format'] = 'date-time'
datestring = "nope nope nope"
with pytest.raises(ValidationError) as excinfo:
> validate_primitive(minimal_swagger_spec, string_spec, datestring)
E Failed: DID NOT RAISE
tests/validate/validate_primitive_test.py:221: Failed
===================================================================================== warnings summary ======================================================================================
../../../../../usr/lib/python3.8/site-packages/pkg_resources/__init__.py:121
/usr/lib/python3.8/site-packages/pkg_resources/__init__.py:121: DeprecationWarning: pkg_resources is deprecated as an API
warnings.warn("pkg_resources is deprecated as an API", DeprecationWarning)
../../../../../usr/lib/python3.8/site-packages/pkg_resources/__init__.py:2870
../../../../../usr/lib/python3.8/site-packages/pkg_resources/__init__.py:2870
../../../../../usr/lib/python3.8/site-packages/pkg_resources/__init__.py:2870
../../../../../usr/lib/python3.8/site-packages/pkg_resources/__init__.py:2870
../../../../../usr/lib/python3.8/site-packages/pkg_resources/__init__.py:2870
/usr/lib/python3.8/site-packages/pkg_resources/__init__.py:2870: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('sphinxcontrib')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
tests/_decorators_test.py: 112 warnings
tests/security_test.py: 102 warnings
tests/util_test.py: 16 warnings
tests/formatter/to_python_test.py: 243 warnings
tests/formatter/to_wire_test.py: 291 warnings
tests/marshal/marshal_array_test.py: 17 warnings
tests/marshal/marshal_model_test.py: 150 warnings
tests/marshal/marshal_object_test.py: 136 warnings
tests/marshal/marshal_primitive_test.py: 64 warnings
tests/marshal/marshal_schema_object_test.py: 68 warnings
tests/model/create_model_docstring_test.py: 32 warnings
tests/model/create_model_repr_test.py: 17 warnings
tests/model/create_model_type_test.py: 32 warnings
tests/model/is_model_test.py: 32 warnings
tests/model/is_object_test.py: 97 warnings
tests/model/model_constructor_test.py: 17 warnings
tests/model/model_discovery_test.py: 83 warnings
tests/model/model_test.py: 563 warnings
tests/model/pickling_test.py: 34 warnings
tests/operation/consumes_test.py: 68 warnings
tests/operation/equality_test.py: 160 warnings
tests/operation/produces_test.py: 68 warnings
tests/operation/security_object_test.py: 287 warnings
tests/param/marshal_param_test.py: 66 warnings
tests/param/unmarshal_param_test.py: 34 warnings
tests/profiling/marshal_profiler_test.py: 582 warnings
tests/profiling/unmarshal_profiler_test.py: 582 warnings
tests/profiling/unmarshal_response_profiler_test.py: 1164 warnings
tests/request/unmarshal_request_test.py: 64 warnings
tests/resource/deepcopy_test.py: 16 warnings
tests/resource/equality_test.py: 144 warnings
tests/response/unmarshal_response_test.py: 51 warnings
tests/response/validate_response_body_test.py: 112 warnings
tests/response/validate_response_headers_test.py: 64 warnings
tests/schema/collapsed_properties_test.py: 17 warnings
tests/schema/collapsed_required_test.py: 17 warnings
tests/schema/get_format_test.py: 66 warnings
tests/schema/get_spec_for_prop_test.py: 164 warnings
tests/schema/has_format_test.py: 66 warnings
tests/schema/is_param_spec_test.py: 66 warnings
tests/schema/is_prop_nullable_test.py: 82 warnings
tests/schema/is_required_test.py: 65 warnings
tests/spec/from_dict_test.py: 341 warnings
tests/spec/pickling_test.py: 146 warnings
tests/spec/Spec/build_test.py: 199 warnings
tests/spec/Spec/deepcopy_test.py: 16 warnings
tests/spec/Spec/deref_flattened_spec_test.py: 85 warnings
tests/spec/Spec/deref_test.py: 82 warnings
tests/spec/Spec/equality_test.py: 385 warnings
tests/spec/Spec/flattened_spec_test.py: 501 warnings
tests/spec/Spec/get_op_for_request_test.py: 83 warnings
tests/swagger20_validator/enum_validator_test.py: 48 warnings
tests/swagger20_validator/format_validator_test.py: 144 warnings
tests/swagger20_validator/required_validator_test.py: 48 warnings
tests/swagger20_validator/type_validator_test.py: 80 warnings
tests/unmarshal/unmarshal_array_test.py: 17 warnings
tests/unmarshal/unmarshal_model_test.py: 322 warnings
tests/unmarshal/unmarshal_object_test.py: 187 warnings
tests/unmarshal/unmarshal_primitive_test.py: 225 warnings
tests/unmarshal/unmarshal_schema_object_test.py: 136 warnings
tests/validate/validate_array_test.py: 176 warnings
tests/validate/validate_object_test.py: 396 warnings
tests/validate/validate_primitive_test.py: 624 warnings
tests/validate/validate_schema_object_test.py: 66 warnings
tests/validate/validate_security_object_test.py: 238 warnings
/home/tkloczko/rpmbuild/BUILD/bravado-core-5.17.1/bravado_core/model.py:888: DeprecationWarning: jsonschema.RefResolver.in_scope is deprecated and will be removed in a future release.
with spec.resolver.in_scope(additional_uri):
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
-------------------------------------------------------------------------------------------------------------------- benchmark: 48 tests --------------------------------------------------------------------------------------------------------------------
Name (time in us) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_small_objects[with-refs-100] 581.8238 (1.0) 649.4028 (1.0) 594.7219 (1.0) 8.2307 (1.0) 593.4569 (1.00) 7.0541 (1.08) 92;33 1,681.4581 (1.0) 987 1
test_small_objects[full-deref-100] 582.0203 (1.00) 1,063.1699 (1.64) 594.8336 (1.00) 17.4092 (2.12) 593.1358 (1.0) 6.5200 (1.0) 31;34 1,681.1425 (1.00) 992 1
test_small_objects[full-deref-100] 693.6779 (1.19) 1,410.3930 (2.17) 711.4820 (1.20) 31.0534 (3.77) 707.5781 (1.19) 9.0068 (1.38) 30;39 1,405.5170 (0.84) 892 1
test_small_objects[with-refs-100] 699.6752 (1.20) 1,416.5291 (2.18) 715.5538 (1.20) 25.4091 (3.09) 713.4019 (1.20) 8.3083 (1.27) 20;26 1,397.5191 (0.83) 873 1
test_small_objects[not_validate-full-deref-100] 700.4179 (1.20) 1,465.6107 (2.26) 717.7927 (1.21) 31.6534 (3.85) 715.0478 (1.21) 9.9686 (1.53) 19;24 1,393.1599 (0.83) 632 1
test_small_objects[not_validate-with-refs-100] 701.1979 (1.21) 772.6196 (1.19) 716.8453 (1.21) 9.8395 (1.20) 715.2001 (1.21) 9.5470 (1.46) 113;33 1,395.0011 (0.83) 858 1
test_large_objects[full-deref-100] 1,913.2816 (3.29) 2,602.9032 (4.01) 1,931.7512 (3.25) 38.7516 (4.71) 1,925.4675 (3.25) 7.3384 (1.13) 18;37 517.6650 (0.31) 410 1
test_large_objects[with-refs-100] 1,921.9802 (3.30) 2,055.6417 (3.17) 1,938.8796 (3.26) 19.4327 (2.36) 1,934.7114 (3.26) 7.8533 (1.20) 17;24 515.7618 (0.31) 345 1
test_large_objects[full-deref-100] 2,407.5550 (4.14) 3,167.3936 (4.88) 2,466.7142 (4.15) 50.6525 (6.15) 2,463.9461 (4.15) 34.1677 (5.24) 25;14 405.3976 (0.24) 359 1
test_large_objects[not_validate-full-deref-100] 2,415.1946 (4.15) 3,212.0338 (4.95) 2,463.4776 (4.14) 50.0307 (6.08) 2,458.8169 (4.15) 32.4192 (4.97) 21;20 405.9302 (0.24) 355 1
test_large_objects[with-refs-100] 2,431.1310 (4.18) 53,400.5617 (82.23) 2,623.3289 (4.41) 2,742.2170 (333.17) 2,474.3839 (4.17) 44.9931 (6.90) 1;10 381.1951 (0.23) 345 1
test_large_objects[not_validate-with-refs-100] 2,434.1010 (4.18) 3,323.1508 (5.12) 2,494.0634 (4.19) 55.3516 (6.73) 2,492.1093 (4.20) 41.7437 (6.40) 17;11 400.9521 (0.24) 350 1
test_small_objects[validate-full-deref-100] 4,426.6470 (7.61) 5,287.2188 (8.14) 4,504.0755 (7.57) 72.7461 (8.84) 4,490.0072 (7.57) 33.7452 (5.18) 12;14 222.0211 (0.13) 175 1
test_small_objects[validate-with-refs-100] 5,554.9340 (9.55) 6,615.7640 (10.19) 5,631.5496 (9.47) 96.9293 (11.78) 5,613.7647 (9.46) 36.6373 (5.62) 7;13 177.5710 (0.11) 149 1
test_small_objects[full-deref-1000] 5,903.0387 (10.15) 50,599.9681 (77.92) 6,325.9054 (10.64) 3,715.8912 (451.47) 6,005.5587 (10.13) 41.0008 (6.29) 1;12 158.0801 (0.09) 144 1
test_small_objects[with-refs-1000] 5,978.0860 (10.27) 48,094.3411 (74.06) 6,403.8454 (10.77) 3,427.8235 (416.47) 6,108.3473 (10.30) 53.1878 (8.16) 1;16 156.1562 (0.09) 150 1
test_small_objects[not_validate-full-deref-1000] 7,115.4973 (12.23) 62,812.4052 (96.72) 8,069.6357 (13.57) 6,505.9810 (790.45) 7,226.2352 (12.18) 119.5185 (18.33) 2;4 123.9213 (0.07) 131 1
test_small_objects[full-deref-1000] 7,144.3859 (12.28) 55,421.6881 (85.34) 7,940.6486 (13.35) 5,392.6391 (655.19) 7,270.7357 (12.26) 99.0434 (15.19) 2;7 125.9343 (0.07) 134 1
test_small_objects[with-refs-1000] 7,200.1643 (12.38) 53,752.6770 (82.77) 7,699.9616 (12.95) 4,170.3144 (506.68) 7,305.3464 (12.32) 87.6756 (13.45) 1;5 129.8708 (0.08) 124 1
test_small_objects[not_validate-with-refs-1000] 7,230.6120 (12.43) 64,086.2300 (98.68) 7,785.3562 (13.09) 4,957.8346 (602.36) 7,340.8829 (12.38) 99.7444 (15.30) 1;3 128.4463 (0.08) 131 1
test_large_objects[validate-full-deref-100] 17,365.6419 (29.85) 18,400.5187 (28.33) 17,593.0011 (29.58) 162.1932 (19.71) 17,573.8984 (29.63) 166.1829 (25.49) 9;2 56.8408 (0.03) 54 1
test_large_objects[full-deref-1000] 19,293.8093 (33.16) 60,312.4299 (92.87) 21,097.1470 (35.47) 7,903.7291 (960.27) 19,492.1037 (32.86) 171.6488 (26.33) 2;4 47.3998 (0.03) 50 1
test_large_objects[with-refs-1000] 19,428.5661 (33.39) 19,936.6142 (30.70) 19,654.6456 (33.05) 141.6553 (17.21) 19,679.9440 (33.18) 155.3362 (23.82) 5;0 50.8786 (0.03) 15 1
test_large_objects[validate-with-refs-100] 21,908.1570 (37.65) 22,878.3069 (35.23) 22,184.0055 (37.30) 149.8864 (18.21) 22,166.3630 (37.37) 129.5377 (19.87) 8;2 45.0775 (0.03) 43 1
test_large_objects[full-deref-1000] 24,480.3522 (42.08) 74,805.4292 (115.19) 29,510.2352 (49.62) 14,026.5788 (>1000.0) 24,888.2680 (41.96) 559.9449 (85.88) 4;4 33.8865 (0.02) 40 1
test_large_objects[with-refs-1000] 24,673.6282 (42.41) 74,394.1008 (114.56) 29,783.1363 (50.08) 14,331.1064 (>1000.0) 25,100.8389 (42.32) 418.6553 (64.21) 4;4 33.5760 (0.02) 40 1
test_large_objects[not_validate-full-deref-1000] 24,702.1830 (42.46) 89,071.5793 (137.16) 31,191.7457 (52.45) 18,501.3167 (>1000.0) 25,087.4988 (42.30) 537.7589 (82.48) 4;4 32.0598 (0.02) 40 1
test_large_objects[not_validate-with-refs-1000] 24,810.5288 (42.64) 91,063.5074 (140.23) 31,423.9906 (52.84) 18,898.0006 (>1000.0) 25,203.8052 (42.49) 458.6137 (70.34) 4;4 31.8228 (0.02) 40 1
test_small_objects[with-refs-5000] 29,825.4667 (51.26) 76,913.9300 (118.44) 34,973.5215 (58.81) 13,413.0050 (>1000.0) 30,705.6592 (51.77) 454.2490 (69.67) 3;3 28.5931 (0.02) 31 1
test_small_objects[full-deref-5000] 30,537.3818 (52.49) 74,711.9891 (115.05) 35,229.8384 (59.24) 13,026.5301 (>1000.0) 31,069.7593 (52.38) 371.0184 (56.91) 3;3 28.3850 (0.02) 31 1
test_small_objects[not_validate-full-deref-5000] 36,350.7527 (62.48) 96,565.3323 (148.70) 47,859.9288 (80.47) 23,128.4707 (>1000.0) 36,806.1918 (62.05) 771.9970 (118.41) 5;5 20.8943 (0.01) 26 1
test_small_objects[full-deref-5000] 36,418.8440 (62.59) 83,658.2687 (128.82) 40,655.3071 (68.36) 13,544.0257 (>1000.0) 36,712.5925 (61.90) 431.2936 (66.15) 1;1 24.5970 (0.01) 12 1
test_small_objects[not_validate-with-refs-5000] 36,438.7911 (62.63) 95,165.1339 (146.54) 42,281.1874 (71.09) 17,542.8812 (>1000.0) 37,188.2380 (62.70) 671.0289 (102.92) 1;1 23.6512 (0.01) 11 1
test_small_objects[with-refs-5000] 36,519.7412 (62.77) 85,153.0000 (131.13) 44,736.8529 (75.22) 18,575.7739 (>1000.0) 36,843.4412 (62.12) 502.2939 (77.04) 2;2 22.3529 (0.01) 12 1
test_small_objects[validate-full-deref-1000] 44,359.9271 (76.24) 45,704.3932 (70.38) 44,780.8543 (75.30) 319.0999 (38.77) 44,720.6311 (75.40) 297.2768 (45.59) 5;2 22.3310 (0.01) 22 1
test_small_objects[validate-with-refs-1000] 55,786.3321 (95.88) 57,386.2297 (88.37) 56,256.6146 (94.59) 397.3091 (48.27) 56,120.6064 (94.62) 392.8589 (60.25) 4;1 17.7757 (0.01) 18 1
test_large_objects[full-deref-5000] 101,134.5172 (173.82) 158,850.2699 (244.61) 118,572.4900 (199.37) 27,218.6821 (>1000.0) 101,976.0191 (171.93) 56,313.3559 (>1000.0) 3;0 8.4337 (0.01) 10 1
test_large_objects[with-refs-5000] 102,244.6160 (175.73) 161,594.1380 (248.83) 120,165.7443 (202.05) 27,938.1605 (>1000.0) 102,909.0895 (173.50) 56,815.4487 (>1000.0) 3;0 8.3218 (0.00) 10 1
test_large_objects[with-refs-5000] 130,446.5057 (224.20) 190,018.8518 (292.61) 166,664.4706 (280.24) 29,807.0422 (>1000.0) 186,564.4460 (314.54) 58,195.3218 (>1000.0) 3;0 6.0001 (0.00) 8 1
test_large_objects[full-deref-5000] 130,725.7582 (224.68) 189,438.8408 (291.71) 166,798.7160 (280.47) 29,748.1500 (>1000.0) 187,554.4495 (316.21) 57,628.0642 (>1000.0) 3;0 5.9952 (0.00) 8 1
test_large_objects[not_validate-with-refs-5000] 130,851.4033 (224.90) 202,297.6950 (311.51) 159,802.4525 (268.70) 38,476.8607 (>1000.0) 132,499.1630 (223.39) 70,230.0551 (>1000.0) 2;0 6.2577 (0.00) 5 1
test_large_objects[not_validate-full-deref-5000] 131,490.8084 (226.00) 203,610.5939 (313.54) 160,152.8675 (269.29) 39,063.8843 (>1000.0) 131,775.1883 (222.17) 71,024.0399 (>1000.0) 2;0 6.2440 (0.00) 5 1
test_large_objects[validate-full-deref-1000] 173,285.3819 (297.83) 233,355.0141 (359.34) 183,652.8932 (308.80) 24,352.3140 (>1000.0) 173,798.2135 (293.02) 940.9059 (144.31) 1;1 5.4451 (0.00) 6 1
test_large_objects[validate-with-refs-1000] 219,006.3042 (376.41) 221,282.8752 (340.75) 219,881.2041 (369.72) 920.6184 (111.85) 220,002.6331 (370.91) 1,268.8525 (194.61) 1;0 4.5479 (0.00) 5 1
test_small_objects[validate-full-deref-5000] 222,974.9397 (383.23) 277,891.5898 (427.92) 234,783.8971 (394.78) 24,110.0131 (>1000.0) 224,469.2789 (378.44) 14,728.8550 (>1000.0) 1;1 4.2592 (0.00) 5 1
test_small_objects[validate-with-refs-5000] 278,768.4030 (479.13) 281,359.2539 (433.26) 280,340.0196 (471.38) 960.5001 (116.70) 280,502.4502 (472.91) 945.8504 (145.07) 2;0 3.5671 (0.00) 5 1
test_large_objects[validate-full-deref-5000] 883,525.3632 (>1000.0) 962,045.9061 (>1000.0) 915,356.3936 (>1000.0) 39,978.7423 (>1000.0) 889,687.1167 (>1000.0) 72,479.6068 (>1000.0) 2;0 1.0925 (0.00) 5 1
test_large_objects[validate-with-refs-5000] 1,108,060.9299 (>1000.0) 1,170,446.8760 (>1000.0) 1,145,040.3069 (>1000.0) 33,677.8427 (>1000.0) 1,169,118.8840 (>1000.0) 61,412.1599 (>1000.0) 2;0 0.8733 (0.00) 5 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
================================================================================== short test summary info ==================================================================================
SKIPPED [1] tests/model/create_model_repr_test.py:16: py2 has ascii default strings
FAILED tests/validate/validate_primitive_test.py::test_string_datetime_invalid_exception - Failed: DID NOT RAISE
==================================================== 1 failed, 908 passed, 1 skipped, 2 deselected, 10662 warnings in 103.23s (0:01:43) =====================================================
```
Here is list of installed modules in build env
```console
Package Version
----------------------------- -------
alabaster 0.7.13
asttokens 2.2.1
attrs 23.1.0
Babel 2.12.1
backcall 0.2.0
build 0.10.0
charset-normalizer 3.1.0
decorator 5.1.1
distro 1.8.0
docutils 0.19
exceptiongroup 1.1.1
executing 1.2.0
gpg 1.20.0
idna 3.4
imagesize 1.4.1
importlib-metadata 6.6.0
importlib-resources 5.12.0
iniconfig 2.0.0
installer 0.7.0
ipython 8.12.0
jedi 0.18.2
Jinja2 3.1.2
jsonref 1.1.0
jsonschema 4.17.3
libcomps 0.1.19
MarkupSafe 2.1.2
matplotlib-inline 0.1.6
msgpack 1.0.5
packaging 23.1
parso 0.8.3
pexpect 4.8.0
pickleshare 0.7.5
pkgutil_resolve_name 1.3.10
pluggy 1.0.0
prompt-toolkit 3.0.38
ptyprocess 0.7.0
pure-eval 0.2.2
py-cpuinfo 9.0.0
Pygments 2.15.1
pyproject_hooks 1.0.0
pyrsistent 0.19.3
pytest 7.3.1
pytest-benchmark 4.0.0
python-dateutil 2.8.2
pytz 2023.2
PyYAML 6.0
requests 2.31.0
setuptools 67.7.2
simplejson 3.19.1
six 1.16.0
snowballstemmer 2.2.0
Sphinx 6.2.1
sphinx-rtd-theme 1.2.1
sphinxcontrib-applehelp 1.0.4
sphinxcontrib-devhelp 1.0.2
sphinxcontrib-htmlhelp 2.0.0
sphinxcontrib-jquery 4.1
sphinxcontrib-jsmath 1.0.1
sphinxcontrib-qthelp 1.0.3
sphinxcontrib-serializinghtml 1.1.5
stack-data 0.6.2
swagger-spec-validator 3.0.3
tomli 2.0.1
traitlets 5.9.0
typing_extensions 4.5.0
urllib3 1.26.15
wcwidth 0.2.6
wheel 0.40.0
zipp 3.15.0
```
macisamuele
Looks like something i wrong with that unit because it cannot finish its work saturating in 100 CPU single core