search

FRRouting / topotests

Moved to frrouting/frr
22 stars 26 forks source link

Added test template framework, convert bgp_direct_to_bgp_vpn to use framework #56

Closed louberger closed 6 years ago

louberger commented 6 years ago

Added lib/ltemplate which builds on lib/lutil to minimize test specific code pytests based on lutil script files. To use, each test now has it: the a top level script that generates the real test file a customize.py file that has in it topology, version check and an other routines to be used (including tests) the normal config directories (daemon run if config file present)

Replaces #52

NetDEF-CI commented 6 years ago

Continuous Integration Result: FAILED

See below for issues. CI System Testrun URL: https://ci1.netdef.org/browse/FRR-TOPOPR-79/

This is a comment from an EXPERIMENTAL automated CI system. For questions and feedback in regards to this CI system, please feel free to email Martin Winter - mwinter (at) opensourcerouting.org.

Topotest Checkout: Successful

Topotests: Failed

Topotest 2.0 branch: Successful Topotest 3.0 branch: Successful

Topotest master branch: Failed

Topotest master branch: Unknown Log URL: https://ci1.netdef.org/browse/FRR-TOPOPR-79/artifact/TMB/TestExecutionLogs/ Topology Test Results are at https://ci1.netdef.org/browse/FRR-TOPOPR-TMB-79/test

Topology Tests failed for Topotest master branch see full log at https://ci1.netdef.org/browse/FRR-TOPOPR-79/artifact/TMB/ErrorLog/log_topotests.txt

Addresssanitizer: Failed

Addresssanitizer: Unknown Log URL: https://ci1.netdef.org/browse/FRR-TOPOPR-79/artifact/AD/TestExecutionLogs/ Topology Test Results are at https://ci1.netdef.org/browse/FRR-TOPOPR-AD-79/test

Topology Tests failed for Addresssanitizer see full log at https://ci1.netdef.org/browse/FRR-TOPOPR-79/artifact/AD/ErrorLog/log_topotests.txt Addresssanitizer: Unknown Log URL: https://ci1.netdef.org/browse/FRR-TOPOPR-79/artifact/AD/AddressSanitizerError/

Topology Tests memory analysis: https://ci1.netdef.org/browse/FRR-TOPOPR-79/artifact/TMB/MemoryLeaks/

NetDEF-CI commented 6 years ago

Continuous Integration Result: FAILED

See below for issues. CI System Testrun URL: https://ci1.netdef.org/browse/FRR-TOPOPR-80/

This is a comment from an EXPERIMENTAL automated CI system. For questions and feedback in regards to this CI system, please feel free to email Martin Winter - mwinter (at) opensourcerouting.org.

Topotest Checkout: Successful

Topotests: Failed

Topotest 2.0 branch: Successful Topotest 3.0 branch: Successful

Addresssanitizer: Failed

Addresssanitizer: Unknown Log URL: https://ci1.netdef.org/browse/FRR-TOPOPR-80/artifact/AD/TestExecutionLogs/ Topology Test Results are at https://ci1.netdef.org/browse/FRR-TOPOPR-AD-80/test

Topology Tests failed for Addresssanitizer see full log at https://ci1.netdef.org/browse/FRR-TOPOPR-80/artifact/AD/ErrorLog/log_topotests.txt Addresssanitizer: Unknown Log URL: https://ci1.netdef.org/browse/FRR-TOPOPR-80/artifact/AD/AddressSanitizerError/

Topotest master branch: Failed

Topotest master branch: Unknown Log URL: https://ci1.netdef.org/browse/FRR-TOPOPR-80/artifact/TMB/TestExecutionLogs/ Topology Test Results are at https://ci1.netdef.org/browse/FRR-TOPOPR-TMB-80/test

Topology Tests failed for Topotest master branch see full log at https://ci1.netdef.org/browse/FRR-TOPOPR-80/artifact/TMB/ErrorLog/log_topotests.txt

Topology Tests memory analysis: https://ci1.netdef.org/browse/FRR-TOPOPR-80/artifact/TMB/MemoryLeaks/

louberger commented 6 years ago

@mwinter-osr can you look at the failures, they are in tests that I don't think have anything to do with the PR

NetDEF-CI commented 6 years ago

Continuous Integration Result: FAILED

See below for issues. CI System Testrun URL: https://ci1.netdef.org/browse/FRR-TOPOPR-81/

This is a comment from an EXPERIMENTAL automated CI system. For questions and feedback in regards to this CI system, please feel free to email Martin Winter - mwinter (at) opensourcerouting.org.

Topotest Checkout: Successful

Topotests: Failed

Topotest 3.0 branch: Successful Topotest 2.0 branch: Successful

Addresssanitizer: Failed

Addresssanitizer: Unknown Log URL: https://ci1.netdef.org/browse/FRR-TOPOPR-81/artifact/AD/TestExecutionLogs/ Topology Test Results are at https://ci1.netdef.org/browse/FRR-TOPOPR-AD-81/test

Topology Tests failed for Addresssanitizer see full log at https://ci1.netdef.org/browse/FRR-TOPOPR-81/artifact/AD/ErrorLog/log_topotests.txt Addresssanitizer: Unknown Log URL: https://ci1.netdef.org/browse/FRR-TOPOPR-81/artifact/AD/AddressSanitizerError/

Topotest master branch: Failed

Topotest master branch: Unknown Log URL: https://ci1.netdef.org/browse/FRR-TOPOPR-81/artifact/TMB/TestExecutionLogs/ Topology Test Results are at https://ci1.netdef.org/browse/FRR-TOPOPR-TMB-81/test

Topology Tests failed for Topotest master branch see full log at https://ci1.netdef.org/browse/FRR-TOPOPR-81/artifact/TMB/ErrorLog/log_topotests.txt

Topology Tests memory analysis: https://ci1.netdef.org/browse/FRR-TOPOPR-81/artifact/TMB/MemoryLeaks/

NetDEF-CI commented 6 years ago

Continuous Integration Result: SUCCESSFUL

Congratulations, this patch passed basic tests

Tested-by: NetDEF / OpenSourceRouting.org CI System

CI System Testrun URL: https://ci1.netdef.org/browse/FRR-TOPOPR-82/

This is a comment from an EXPERIMENTAL automated CI system. For questions and feedback in regards to this CI system, please feel free to email Martin Winter - mwinter (at) opensourcerouting.org.

louberger commented 6 years ago

@mwinter-osr looks like failure fixed by rebase - ready for your review...

NetDEF-CI commented 6 years ago

Continuous Integration Result: SUCCESSFUL

Congratulations, this patch passed basic tests

Tested-by: NetDEF / OpenSourceRouting.org CI System

CI System Testrun URL: https://ci1.netdef.org/browse/FRR-TOPOPR-83/

This is a comment from an EXPERIMENTAL automated CI system. For questions and feedback in regards to this CI system, please feel free to email Martin Winter - mwinter (at) opensourcerouting.org.

NetDEF-CI commented 6 years ago

Continuous Integration Result: SUCCESSFUL

Congratulations, this patch passed basic tests

Tested-by: NetDEF / OpenSourceRouting.org CI System

CI System Testrun URL: https://ci1.netdef.org/browse/FRR-TOPOPR-84/

This is a comment from an EXPERIMENTAL automated CI system. For questions and feedback in regards to this CI system, please feel free to email Martin Winter - mwinter (at) opensourcerouting.org.

NetDEF-CI commented 6 years ago

Continuous Integration Result: FAILED

See below for issues. CI System Testrun URL: https://ci1.netdef.org/browse/FRR-TOPOPR-85/

This is a comment from an EXPERIMENTAL automated CI system. For questions and feedback in regards to this CI system, please feel free to email Martin Winter - mwinter (at) opensourcerouting.org.

Topotest Checkout: Successful

Topotests: Failed

Topotest 3.0 branch: Successful Topotest 2.0 branch: Successful

Topotest master branch: Failed

Topotest master branch: Unknown Log URL: https://ci1.netdef.org/browse/FRR-TOPOPR-85/artifact/TMB/TestExecutionLogs/ Topotest master branch: Unknown Log URL: https://ci1.netdef.org/browse/FRR-TOPOPR-85/artifact/TMB/ErrorLog/ Topotest master branch: No useful log found

Addresssanitizer: Failed

Addresssanitizer: Unknown Log URL: https://ci1.netdef.org/browse/FRR-TOPOPR-85/artifact/AD/TestExecutionLogs/ Addresssanitizer: Unknown Log URL: https://ci1.netdef.org/browse/FRR-TOPOPR-85/artifact/AD/ErrorLog/ Addresssanitizer: Unknown Log URL: https://ci1.netdef.org/browse/FRR-TOPOPR-85/artifact/AD/AddressSanitizerError/ Addresssanitizer: No useful log found

Topology Tests memory analysis: https://ci1.netdef.org/browse/FRR-TOPOPR-85/artifact/TMB/MemoryLeaks/

louberger commented 6 years ago

@mwinter-osr do you have an ETA on when you can look at this?

NetDEF-CI commented 6 years ago

Continuous Integration Result: SUCCESSFUL

Congratulations, this patch passed basic tests

Tested-by: NetDEF / OpenSourceRouting.org CI System

CI System Testrun URL: https://ci1.netdef.org/browse/FRR-TOPOPR-86/

This is a comment from an EXPERIMENTAL automated CI system. For questions and feedback in regards to this CI system, please feel free to email Martin Winter - mwinter (at) opensourcerouting.org.

louberger commented 6 years ago

@mwinter-osr let's get this in as is major improvement then fine tune as time permits...