search

virlfiles / genie_learning_lab

Topology used for Genie learning labs
5 stars 4 forks source link

[Learning labs] Fixed minor bug #10

Closed lsheikal closed 2 years ago

lsheikal commented 2 years ago

Motivation

  1. Triggers and verifications were not executed because of the old job file.
  2. CML testbed comes with connection "a" not the "console". So replaced "console" with connection "a".

Fail case

2021-12-06T11:43:35: %EASYPY-INFO: +------------------------------------------------------------------------------+
2021-12-06T11:43:35: %EASYPY-INFO: |                                Easypy Report                                 |
2021-12-06T11:43:35: %EASYPY-INFO: +------------------------------------------------------------------------------+
2021-12-06T11:43:35: %EASYPY-INFO: pyATS Instance   : /home/developer/py3venv
2021-12-06T11:43:35: %EASYPY-INFO: Python Version   : cpython-3.6.8 (64bit)
2021-12-06T11:43:35: %EASYPY-INFO: CLI Arguments    : /home/developer/py3venv/bin/easypy genie_sample_job.py -testbed_file ../default_testbed.yaml -html_logs
2021-12-06T11:43:35: %EASYPY-INFO: User             : developer
2021-12-06T11:43:35: %EASYPY-INFO: Host Server      : devbox
2021-12-06T11:43:35: %EASYPY-INFO: Host OS Version  : CentOS Linux 7 Core (x86_64)
2021-12-06T11:43:35: %EASYPY-INFO:
2021-12-06T11:43:35: %EASYPY-INFO: Job Information
2021-12-06T11:43:35: %EASYPY-INFO:     Name         : genie_sample_job
2021-12-06T11:43:35: %EASYPY-INFO:     Start time   : 2021-12-06 11:43:17.633556
2021-12-06T11:43:35: %EASYPY-INFO:     Stop time    : 2021-12-06 11:43:35.298667
2021-12-06T11:43:35: %EASYPY-INFO:     Elapsed time : 17.665111
2021-12-06T11:43:35: %EASYPY-INFO:     Archive      : /home/developer/.pyats/archive/21-Dec/genie_sample_job.2021Dec06_11:43:14.342749.zip
2021-12-06T11:43:35: %EASYPY-INFO:
2021-12-06T11:43:35: %EASYPY-INFO: Total Tasks    : 1
2021-12-06T11:43:35: %EASYPY-INFO:
2021-12-06T11:43:35: %EASYPY-INFO: Overall Stats
2021-12-06T11:43:35: %EASYPY-INFO:     Passed     : 2
2021-12-06T11:43:35: %EASYPY-INFO:     Passx      : 0
2021-12-06T11:43:35: %EASYPY-INFO:     Failed     : 0
2021-12-06T11:43:35: %EASYPY-INFO:     Aborted    : 0
2021-12-06T11:43:35: %EASYPY-INFO:     Blocked    : 0
2021-12-06T11:43:35: %EASYPY-INFO:     Skipped    : 0
2021-12-06T11:43:35: %EASYPY-INFO:     Errored    : 0
2021-12-06T11:43:35: %EASYPY-INFO:
2021-12-06T11:43:35: %EASYPY-INFO:     TOTAL      : 2
2021-12-06T11:43:35: %EASYPY-INFO:
2021-12-06T11:43:35: %EASYPY-INFO: Success Rate   : 100.00 %
2021-12-06T11:43:35: %EASYPY-INFO:
2021-12-06T11:43:35: %EASYPY-INFO: +------------------------------------------------------------------------------+
2021-12-06T11:43:35: %EASYPY-INFO: |                             Task Result Summary                              |
2021-12-06T11:43:35: %EASYPY-INFO: +------------------------------------------------------------------------------+
2021-12-06T11:43:35: %EASYPY-INFO: Task-1: genie_testscript.common_setup                                     PASSED
2021-12-06T11:43:35: %EASYPY-INFO: Task-1: genie_testscript.common_cleanup                                   PASSED
2021-12-06T11:43:35: %EASYPY-INFO:
2021-12-06T11:43:35: %EASYPY-INFO: +------------------------------------------------------------------------------+
2021-12-06T11:43:35: %EASYPY-INFO: |                             Task Result Details                              |
2021-12-06T11:43:35: %EASYPY-INFO: +------------------------------------------------------------------------------+
2021-12-06T11:43:35: %EASYPY-INFO: Task-1: genie_testscript
2021-12-06T11:43:35: %EASYPY-INFO: |-- common_setup                                                          PASSED
2021-12-06T11:43:35: %EASYPY-INFO: |   |-- connect                                                           PASSED
2021-12-06T11:43:35: %EASYPY-INFO: |   |-- configure                                                        SKIPPED
2021-12-06T11:43:35: %EASYPY-INFO: |   |-- configuration_snapshot                                            PASSED
2021-12-06T11:43:35: %EASYPY-INFO: |   |-- save_bootvar                                                      PASSED
2021-12-06T11:43:35: %EASYPY-INFO: |   |-- learn_system_defaults                                             PASSED
2021-12-06T11:43:35: %EASYPY-INFO: |   |-- initialize_traffic                                               SKIPPED
2021-12-06T11:43:35: %EASYPY-INFO: |   `-- PostProcessor-1                                                   PASSED
2021-12-06T11:43:35: %EASYPY-INFO: `-- common_cleanup                                                        PASSED
2021-12-06T11:43:35: %EASYPY-INFO:     |-- verify_configuration_snapshot                                     PASSED
2021-12-06T11:43:35: %EASYPY-INFO:     |-- stop_traffic                                                     SKIPPED
2021-12-06T11:43:35: %EASYPY-INFO:     `-- PostProcessor-1                                                   PASSED
2021-12-06T11:43:35: %EASYPY-INFO: Sending report email...
2021-12-06T11:43:35: %EASYPY-INFO: Missing SMTP server configuration, or failed to reach/authenticate/send mail. Result notification email failed to send.
2021-12-06T11:43:35: %EASYPY-INFO: Done!
lsheikal commented 2 years ago

Pass case:

After the fix:

2021-12-06T11:46:10: %EASYPY-INFO: +------------------------------------------------------------------------------+
2021-12-06T11:46:10: %EASYPY-INFO: |                                Easypy Report                                 |
2021-12-06T11:46:10: %EASYPY-INFO: +------------------------------------------------------------------------------+
2021-12-06T11:46:10: %EASYPY-INFO: pyATS Instance   : /home/developer/py3venv
2021-12-06T11:46:10: %EASYPY-INFO: Python Version   : cpython-3.6.8 (64bit)
2021-12-06T11:46:10: %EASYPY-INFO: CLI Arguments    : /home/developer/py3venv/bin/pyats run job genie_sample_job.py --testbed-file ../default_testbed.yaml --html_logs
2021-12-06T11:46:10: %EASYPY-INFO: User             : developer
2021-12-06T11:46:10: %EASYPY-INFO: Host Server      : devbox
2021-12-06T11:46:10: %EASYPY-INFO: Host OS Version  : CentOS Linux 7 Core (x86_64)
2021-12-06T11:46:10: %EASYPY-INFO:
2021-12-06T11:46:10: %EASYPY-INFO: Job Information
2021-12-06T11:46:10: %EASYPY-INFO:     Name         : genie_sample_job
2021-12-06T11:46:10: %EASYPY-INFO:     Start time   : 2021-12-06 11:45:14.829604
2021-12-06T11:46:10: %EASYPY-INFO:     Stop time    : 2021-12-06 11:46:09.572158
2021-12-06T11:46:10: %EASYPY-INFO:     Elapsed time : 54.742554
2021-12-06T11:46:10: %EASYPY-INFO:     Archive      : /home/developer/.pyats/archive/21-Dec/genie_sample_job.2021Dec06_11:45:11.371751.zip
2021-12-06T11:46:10: %EASYPY-INFO:
2021-12-06T11:46:10: %EASYPY-INFO: Total Tasks    : 1
2021-12-06T11:46:10: %EASYPY-INFO:
2021-12-06T11:46:10: %EASYPY-INFO: Overall Stats
2021-12-06T11:46:10: %EASYPY-INFO:     Passed     : 5
2021-12-06T11:46:10: %EASYPY-INFO:     Passx      : 0
2021-12-06T11:46:10: %EASYPY-INFO:     Failed     : 0
2021-12-06T11:46:10: %EASYPY-INFO:     Aborted    : 0
2021-12-06T11:46:10: %EASYPY-INFO:     Blocked    : 0
2021-12-06T11:46:10: %EASYPY-INFO:     Skipped    : 0
2021-12-06T11:46:10: %EASYPY-INFO:     Errored    : 0
2021-12-06T11:46:10: %EASYPY-INFO:
2021-12-06T11:46:10: %EASYPY-INFO:     TOTAL      : 5
2021-12-06T11:46:10: %EASYPY-INFO:
2021-12-06T11:46:10: %EASYPY-INFO: Success Rate   : 100.00 %
2021-12-06T11:46:10: %EASYPY-INFO:
2021-12-06T11:46:10: %EASYPY-INFO: +------------------------------------------------------------------------------+
2021-12-06T11:46:10: %EASYPY-INFO: |                             Task Result Summary                              |
2021-12-06T11:46:10: %EASYPY-INFO: +------------------------------------------------------------------------------+
2021-12-06T11:46:10: %EASYPY-INFO: Task-1: genie_testscript.common_setup                                     PASSED
2021-12-06T11:46:10: %EASYPY-INFO: Task-1: genie_testscript.Verify_BgpAllNexthopDatabase.uut.1               PASSED
2021-12-06T11:46:10: %EASYPY-INFO: Task-1: genie_testscript.TriggerDisableEnableBgp.uut                      PASSED
2021-12-06T11:46:10: %EASYPY-INFO: Task-1: genie_testscript.Verify_BgpAllNexthopDatabase.uut.2               PASSED
2021-12-06T11:46:10: %EASYPY-INFO: Task-1: genie_testscript.common_cleanup                                   PASSED
2021-12-06T11:46:10: %EASYPY-INFO:
2021-12-06T11:46:10: %EASYPY-INFO: +------------------------------------------------------------------------------+
2021-12-06T11:46:10: %EASYPY-INFO: |                             Task Result Details                              |
2021-12-06T11:46:10: %EASYPY-INFO: +------------------------------------------------------------------------------+
2021-12-06T11:46:10: %EASYPY-INFO: Task-1: genie_testscript
2021-12-06T11:46:10: %EASYPY-INFO: |-- common_setup                                                          PASSED
2021-12-06T11:46:10: %EASYPY-INFO: |   |-- connect                                                           PASSED
2021-12-06T11:46:10: %EASYPY-INFO: |   |-- configure                                                        SKIPPED
2021-12-06T11:46:10: %EASYPY-INFO: |   |-- configuration_snapshot                                            PASSED
2021-12-06T11:46:10: %EASYPY-INFO: |   |-- save_bootvar                                                      PASSED
2021-12-06T11:46:10: %EASYPY-INFO: |   |-- learn_system_defaults                                             PASSED
2021-12-06T11:46:10: %EASYPY-INFO: |   |-- initialize_traffic                                               SKIPPED
2021-12-06T11:46:10: %EASYPY-INFO: |   `-- PostProcessor-1                                                   PASSED
2021-12-06T11:46:10: %EASYPY-INFO: |-- Verify_BgpAllNexthopDatabase.uut.1                                    PASSED
2021-12-06T11:46:10: %EASYPY-INFO: |   `-- verify                                                            PASSED
2021-12-06T11:46:10: %EASYPY-INFO: |-- TriggerDisableEnableBgp.uut                                           PASSED
2021-12-06T11:46:10: %EASYPY-INFO: |   |-- PreProcessor-1                                                    PASSED
2021-12-06T11:46:10: %EASYPY-INFO: |   |-- verify_prerequisite                                               PASSED
2021-12-06T11:46:10: %EASYPY-INFO: |   |   |-- STEP 1: Learning 'Bgp' Ops                                    PASSED
2021-12-06T11:46:10: %EASYPY-INFO: |   |   |-- STEP 2: Verifying requirements                                PASSED
2021-12-06T11:46:10: %EASYPY-INFO: |   |   `-- STEP 3: Merge requirements                                    PASSED
2021-12-06T11:46:10: %EASYPY-INFO: |   |-- save_configuration                                                PASSED
2021-12-06T11:46:10: %EASYPY-INFO: |   |-- disable                                                           PASSED
2021-12-06T11:46:10: %EASYPY-INFO: |   |   `-- STEP 1: Unconfiguring 'Bgp'                                   PASSED
2021-12-06T11:46:10: %EASYPY-INFO: |   |-- verify_disable                                                    PASSED
2021-12-06T11:46:10: %EASYPY-INFO: |   |-- restore_configuration                                             PASSED
2021-12-06T11:46:10: %EASYPY-INFO: |   |-- verify_initial_state                                              PASSED
2021-12-06T11:46:10: %EASYPY-INFO: |   |   `-- STEP 1: Verifying ops 'Bgp' is back to original state         PASSED
2021-12-06T11:46:10: %EASYPY-INFO: |   `-- PostProcessor-1                                                   PASSED
2021-12-06T11:46:10: %EASYPY-INFO: |-- Verify_BgpAllNexthopDatabase.uut.2                                    PASSED
2021-12-06T11:46:10: %EASYPY-INFO: |   `-- verify                                                            PASSED
2021-12-06T11:46:10: %EASYPY-INFO: `-- common_cleanup                                                        PASSED
2021-12-06T11:46:10: %EASYPY-INFO:     |-- verify_configuration_snapshot                                     PASSED
2021-12-06T11:46:10: %EASYPY-INFO:     |-- stop_traffic                                                     SKIPPED
2021-12-06T11:46:10: %EASYPY-INFO:     `-- PostProcessor-1                                                   PASSED
2021-12-06T11:46:10: %EASYPY-INFO: Sending report email...
2021-12-06T11:46:10: %EASYPY-INFO: Missing SMTP server configuration, or failed to reach/authenticate/send mail. Result notification email failed to send.
2021-12-06T11:46:10: %EASYPY-INFO: Done!