SatelliteQE / robottelo

Robottelo is a test suite that exercises The Foreman.
GNU General Public License v3.0
61 stars 115 forks source link

installer.test_installer.test_installer_options_and_flags - new options added #5202

Closed rplevka closed 6 years ago

rplevka commented 7 years ago
self = <tests.foreman.installer.test_installer.InstallerParamsTestCase testMethod=test_installer_options_and_flags>

    @tier1
    def test_installer_options_and_flags(self):
        """Look for changes on installer options and flags

            @id: a51d3b9f-f347-4a96-a31a-770349db08c7

            @Steps:
                1. parse installer options and flags
                2. compare with last options

            @expectedresults: Ideally options should not change on zstreams.
                Documentation must be updated accordingly when such changes occur.
                So when this test fail we QE can act on it, asking dev if
                changes occurs on zstream and checking docs are up to date.
            """
        stdout = ssh.command('satellite-installer --help').stdout

        self.assertEqual(
            INSTALLER_OPTIONS,
>           set(extract_params(stdout or []))
        )
E       AssertionError: Items in the second set but not the first:
E       u'--katello-qpid-session-unacked'
E       u'--katello-qpid-wcache-page-size'
ntkathole commented 7 years ago

Bump, For 6.3

        self.assertEqual(
            INSTALLER_OPTIONS,
>           set(extract_params(stdout or []))
        )
E       AssertionError: Items in the first set but not the second:
E       u'--certs-server-ca-name'
E       u'--certs-org-unit'
E       u'--foreman-loggers'
E       u'-d'
E       u'--katello-num-pulp-workers'
E       u'--certs-org'
E       u'--katello-user-groups'
E       u'--foreman-version'
E       u'--foreman-ipa-manage-sssd'
E       u'--foreman-server-ssl-cert'
E       u'--foreman-repo'
E       u'--foreman-ssl'
E       u'--foreman-db-sslmode'
E       u'--certs-ca-common-name'
E       u'--foreman-db-password'
E       u'--foreman-passenger-interface'
E       u'--capsule-parent-fqdn'
E       u'--katello-oauth-secret'
E       u'--foreman-vhost-priority'
E       u'--foreman-oauth-map-users'
E       u'--certs-ssl-build-dir'
E       u'--foreman-oauth-consumer-secret'
E       u'--foreman-http-keytab'
E       u'--foreman-server-ssl-port'
E       u'--foreman-db-host'
E       u'--certs-user'
E       u'--foreman-websockets-ssl-key'
E       u'--foreman-unattended'
E       u'--foreman-server-port'
E       u'--foreman-db-username'
E       u'--foreman-db-port'
E       u'--foreman-authentication'
E       u'--certs-generate'
E       u'--foreman-db-adapter'
E       u'--foreman-websockets-ssl-cert'
E       u'--foreman-configure-epel-repo'
E       u'--foreman-manage-user'
E       u'--foreman-keepalive-timeout'
E       u'--certs-default-ca-name'
E       u'--foreman-websockets-encrypt'
E       u'--certs-deploy'
E       u'--foreman-passenger-min-instances'
E       u'--foreman-selinux'
E       u'--foreman-plugin-version'
E       u'--foreman-passenger-prestart'
E       u'--foreman-server-ssl-key'
E       u'--katello-cdn-ssl-version'
E       u'--foreman-puppet-home'
E       u'--katello-log-dir'
E       u'--foreman-passenger-start-timeout'
E       u'--capsule-enable-ostree'
E       u'--certs-city'
E       u'--foreman-puppet-ssldir'
E       u'--katello-package-names'
E       u'--foreman-group'
E       u'--foreman-db-pool'
E       u'--certs-state'
E       u'--foreman-passenger'
E       u'--foreman-db-database'
E       u'--foreman-keepalive'
E       u'--foreman-server-ssl-certs-dir'
E       u'--foreman-serveraliases'
E       u'--foreman-pam-service'
E       u'--foreman-passenger-ruby-package'
E       u'--foreman-servername'
E       u'--certs-pki-dir'
E       u'--katello-group'
E       u'--foreman-client-ssl-ca'
E       u'--foreman-server-ssl-chain'
E       u'--foreman-user-groups'
E       u'--foreman-configure-scl-repo'
E       u'--foreman-max-keepalive-requests'
E       u'--foreman-rails-env'
E       u'--certs-ca-expiration'
E       u'--foreman-logging-level'
E       u'--katello-user'
E       u'--foreman-oauth-consumer-key'
E       u'--foreman-client-ssl-key'
E       u'--foreman-email-conf'
E       u'--certs-regenerate-ca'
E       u'--foreman-foreman-url'
E       u'--capsule-certs-tar'
E       u'--foreman-use-vhost'
E       u'--foreman-email-source'
E       u'--foreman-custom-repo'
E       u'--katello-config-dir'
E       u'--[no-]enable-capsule'
E       u'--certs-expiration'
E       u'--foreman-passenger-ruby'
E       u'--certs-country'
E       u'--certs-group'
E       u'--foreman-server-ssl-ca'
E       u'--foreman-app-root'
E       u'--capsule-puppet-ca-proxy'
E       u'--capsule-puppet-server-implementation'
E       u'--katello-max-keep-alive'
E       u'--katello-oauth-key'
E       u'--katello-post-sync-token'
E       u'--foreman-oauth-active'
E       u'--foreman-client-ssl-cert'
E       u'--foreman-gpgcheck'
E       u'--certs-regenerate'
E       u'--foreman-plugin-prefix'
E       u'--foreman-user'
E       u'--foreman-server-ssl-crl'
E       u'--capsule-puppet'
E       u'--certs-log-dir'
E       Items in the second set but not the first:
E       u'--puppet-syslogfacility'
E       u'--puppet-ca-server'
E       u'--puppet-hiera-config'
E       u'--puppet-autosign'
E       u'--puppet-manage-packages'
E       u'--puppet-cron-cmd'
E       u'--foreman-proxy-use-sudoers'
E       u'--foreman-plugin-puppetdb-dashboard-address'
E       u'--foreman-proxy-realm-split-config-files'
E       u'--certs-reset'
E       u'--puppet-ca-crl-filepath'
E       u'--foreman-compute-libvirt-version'
E       u'--foreman-plugin-puppetdb-package'
E       u'--foreman-compute-gce-version'
E       u'--puppet-use-srv-records'
E       u'--foreman-compute-rackspace-version'
E       u'--foreman-compute-vmware-version'
E       u'--[no-]enable-foreman-plugin-default-hostgroup'
E       u'--puppet-module-repository'
E       u'--foreman-plugin-puppetdb-ssl-ca-file'
E       u'--puppet-splay'
E       u'--puppet-runmode'
E       u'--[no-]enable-foreman-plugin-chef'
E       u'--puppet-logdir'
E       u'--puppet-unavailable-runmodes'
E       u'--[no-]enable-foreman-compute-vmware'
E       u'--[no-]enable-foreman-plugin-docker'
E       u'--[no-]enable-foreman-compute-openstack'
E       u'--[no-]enable-foreman-plugin-templates'
E       u'--foreman-proxy-freeipa-config'
E       u'--foreman-cli-foreman-url'
E       u'--puppet-rundir'
E       u'--[no-]enable-foreman-plugin-hooks'
E       u'--foreman-proxy-puppet-api-timeout'
E       u'--puppet-srv-domain'
E       u'--[no-]enable-foreman-compute-libvirt'
E       u'--puppet-configtimeout'
E       u'--[no-]parser-cache'
E       u'--foreman-proxy-content-certs-tar'
E       u'--puppet-systemd-cmd'
E       u'--puppet-runinterval'
E       u'--puppet-dir'
E       u'--foreman-proxy-dhcp-pxeserver'
E       u'--puppet-autosign-content'
E       u'--foreman-proxy-plugin-remote-execution-ssh-install-key'
E       u'--puppet-group'
E       u'--disable-resolve-mismatches'
E       u'--puppet-classfile'
E       u'--foreman-cli-username'
E       u'--puppet-dns-alt-names'
E       u'--foreman-proxy-content-enable-ostree'
E       u'--foreman-compute-ovirt-version'
E       u'--foreman-plugin-puppetdb-address'
E       u'--puppet-ssldir'
E       u'--puppet-listen-to'
E       u'--foreman-plugin-puppetdb-ssl-certificate'
E       u'--[no-]enable-foreman-compute-ec2'
E       u'--foreman-proxy-content-parent-fqdn'
E       u'--[no-]enable-foreman-plugin-puppetdb'
E       u'--puppet-show-diff'
E       u'--foreman-plugin-tasks-cron-line'
E       u'--puppet-pluginfactsource'
E       u'--puppet-auth-template'
E       u'--[no-]enable-foreman-compute-gce'
E       u'--[no-]enable-foreman-compute-ovirt'
E       u'--katello-pulp-max-speed'
E       u'--puppet-listen'
E       u'--puppet-vardir'
E       u'--puppet-additional-settings'
E       u'--[no-]enable-foreman-cli'
E       u'--foreman-compute-ec2-version'
E       u'--puppet-pluginsource'
E       u'--puppet-user'
E       u'--puppet-autosign-mode'
E       u'--puppet-port'
E       u'--certs-cname'
E       u'--puppet-version'
E       u'--foreman-plugin-tasks-automatic-cleanup'
E       u'--puppet-main-template'
E       u'--puppet-package-provider'
E       u'--[no-]enable-puppet'
E       u'--puppet-autosign-entries'
E       u'--puppet-splaylimit'
E       u'--foreman-proxy-groups'
E       u'--foreman-compute-openstack-version'
E       u'--foreman-plugin-puppetdb-ssl-private-key'
E       u'--[no-]enable-foreman-proxy-content'
E       u'--puppet-ca-port'
E       u'--puppet-sharedir'
E       u'--puppet-codedir'
E       u'--foreman-cli-password'
E       u'--[no-]enable-foreman-plugin-setup'
E       u'--foreman-proxy-plugin-remote-execution-ssh-ssh-kerberos-auth'
E       u'--puppet-package-source'
E       u'--[no-]enable-foreman-compute-rackspace'
E       u'--puppet-pluginsync'
E       u'--puppet-usecacheonfailure'
E       u'--foreman-proxy-dhcp-manage-acls'

tests/foreman/installer/test_installer.py:370: AssertionError
ntkathole commented 6 years ago

Removing 6.3 flag as PR #5749 merged

san7ket commented 6 years ago

adding 6.3 flag again , newer options added, need to investigate why the options are added though [u'--foreman-proxy-content-qpid-router-ssl-ciphers', u'--foreman-proxy-content-qpid-router-ssl-protocols', u'--foreman-proxy-content-ssl-protocol', u'--foreman-proxy-tls-disabled-versions', u'--foreman-server-ssl-protocol', u'--reset-foreman-proxy-content-qpid-router-ssl-ciphers', u'--reset-foreman-proxy-content-qpid-router-ssl-protocols', u'--reset-foreman-proxy-content-ssl-protocol', u'--reset-foreman-proxy-tls-disabled-versions', u'--reset-foreman-server-ssl-protocol']

vijay8451 commented 6 years ago

Fixed #6515