search

cloudbase / cloudbase-init

Cross-platform instance initialization
http://openstack.org
Apache License 2.0
415 stars 148 forks source link

windows servers images are not returning the passwords back to meta data servers. #41

Open vinay108 opened 4 years ago

vinay108 commented 4 years ago

in openstack environment looking into the logs i can see password plugin is executed and generated the random password by using public key pair. but it did not sent that password back to meta data server http://169.254.169.254 and this issue has been seen in when using the windows defender in windows server images.

ader1990 commented 4 years ago

Hello,

If possible, can you provide the cloudbase-init logs and more information on how you created the Windows image?

After all I know, Windows defender does not interfere with cloudbase-init, but it is possible that Windows firewall can be set (on purpose) to deny egress traffic.

Thank you, Adrian Vladu

vinay108 commented 4 years ago

sure will upload the script which we used to create a image. when i disable the windows defender and restart cloudbase-it service its working so i was suspecting issue with windows defender.

vinay108 commented 4 years ago

2020-03-26 04:54:17.261 3000 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.osutils.windows.WindowsUtils' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:54:21.766 3000 DEBUG cloudbaseinit.osutils.windows [-] Checking if service exists: cloudbase-init check_service_exists C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\osutils\windows.py:1092 2020-03-26 04:54:21.766 3000 DEBUG cloudbaseinit.osutils.windows [-] Getting service username: cloudbase-init get_service_username C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\osutils\windows.py:1225 2020-03-26 04:54:21.766 3000 DEBUG cloudbaseinit.osutils.windows [-] Resetting password for service user: .\cloudbase-init reset_service_password C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\osutils\windows.py:1248 2020-03-26 04:54:23.674 3000 DEBUG cloudbaseinit.osutils.windows [-] Setting service credentials: cloudbase-init set_service_credentials C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\osutils\windows.py:1208 2020-03-26 04:54:23.705 3000 DEBUG cloudbaseinit.init [-] No need to respawn process. Current user: WIN-B7VU3S5C78C$. Service user: cloudbase-init _reset_service_password_and_respawn C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\init.py:141 2020-03-26 04:54:23.724 3000 INFO cloudbaseinit.init [-] Cloudbase-Init version: 1.1.0 2020-03-26 04:54:23.724 3000 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.mtu.MTUPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:54:23.830 3000 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.sethostname.SetHostNamePlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:54:23.877 3000 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.windows.extendvolumes.ExtendVolumesPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:54:24.002 3000 INFO cloudbaseinit.init [-] Executing plugins for stage 'PRE_NETWORKING': 2020-03-26 04:54:24.002 3000 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.mtu.MTUPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:54:24.002 3000 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.sethostname.SetHostNamePlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:54:24.018 3000 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.windows.extendvolumes.ExtendVolumesPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:54:24.018 3000 INFO cloudbaseinit.init [-] Executing plugins for stage 'PRE_METADATA_DISCOVERY': 2020-03-26 04:54:24.018 3000 INFO cloudbaseinit.init [-] Executing plugin 'MTUPlugin' 2020-03-26 04:54:24.018 3000 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.osutils.windows.WindowsUtils' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:54:24.049 3000 DEBUG cloudbaseinit.osutils.windows [-] Setting MTU for interface "Ethernet" with value "1500" set_network_adapter_mtu C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\osutils\windows.py:843 2020-03-26 04:54:25.613 3000 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.metadata.services.configdrive.ConfigDriveService' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:54:25.847 3000 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.metadata.services.osconfigdrive.windows.WindowsConfigDriveManager' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:54:25.925 3000 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.osutils.windows.WindowsUtils' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:54:25.925 3000 DEBUG cloudbaseinit.metadata.services.osconfigdrive.windows [-] Looking for Config Drive vfat in hdd get_config_drive_files C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\metadata\services\osconfigdrive\windows.py:207 2020-03-26 04:54:26.848 3000 DEBUG cloudbaseinit.utils.windows.vfat [-] Could not retrieve label for VFAT drive path '\\.\PHYSICALDRIVE0' is_vfat_drive C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\windows\vfat.py:46 2020-03-26 04:54:26.863 3000 DEBUG cloudbaseinit.utils.windows.vfat [-] mlabel failed with error b"init :: sector size (190) not a small power of two\r\nCannot initialize '::'\r\nC:\Program Files\Cloudbase Solutions\Cloudbase-Init\bin\mlabel: Cannot initialize drive\r\n" is_vfat_drive C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\windows\vfat.py:47 2020-03-26 04:54:26.863 3000 DEBUG cloudbaseinit.metadata.services.osconfigdrive.windows [-] Looking for Config Drive vfat in partition get_config_drive_files C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\metadata\services\osconfigdrive\windows.py:207 2020-03-26 04:54:26.880 3000 DEBUG cloudbaseinit.metadata.services.osconfigdrive.windows [-] Looking for a Config Drive with label 'config-2' on '\?\Volume{66e56217-0000-0000-0000-100000000000}\'. Found mismatching label 'OS'. _check_for_config_drive C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\metadata\services\osconfigdrive\windows.py:64 2020-03-26 04:54:26.880 3000 DEBUG cloudbaseinit.metadata.services.osconfigdrive.windows [-] Looking for Config Drive vfat in cdrom get_config_drive_files C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\metadata\services\osconfigdrive\windows.py:207 2020-03-26 04:54:26.895 3000 DEBUG cloudbaseinit.metadata.services.osconfigdrive.windows [-] Irrelevant type vfat in cdrom location; skip _get_config_drive_files C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\metadata\services\osconfigdrive\windows.py:191 2020-03-26 04:54:26.895 3000 DEBUG cloudbaseinit.metadata.services.osconfigdrive.windows [-] Looking for Config Drive iso in hdd get_config_drive_files C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\metadata\services\osconfigdrive\windows.py:207 2020-03-26 04:54:26.910 3000 DEBUG cloudbaseinit.metadata.services.osconfigdrive.windows [-] Looking for Config Drive iso in partition get_config_drive_files C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\metadata\services\osconfigdrive\windows.py:207 2020-03-26 04:54:30.553 3000 WARNING cloudbaseinit.metadata.services.osconfigdrive.windows [-] ISO extraction failed on <Partition: \?\GLOBALROOT\Device\Harddisk0\Partition1> with WindowsCloudbaseInitException("Cannot open file: 'The process cannot access the file because it is being used by another process.'",): cloudbaseinit.exception.WindowsCloudbaseInitException: Cannot open file: 'The process cannot access the file because it is being used by another process.' 2020-03-26 04:54:30.569 3000 DEBUG cloudbaseinit.metadata.services.osconfigdrive.windows [-] Looking for Config Drive iso in cdrom get_config_drive_files C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\metadata\services\osconfigdrive\windows.py:207 2020-03-26 04:54:30.585 3000 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.metadata.services.httpservice.HttpService' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:54:30.647 3000 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.osutils.windows.WindowsUtils' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:54:30.663 3000 DEBUG cloudbaseinit.metadata.services.base [-] Executing http request GET at http://169.254.169.254/openstack/latest/meta_data.json _http_request C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\metadata\services\base.py:315 2020-03-26 04:54:31.413 3000 INFO cloudbaseinit.init [-] Metadata service loaded: 'HttpService' 2020-03-26 04:54:31.413 3000 DEBUG cloudbaseinit.metadata.services.base [-] Using cached copy of metadata: 'openstack/latest/meta_data.json' _get_cache_data C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\metadata\services\base.py:74 2020-03-26 04:54:31.429 3000 DEBUG cloudbaseinit.init [-] Instance id: b3a07fab-a7b1-4bac-be89-5a8a0fd3f14b configure_host C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\init.py:202 2020-03-26 04:54:31.429 3000 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.mtu.MTUPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:54:31.429 3000 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.sethostname.SetHostNamePlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:54:31.444 3000 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.windows.extendvolumes.ExtendVolumesPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:54:31.444 3000 INFO cloudbaseinit.init [-] Executing plugins for stage 'MAIN': 2020-03-26 04:54:31.444 3000 INFO cloudbaseinit.init [-] Executing plugin 'SetHostNamePlugin' 2020-03-26 04:54:31.444 3000 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.osutils.windows.WindowsUtils' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:54:31.460 3000 DEBUG cloudbaseinit.metadata.services.base [-] Using cached copy of metadata: 'openstack/latest/meta_data.json' _get_cache_data C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\metadata\services\base.py:74 2020-03-26 04:54:31.460 3000 WARNING cloudbaseinit.utils.hostname [-] Truncating host name for Netbios compatibility. Old name: windows-tanium-1, new name: windows-tanium- 2020-03-26 04:54:31.476 3000 INFO cloudbaseinit.utils.hostname [-] Setting hostname: windows-tanium0 2020-03-26 04:54:31.585 3000 INFO cloudbaseinit.init [-] Executing plugin 'ExtendVolumesPlugin' 2020-03-26 04:54:31.601 3000 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.osutils.windows.WindowsUtils' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:54:31.601 3000 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.utils.windows.storage.vds_storage_manager.VDSStorageManager' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:54:34.681 3000 INFO cloudbaseinit.utils.windows.storage.vds_storage_manager [-] Extending volume "\?\GLOBALROOT\Device\HarddiskVolume1" with 2040528896 bytes 2020-03-26 04:54:34.821 3000 INFO cloudbaseinit.init [-] Plugins execution done 2020-03-26 04:55:34.496 3340 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.osutils.windows.WindowsUtils' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:36.293 3340 DEBUG cloudbaseinit.osutils.windows [-] Checking if service exists: cloudbase-init check_service_exists C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\osutils\windows.py:1092 2020-03-26 04:55:36.310 3340 DEBUG cloudbaseinit.osutils.windows [-] Getting service username: cloudbase-init get_service_username C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\osutils\windows.py:1225 2020-03-26 04:55:36.310 3340 DEBUG cloudbaseinit.osutils.windows [-] Resetting password for service user: .\cloudbase-init reset_service_password C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\osutils\windows.py:1248 2020-03-26 04:55:36.372 3340 DEBUG cloudbaseinit.osutils.windows [-] Setting service credentials: cloudbase-init set_service_credentials C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\osutils\windows.py:1208 2020-03-26 04:55:37.695 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.osutils.windows.WindowsUtils' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:38.088 3824 INFO cloudbaseinit.init [-] Cloudbase-Init version: 1.1.0 2020-03-26 04:55:38.088 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.mtu.MTUPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:38.151 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.windows.ntpclient.NTPClientPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:38.214 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.sethostname.SetHostNamePlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:38.230 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.windows.createuser.CreateUserPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:38.293 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.networkconfig.NetworkConfigPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:38.356 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.windows.licensing.WindowsLicensingPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:38.434 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.sshpublickeys.SetUserSSHPublicKeysPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:38.466 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.windows.extendvolumes.ExtendVolumesPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:38.482 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.userdata.UserDataPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:38.686 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.setuserpassword.SetUserPasswordPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:38.875 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.windows.winrmlistener.ConfigWinRMListenerPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:39.316 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.windows.winrmcertificateauth.ConfigWinRMCertificateAuthPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:39.347 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.localscripts.LocalScriptsPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:39.395 3824 INFO cloudbaseinit.init [-] Executing plugins for stage 'PRE_NETWORKING': 2020-03-26 04:55:39.410 3824 INFO cloudbaseinit.init [-] Executing plugin 'NTPClientPlugin' 2020-03-26 04:55:39.410 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.osutils.windows.WindowsUtils' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:39.410 3824 DEBUG cloudbaseinit.osutils.windows [-] Getting service start mode for: w32time get_service_start_mode C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\osutils\windows.py:1112 2020-03-26 04:55:40.133 3824 DEBUG cloudbaseinit.osutils.windows [-] Getting service status for: w32time get_service_status C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\osutils\windows.py:1102 2020-03-26 04:55:40.149 3824 INFO cloudbaseinit.plugins.common.ntpclient [-] NTP client service enabled 2020-03-26 04:55:40.165 3824 DEBUG cloudbaseinit.plugins.common.ntpclient [-] Could not obtain the NTP configuration via DHCP execute C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\plugins\common\ntpclient.py:71 2020-03-26 04:55:40.165 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.mtu.MTUPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:40.180 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.windows.ntpclient.NTPClientPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:40.180 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.sethostname.SetHostNamePlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:40.180 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.windows.createuser.CreateUserPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:40.196 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.networkconfig.NetworkConfigPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:40.196 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.windows.licensing.WindowsLicensingPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:40.212 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.sshpublickeys.SetUserSSHPublicKeysPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:40.212 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.windows.extendvolumes.ExtendVolumesPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:40.212 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.userdata.UserDataPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:40.228 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.setuserpassword.SetUserPasswordPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:40.228 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.windows.winrmlistener.ConfigWinRMListenerPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:40.244 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.windows.winrmcertificateauth.ConfigWinRMCertificateAuthPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:40.244 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.localscripts.LocalScriptsPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:40.244 3824 INFO cloudbaseinit.init [-] Executing plugins for stage 'PRE_METADATA_DISCOVERY': 2020-03-26 04:55:40.259 3824 INFO cloudbaseinit.init [-] Executing plugin 'MTUPlugin' 2020-03-26 04:55:40.259 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.osutils.windows.WindowsUtils' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:40.275 3824 DEBUG cloudbaseinit.osutils.windows [-] Setting MTU for interface "Ethernet" with value "1500" set_network_adapter_mtu C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\osutils\windows.py:843 2020-03-26 04:55:40.841 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.metadata.services.httpservice.HttpService' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:40.872 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.osutils.windows.WindowsUtils' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:40.872 3824 DEBUG cloudbaseinit.metadata.services.base [-] Executing http request GET at http://169.254.169.254/openstack/latest/meta_data.json _http_request C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\metadata\services\base.py:315 2020-03-26 04:55:42.051 3824 INFO cloudbaseinit.init [-] Metadata service loaded: 'HttpService' 2020-03-26 04:55:42.051 3824 DEBUG cloudbaseinit.metadata.services.base [-] Using cached copy of metadata: 'openstack/latest/meta_data.json' _get_cache_data C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\metadata\services\base.py:74 2020-03-26 04:55:42.067 3824 DEBUG cloudbaseinit.init [-] Instance id: b3a07fab-a7b1-4bac-be89-5a8a0fd3f14b configure_host C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\init.py:202 2020-03-26 04:55:42.067 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.mtu.MTUPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:42.067 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.windows.ntpclient.NTPClientPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:42.082 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.sethostname.SetHostNamePlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:42.082 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.windows.createuser.CreateUserPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:42.098 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.networkconfig.NetworkConfigPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:42.098 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.windows.licensing.WindowsLicensingPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:42.114 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.sshpublickeys.SetUserSSHPublicKeysPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:42.114 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.windows.extendvolumes.ExtendVolumesPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:42.114 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.userdata.UserDataPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:42.130 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.setuserpassword.SetUserPasswordPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:42.130 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.windows.winrmlistener.ConfigWinRMListenerPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:42.145 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.windows.winrmcertificateauth.ConfigWinRMCertificateAuthPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:42.145 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.plugins.common.localscripts.LocalScriptsPlugin' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:42.145 3824 INFO cloudbaseinit.init [-] Executing plugins for stage 'MAIN': 2020-03-26 04:55:42.161 3824 DEBUG cloudbaseinit.init [-] Plugin 'SetHostNamePlugin' execution already done, skipping _exec_plugin C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\init.py:62 2020-03-26 04:55:42.161 3824 INFO cloudbaseinit.init [-] Executing plugin 'CreateUserPlugin' 2020-03-26 04:55:42.161 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.osutils.windows.WindowsUtils' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:42.177 3824 INFO cloudbaseinit.plugins.common.createuser [-] Creating user "Admin" and setting password 2020-03-26 04:55:42.224 3824 DEBUG cloudbaseinit.osutils.windows [-] Creating logon session for user: True\Admin create_user_logon_session C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\osutils\windows.py:649 2020-03-26 04:55:47.750 3824 INFO cloudbaseinit.init [-] Executing plugin 'NetworkConfigPlugin' 2020-03-26 04:55:47.750 3824 DEBUG cloudbaseinit.metadata.services.base [-] Executing http request GET at http://169.254.169.254/openstack/latest/network_data.json _http_request C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\metadata\services\base.py:315 2020-03-26 04:55:49.585 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.osutils.windows.WindowsUtils' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:49.585 3824 INFO cloudbaseinit.plugins.common.networkconfig [-] Renaming network adapter "Ethernet" to "tap30561dc9-50" 2020-03-26 04:55:51.075 3824 DEBUG cloudbaseinit.plugins.common.networkconfig [-] Setting MTU on network adapter "tap30561dc9-50": 1550 _process_link_common C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\plugins\common\networkconfig.py:182 2020-03-26 04:55:51.090 3824 DEBUG cloudbaseinit.osutils.windows [-] Setting MTU for interface "tap30561dc9-50" with value "1550" set_network_adapter_mtu C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\osutils\windows.py:843 2020-03-26 04:55:51.905 3824 DEBUG cloudbaseinit.plugins.common.networkconfig [-] Enable network adapter "tap30561dc9-50": True _process_link_common C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\plugins\common\networkconfig.py:187 2020-03-26 04:55:51.999 3824 INFO cloudbaseinit.init [-] Executing plugin 'WindowsLicensingPlugin' 2020-03-26 04:55:51.999 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.osutils.windows.WindowsUtils' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:51.999 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.osutils.windows.WindowsUtils' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:52.783 3824 INFO cloudbaseinit.plugins.windows.licensing [-] Evaluation license, skipping activation. Evaluation end date: 1601-01-01 00:00:00 2020-03-26 04:55:52.783 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.osutils.windows.WindowsUtils' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:53.801 3824 INFO cloudbaseinit.plugins.windows.licensing [-] Microsoft Windows license info: Microsoft (R) Windows Script Host Version 5.812 Copyright (C) Microsoft Corporation. All rights reserved.

Software licensing service version: 10.0.14393.3541

Name: Windows(R), ServerDatacenter edition Description: Windows(R) Operating System, VOLUME_KMSCLIENT channel Activation ID: 21c56779-b449-4d20-adfc-eece0e1ad74b Application ID: 55c92734-d682-4d71-983e-d6ec3f16059f Extended PID: 03612-03764-000-000000-03-1033-14393.0000-0862020 Product Key Channel: Volume:GVLK Installation ID: 366794310806304838336045284501120947862176252843520533728972084 Partial Product Key: 8XDDG License Status: Notification Notification Reason: 0xC004F056. Remaining Windows rearm count: 1000 Remaining SKU rearm count: 1000 Trusted time: 3/26/2020 4:55:53 AM Configured Activation Type: All Please use slmgr.vbs /ato to activate and update KMS client information in order to update values.

2020-03-26 04:55:53.832 3824 INFO cloudbaseinit.init [-] Executing plugin 'SetUserSSHPublicKeysPlugin' 2020-03-26 04:55:53.832 3824 DEBUG cloudbaseinit.metadata.services.base [-] Using cached copy of metadata: 'openstack/latest/meta_data.json' _get_cache_data C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\metadata\services\base.py:74 2020-03-26 04:55:53.832 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.osutils.windows.WindowsUtils' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:53.848 3824 DEBUG cloudbaseinit.plugins.common.sshpublickeys [-] User home: C:\Users\Admin execute C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\plugins\common\sshpublickeys.py:45 2020-03-26 04:55:53.848 3824 INFO cloudbaseinit.plugins.common.sshpublickeys [-] Writing SSH public keys in: C:\Users\Admin.ssh\authorized_keys 2020-03-26 04:55:53.848 3824 INFO cloudbaseinit.init [-] Executing plugin 'ExtendVolumesPlugin' 2020-03-26 04:55:53.864 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.osutils.windows.WindowsUtils' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:53.864 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.utils.windows.storage.vds_storage_manager.VDSStorageManager' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:55:57.842 3824 INFO cloudbaseinit.init [-] Executing plugin 'UserDataPlugin' 2020-03-26 04:55:57.857 3824 DEBUG cloudbaseinit.metadata.services.base [-] Executing http request GET at http://169.254.169.254/openstack/latest/user_data _http_request C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\metadata\services\base.py:315 2020-03-26 04:56:03.226 3824 INFO cloudbaseinit.init [-] Executing plugin 'SetUserPasswordPlugin' 2020-03-26 04:56:03.242 3824 DEBUG cloudbaseinit.utils.classloader [-] Loading class 'cloudbaseinit.osutils.windows.WindowsUtils' load_class C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\utils\classloader.py:27 2020-03-26 04:56:03.242 3824 DEBUG cloudbaseinit.metadata.services.base [-] Using cached copy of metadata: 'openstack/latest/meta_data.json' _get_cache_data C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\metadata\services\base.py:74 2020-03-26 04:56:03.273 3824 INFO cloudbaseinit.plugins.common.setuserpassword [-] Password succesfully updated for user Admin 2020-03-26 04:56:03.289 3824 DEBUG cloudbaseinit.metadata.services.base [-] Executing http request GET at http://169.254.169.254/openstack/2013-04-04/meta_data.json _http_request C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\metadata\services\base.py:315

ader1990 commented 4 years ago

Hello @vinay108,

Can you share the cloudbase-init logs after 

2020-03-26 04:56:03.289 3824 DEBUG cloudbaseinit.metadata.services.base [-] Executing http request GET at http://169.254.169.254/openstack/2013-04-04/meta_data.json _http_request C:\Program Files\Cloudbase Solutions\Cloudbase-Init\Python\lib\site-packages\cloudbaseinit\metadata\services\base.py:315

?

The important logs for checking what went wrong with the password post to the metadata service is coming right after the last line that you shared.

Please use a pastebin or paste.openstack.org service for sharing logs, for better readability.

Thank you, Adrian Vladu

vinay108 commented 4 years ago

HI Adrian, first thing there were no logs after that line. I too expect http calls to meta data server to post the generated password,after waiting couple of hours also it did not go to next step. On my guess i tried with cloudbase .9.11 release which works fine.

Here is bit extra information: currently i am using openstack ocata version. if i try multiple vms creation lets say number of counts to more than 2 then also i see same issues.. creating 1 or 2 instances at a time with .9.11 version is working. windows firewall is turned off by default.

ader1990 commented 4 years ago

It might be an issue of a blocking HTTP request, which is not properly retried. Or a possible issue with the underlying version of the python submodules that perform the HTTP requests.

I will try to reproduce this issue in order to get to the cause of the issue.

Can you check in the logs of cloudbase-init 0.9.11 if the password posting fails at first, then gets retried and eventually succeeds?

vinay108 commented 4 years ago

here is the logs for 0.9.11 https://paste.ubuntu.com/p/pwZzM2QDGM/

ader1990 commented 4 years ago

Hello,

I have compared the libraries responsible for the HTTP requests between versions, but I could not find in their respective changelogs any clue on why the behaviour differs. More debugging is required on this one, and it would be great to reproduce this issue with a small change in the cloudbase-init code, where the connection timeout is set to a few seconds.

The packages and versions are:

For v0.9.11: requests: 2.13.0 urllib3==1.20 (bundled inside requests)

For v1.1.0: requests==2.23.0 urllib3==1.25.8

Would you be able to run a test with a custom cloudbase-init build?

Thank you, Adrian Vladu