search

autopkg / dataJAR-recipes

Elegant and powerful Apple services for business and education.
https://www.datajar.co.uk
Apache License 2.0
113 stars 80 forks source link

VMware Fusion 13.download recipe failing #333

Closed rtrouton closed 3 months ago

rtrouton commented 3 months ago

With Broadcom's recent backend changes, It looks like the VMware Fusion 13.download recipe is now failing because the URL text search is no longer matching. Verbose output below:

username@computername ~ % autopkg run "com.github.dataJAR-recipes.download.VMware Fusion 13" -vvvv
Processing com.github.dataJAR-recipes.download.VMware Fusion 13...
WARNING: com.github.dataJAR-recipes.download.VMware Fusion 13 is missing trust info and FAIL_RECIPES_WITHOUT_TRUST_INFO is not set. Proceeding...
{'API_PASSWORD': 'api_password_goes_here',
 'API_USERNAME': 'api_username_goes_here',
 'AUTOPKG_VERSION': '2.7.2',
 'JSS_URL': 'https://jamf.pro.server.here',
 'PARENT_RECIPES': [],
 'RECIPE_CACHE_DIR': '/Users/username/Library/AutoPkg/Cache/com.github.dataJAR-recipes.download.VMware '
                     'Fusion 13',
 'RECIPE_DIR': '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.dataJAR-recipes/VMware '
               'Fusion 13',
 'RECIPE_OVERRIDE_DIRS': ['~/Library/AutoPkg/RecipeOverrides'],
 'RECIPE_PATH': '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.dataJAR-recipes/VMware '
                'Fusion 13/VMware Fusion 13.download.recipe',
 'RECIPE_REPOS': {'/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.Yohan460-recipes': {'URL': 'https://github.com/autopkg/Yohan460-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.andrewvalentine-recipes': {'URL': 'https://github.com/autopkg/andrewvalentine-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.apettinen-recipes': {'URL': 'https://github.com/autopkg/apettinen-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.apizz-recipes': {'URL': 'https://github.com/autopkg/apizz-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.bkerns-recipes': {'URL': 'https://github.com/autopkg/bkerns-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.bnpl-recipes': {'URL': 'https://github.com/autopkg/bnpl-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.cgerke-recipes': {'URL': 'https://github.com/autopkg/cgerke-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.dataJAR-recipes': {'URL': 'https://github.com/autopkg/dataJAR-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.foigus-recipes': {'URL': 'https://github.com/autopkg/foigus-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.golbiga-recipes': {'URL': 'https://github.com/autopkg/golbiga-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.grahamgilbert-recipes': {'URL': 'https://github.com/autopkg/grahamgilbert-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.grahampugh-recipes': {'URL': 'https://github.com/autopkg/grahampugh-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.hansen-m-recipes': {'URL': 'https://github.com/autopkg/hansen-m-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.hjuutilainen-recipes': {'URL': 'https://github.com/autopkg/hjuutilainen-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.homebysix-recipes': {'URL': 'https://github.com/autopkg/homebysix-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.jleggat-recipes': {'URL': 'https://github.com/autopkg/jleggat-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.joshua-d-miller-recipes': {'URL': 'https://github.com/autopkg/joshua-d-miller-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.justinrummel-recipes': {'URL': 'https://github.com/autopkg/justinrummel-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.killahquam-recipes': {'URL': 'https://github.com/autopkg/killahquam-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.moofit-recipes': {'URL': 'https://github.com/autopkg/moofit-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.mosen-recipes': {'URL': 'https://github.com/autopkg/mosen-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.n8felton-recipes': {'URL': 'https://github.com/autopkg/n8felton-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.novaksam-recipes': {'URL': 'https://github.com/autopkg/novaksam-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.patgmac-recipes': {'URL': 'https://github.com/autopkg/patgmac-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.paul-cossey-recipes': {'URL': 'https://github.com/autopkg/paul-cossey-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.peshay-recipes': {'URL': 'https://github.com/autopkg/peshay-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.recipes': {'URL': 'https://github.com/autopkg/recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.rtrouton-recipes': {'URL': 'https://github.com/autopkg/rtrouton-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.rustymyers-recipes': {'URL': 'https://github.com/autopkg/rustymyers-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.scriptingosx-recipes': {'URL': 'https://github.com/autopkg/scriptingosx-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.smithjw-recipes': {'URL': 'https://github.com/autopkg/smithjw-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.tbridge-recipes': {'URL': 'https://github.com/autopkg/tbridge-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.timsutton-recipes': {'URL': 'https://github.com/autopkg/timsutton-recipes'},
                  '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.triti-recipes': {'URL': 'https://github.com/autopkg/triti-recipes'}},,
 'RECIPE_SEARCH_DIRS': ['.',
                        '~/Library/AutoPkg/Recipes',
                        '/Library/AutoPkg/Recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.apettinen-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.bkerns-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.bnpl-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.cgerke-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.foigus-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.golbiga-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.grahamgilbert-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.hansen-m-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.hjuutilainen-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.homebysix-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.jleggat-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.joshua-d-miller-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.justinrummel-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.killahquam-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.mosen-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.n8felton-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.novaksam-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.rustymyers-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.scriptingosx-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.smithjw-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.tbridge-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.timsutton-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.peshay-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.patgmac-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.dataJAR-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.triti-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.paul-cossey-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.Yohan460-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.andrewvalentine-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.moofit-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.apizz-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.grahampugh-recipes',
                        '/Users/username/Library/AutoPkg/RecipeRepos/com.github.autopkg.rtrouton-recipes'],
 'verbose': 4}
URLTextSearcher
{'Input': {'re_pattern': '{\\"name\\":\\"VMware Fusion '
                         '13.*\\",\\"dlgList\\":\\[{\\".*\\",\\"code\\":\\"(?P<download_group>FUS-\\d.*)\\",\\"releaseDate\\":\\".*\\",\\"productId\\":\\".*\\",\\"releasePackageId\\":\\".*\\",\\"isFirmwareImage\\":.*,\\"orderId\\":.*}',
           'url': 'https://my.vmware.com/channel/public/api/v1.0/products/getRelatedDLGList?locale=en_US&category=desktop_end_user_computing&product=vmware_fusion&version=13_0&dlgType=PRODUCT_BINARY'}}
URLTextSearcher: No value supplied for result_output_var_name, setting default value of: match
URLTextSearcher: Curl command: ['/usr/bin/curl', '--compressed', '--location', 'https://my.vmware.com/channel/public/api/v1.0/products/getRelatedDLGList?locale=en_US&category=desktop_end_user_computing&product=vmware_fusion&version=13_0&dlgType=PRODUCT_BINARY']
Traceback (most recent call last):
  File "/Library/AutoPkg/autopkglib/__init__.py", line 840, in process
    self.env = processor.process()
  File "/Library/AutoPkg/autopkglib/__init__.py", line 626, in process
    self.main()
  File "/Library/AutoPkg/autopkglib/URLTextSearcher.py", line 122, in main
    groupmatch, groupdict = self.re_search(content)
  File "/Library/AutoPkg/autopkglib/URLTextSearcher.py", line 109, in re_search
    raise ProcessorError(f"{NO_MATCH_MESSAGE}: {self.env['url']}")
autopkglib.ProcessorError: No match found on URL: https://my.vmware.com/channel/public/api/v1.0/products/getRelatedDLGList?locale=en_US&category=desktop_end_user_computing&product=vmware_fusion&version=13_0&dlgType=PRODUCT_BINARY
  File "/Library/AutoPkg/autopkglib/__init__.py", line 840, in process
    self.env = processor.process()
No match found on URL: https://my.vmware.com/channel/public/api/v1.0/products/getRelatedDLGList?locale=en_US&category=desktop_end_user_computing&product=vmware_fusion&version=13_0&dlgType=PRODUCT_BINARY
Failed.
Receipt written to /Users/username/Library/AutoPkg/Cache/com.github.dataJAR-recipes.download.VMware Fusion 13/receipts/com.github.dataJAR-recipes.download-receipt-20240507-115545.plist

The following recipes failed:
    com.github.dataJAR-recipes.download.VMware Fusion 13
        Error in com.github.dataJAR-recipes.download.VMware Fusion 13: Processor: URLTextSearcher: Error: No match found on URL: https://my.vmware.com/channel/public/api/v1.0/products/getRelatedDLGList?locale=en_US&category=desktop_end_user_computing&product=vmware_fusion&version=13_0&dlgType=PRODUCT_BINARY

Nothing downloaded, packaged or imported.
username@computername ~ %
paul-cossey commented 3 months ago

I dug in to a different VMware recipe this morning and posted the below. I think we're stuck with broken recipes until after the 13th of May

https://github.com/autopkg/scriptingosx-recipes/issues/100

According to this KB It's possible downloads are only temporarily unavailable until May 13th while systems are migrated.

This looks like the new download page: https://customerconnect.omnissa.com/downloads/#my_products

This section of the site is temporarily inaccessible. Please come back after this time. We apologize for the inconvenience.

Best Regards, The VMware Team

paul-cossey commented 3 months ago

Looks like the download for VMware Fusion is now behind a login window.

https://blogs.vmware.com/teamfusion/2024/05/fusion-pro-now-available-free-for-personal-use.html

paul-cossey commented 3 months ago

Download recipe has been updated now, please see: https://github.com/autopkg/dataJAR-recipes/compare/fe6ee78c8659...205a15de3c5b