autopkg / joshua-d-miller-recipes

My recipes for autopkg https://github.com/autopkg
13 stars 45 forks source link

Update Unity3D.download.recipe #166

Open paul-cossey opened 4 months ago

paul-cossey commented 4 months ago

Hi, @joshua-d-miller

The Unity3D download recipe is currently failing with the below error

The following recipes failed:
    Unity3D.munki.recipe
        Error in com.github.joshua-d-miller.autopkg.munki.Unity3D: Processor: URLTextSearcher: Error: No match found on URL: https://unity.com/releases/editor/archive

This PR...

Output from a successful -vv run

autopkg run -vv Unity3D.munki.recipe 
Looking for com.github.joshua-d-miller.autopkg.download.Unity3D...
Did not find com.github.joshua-d-miller.autopkg.download.Unity3D in recipe map
Rebuilding recipe map with current working directories...
Looking for com.github.joshua-d-miller.autopkg.download.Unity3D...
Found com.github.joshua-d-miller.autopkg.download.Unity3D in recipe map
**load_recipe time: 0.007533374999184161
Processing Unity3D.munki.recipe...
WARNING: Unity3D.munki.recipe is missing trust info and FAIL_RECIPES_WITHOUT_TRUST_INFO is not set. Proceeding...
URLTextSearcher
{'Input': {'re_pattern': 'unityhub://(?P<VERSION>2023\\.[fp\\d\\.]+)/(?P<DEEP_LINK>[a-f0-9]+)',
           'url': 'https://unity.com/releases/editor/archive'}}
URLTextSearcher: No value supplied for result_output_var_name, setting default value of: match
URLTextSearcher: Found matching text (VERSION): 2023.2.20f1
URLTextSearcher: Found matching text (DEEP_LINK): 0e25a174756c
URLTextSearcher: Found matching text (match): 0e25a174756c
{'Output': {'DEEP_LINK': '0e25a174756c',
            'VERSION': '2023.2.20f1',
            'match': '0e25a174756c'}}
URLDownloader
{'Input': {'filename': 'Unity 3D.pkg',
           'request_headers': {'Referer': 'https://unity.com/releases/editor/archive;auto',
                               'user-agent': 'Mozilla/5.0 (Macintosh; Intel '
                                             'Mac OS X 10_15_7) '
                                             'AppleWebKit/605.1.15 (KHTML, '
                                             'like Gecko) Version/17.4.1 '
                                             'Safari/605.1.15'},
           'url': 'https://download.unity3d.com/download_unity/0e25a174756c/MacEditorInstaller/Unity-2023.2.20f1.pkg'}}
URLDownloader: No value supplied for prefetch_filename, setting default value of: False
URLDownloader: No value supplied for CHECK_FILESIZE_ONLY, setting default value of: False
URLDownloader: Storing new Last-Modified header: Thu, 25 Apr 2024 08:09:05 GMT
URLDownloader: Storing new ETag header: "8f71176be3b8f9354eb9b3ea18627d70"
URLDownloader: Downloaded /Users/paul.cossey/Library/AutoPkg/Cache/com.github.joshua-d-miller.autopkg.munki.Unity3D/downloads/Unity 3D.pkg
{'Output': {'download_changed': True,
            'etag': '"8f71176be3b8f9354eb9b3ea18627d70"',
            'last_modified': 'Thu, 25 Apr 2024 08:09:05 GMT',
            'pathname': '/Users/paul.cossey/Library/AutoPkg/Cache/com.github.joshua-d-miller.autopkg.munki.Unity3D/downloads/Unity '
                        '3D.pkg',
            'url_downloader_summary_result': {'data': {'download_path': '/Users/paul.cossey/Library/AutoPkg/Cache/com.github.joshua-d-miller.autopkg.munki.Unity3D/downloads/Unity '
                                                                        '3D.pkg'},
                                              'summary_text': 'The following '
                                                              'new items were '
                                                              'downloaded:'}}}
CodeSignatureVerifier
{'Input': {'expected_authority_names': ['Developer ID Installer: Unity '
                                        'Technologies SF (9QW8UQUTAA)',
                                        'Developer ID Certification Authority',
                                        'Apple Root CA'],
           'input_path': '/Users/paul.cossey/Library/AutoPkg/Cache/com.github.joshua-d-miller.autopkg.munki.Unity3D/downloads/Unity '
                         '3D.pkg'}}
CodeSignatureVerifier: Verifying installer package signature...
CodeSignatureVerifier: Package "Unity 3D.pkg":
CodeSignatureVerifier:    Status: signed by a developer certificate issued by Apple for distribution
CodeSignatureVerifier:    Signed with a trusted timestamp on: 2024-04-19 18:14:29 +0000
CodeSignatureVerifier:    Certificate Chain:
CodeSignatureVerifier:     1. Developer ID Installer: Unity Technologies SF (9QW8UQUTAA)
CodeSignatureVerifier:        Expires: 2027-02-01 22:12:15 +0000
CodeSignatureVerifier:        SHA256 Fingerprint:
CodeSignatureVerifier:            B5 62 C9 70 C2 5E 3F 53 54 F7 D3 B5 48 49 8F 86 43 99 D3 02 E3 9F 
CodeSignatureVerifier:            0B 03 6F 0D FD 22 04 88 E5 25
CodeSignatureVerifier:        ------------------------------------------------------------------------
CodeSignatureVerifier:     2. Developer ID Certification Authority
CodeSignatureVerifier:        Expires: 2027-02-01 22:12:15 +0000
CodeSignatureVerifier:        SHA256 Fingerprint:
CodeSignatureVerifier:            7A FC 9D 01 A6 2F 03 A2 DE 96 37 93 6D 4A FE 68 09 0D 2D E1 8D 03 
CodeSignatureVerifier:            F2 9C 88 CF B0 B1 BA 63 58 7F
CodeSignatureVerifier:        ------------------------------------------------------------------------
CodeSignatureVerifier:     3. Apple Root CA
CodeSignatureVerifier:        Expires: 2035-02-09 21:40:36 +0000
CodeSignatureVerifier:        SHA256 Fingerprint:
CodeSignatureVerifier:            B0 B1 73 0E CB C7 FF 45 05 14 2C 49 F1 29 5E 6E DA 6B CA ED 7E 2C 
CodeSignatureVerifier:            68 C5 BE 91 B5 A1 10 01 F0 24
CodeSignatureVerifier: 
CodeSignatureVerifier: Signature is valid
CodeSignatureVerifier: Authority name chain is valid
{'Output': {}}
EndOfCheckPhase
{'Input': {}}
{'Output': {}}
FlatPkgUnpacker
{'Input': {'destination_path': '/Users/paul.cossey/Library/AutoPkg/Cache/com.github.joshua-d-miller.autopkg.munki.Unity3D/Unpack/',
           'flat_pkg_path': '/Users/paul.cossey/Library/AutoPkg/Cache/com.github.joshua-d-miller.autopkg.munki.Unity3D/Downloads/Unity '
                            '3D.pkg'}}
FlatPkgUnpacker: Unpacked /Users/paul.cossey/Library/AutoPkg/Cache/com.github.joshua-d-miller.autopkg.munki.Unity3D/Downloads/Unity 3D.pkg to /Users/paul.cossey/Library/AutoPkg/Cache/com.github.joshua-d-miller.autopkg.munki.Unity3D/Unpack/
{'Output': {}}
PkgRootCreator
{'Input': {'pkgdirs': {},
           'pkgroot': '/Users/paul.cossey/Library/AutoPkg/Cache/com.github.joshua-d-miller.autopkg.munki.Unity3D/application_payload/Applications'}}
PkgRootCreator: Created /Users/paul.cossey/Library/AutoPkg/Cache/com.github.joshua-d-miller.autopkg.munki.Unity3D/application_payload/Applications
{'Output': {}}
PkgPayloadUnpacker
{'Input': {'destination_path': '/Users/paul.cossey/Library/AutoPkg/Cache/com.github.joshua-d-miller.autopkg.munki.Unity3D/application_payload/Applications',
           'pkg_payload_path': '/Users/paul.cossey/Library/AutoPkg/Cache/com.github.joshua-d-miller.autopkg.munki.Unity3D/Unpack/Unity.pkg.tmp/Payload',
           'purge_destination': True}}
PkgPayloadUnpacker: Unpacked /Users/paul.cossey/Library/AutoPkg/Cache/com.github.joshua-d-miller.autopkg.munki.Unity3D/Unpack/Unity.pkg.tmp/Payload to /Users/paul.cossey/Library/AutoPkg/Cache/com.github.joshua-d-miller.autopkg.munki.Unity3D/application_payload/Applications
{'Output': {}}
MunkiInstallsItemsCreator
{'Input': {'derive_minimum_os_version': 'YES',
           'faux_root': '/Users/paul.cossey/Library/AutoPkg/Cache/com.github.joshua-d-miller.autopkg.munki.Unity3D/application_payload',
           'installs_item_paths': ['/Applications/Unity/Unity.app']}}
MunkiInstallsItemsCreator: Created installs item for /Applications/Unity/Unity.app
MunkiInstallsItemsCreator: Derived minimum os version as: 10.14.0
{'Output': {'additional_pkginfo': {'installs': [{'CFBundleIdentifier': 'com.unity3d.UnityEditor5.x',
                                                 'CFBundleName': 'Unity',
                                                 'CFBundleShortVersionString': 'Unity '
                                                                               'version '
                                                                               '2023.2.20f1',
                                                 'CFBundleVersion': '2023.2.20f1',
                                                 'minosversion': '10.14.0',
                                                 'path': '/Applications/Unity/Unity.app',
                                                 'type': 'application',
                                                 'version_comparison_key': 'CFBundleVersion'}],
                                   'minimum_os_version': '10.14.0'}}}
MunkiPkginfoMerger
{'Input': {'additional_pkginfo': {'installs': [{'CFBundleIdentifier': 'com.unity3d.UnityEditor5.x',
                                                'CFBundleName': 'Unity',
                                                'CFBundleShortVersionString': 'Unity '
                                                                              'version '
                                                                              '2023.2.20f1',
                                                'CFBundleVersion': '2023.2.20f1',
                                                'minosversion': '10.14.0',
                                                'path': '/Applications/Unity/Unity.app',
                                                'type': 'application',
                                                'version_comparison_key': 'CFBundleVersion'}],
                                  'minimum_os_version': '10.14.0'},
           'pkginfo': {'catalogs': ['testing'],
                       'category': 'Application Development',
                       'description': 'Unity is a flexible and powerful '
                                      'development platform for creating '
                                      'multiplatform 3D and 2D games and '
                                      "interactive experiences. It's a "
                                      'complete ecosystem for anyone who aims '
                                      'to build a business on creating '
                                      'high-end content and connecting to '
                                      'their most loyal and enthusiastic '
                                      'players and customers.',
                       'developer': 'Unity Technologies',
                       'display_name': 'Unity 3D',
                       'name': 'Unity 3D',
                       'unattended_install': True}}}
MunkiPkginfoMerger: Merged {'installs': [{'CFBundleIdentifier': 'com.unity3d.UnityEditor5.x', 'CFBundleName': 'Unity', 'CFBundleShortVersionString': 'Unity version 2023.2.20f1', 'CFBundleVersion': '2023.2.20f1', 'minosversion': '10.14.0', 'path': '/Applications/Unity/Unity.app', 'type': 'application', 'version_comparison_key': 'CFBundleVersion'}], 'minimum_os_version': '10.14.0'} into pkginfo
{'Output': {'pkginfo': {'catalogs': ['testing'],
                        'category': 'Application Development',
                        'description': 'Unity is a flexible and powerful '
                                       'development platform for creating '
                                       'multiplatform 3D and 2D games and '
                                       "interactive experiences. It's a "
                                       'complete ecosystem for anyone who aims '
                                       'to build a business on creating '
                                       'high-end content and connecting to '
                                       'their most loyal and enthusiastic '
                                       'players and customers.',
                        'developer': 'Unity Technologies',
                        'display_name': 'Unity 3D',
                        'installs': [{'CFBundleIdentifier': 'com.unity3d.UnityEditor5.x',
                                      'CFBundleName': 'Unity',
                                      'CFBundleShortVersionString': 'Unity '
                                                                    'version '
                                                                    '2023.2.20f1',
                                      'CFBundleVersion': '2023.2.20f1',
                                      'minosversion': '10.14.0',
                                      'path': '/Applications/Unity/Unity.app',
                                      'type': 'application',
                                      'version_comparison_key': 'CFBundleVersion'}],
                        'minimum_os_version': '10.14.0',
                        'name': 'Unity 3D',
                        'unattended_install': True}}}
Versioner
{'Input': {'input_plist_path': '/Users/paul.cossey/Library/AutoPkg/Cache/com.github.joshua-d-miller.autopkg.munki.Unity3D/application_payload/Applications/Unity/Unity.app/Contents/Info.plist',
           'plist_version_key': 'CFBundleVersion'}}
Versioner: No value supplied for skip_single_root_dir, setting default value of: False
Versioner: Found version 2023.2.20f1 in file /Users/paul.cossey/Library/AutoPkg/Cache/com.github.joshua-d-miller.autopkg.munki.Unity3D/application_payload/Applications/Unity/Unity.app/Contents/Info.plist
{'Output': {'version': '2023.2.20f1'}}
MunkiPkginfoMerger
{'Input': {'additional_pkginfo': {'version': '2023.2.20f1'},
           'pkginfo': {'catalogs': ['testing'],
                       'category': 'Application Development',
                       'description': 'Unity is a flexible and powerful '
                                      'development platform for creating '
                                      'multiplatform 3D and 2D games and '
                                      "interactive experiences. It's a "
                                      'complete ecosystem for anyone who aims '
                                      'to build a business on creating '
                                      'high-end content and connecting to '
                                      'their most loyal and enthusiastic '
                                      'players and customers.',
                       'developer': 'Unity Technologies',
                       'display_name': 'Unity 3D',
                       'installs': [{'CFBundleIdentifier': 'com.unity3d.UnityEditor5.x',
                                     'CFBundleName': 'Unity',
                                     'CFBundleShortVersionString': 'Unity '
                                                                   'version '
                                                                   '2023.2.20f1',
                                     'CFBundleVersion': '2023.2.20f1',
                                     'minosversion': '10.14.0',
                                     'path': '/Applications/Unity/Unity.app',
                                     'type': 'application',
                                     'version_comparison_key': 'CFBundleVersion'}],
                       'minimum_os_version': '10.14.0',
                       'name': 'Unity 3D',
                       'unattended_install': True}}}
MunkiPkginfoMerger: Merged {'version': '2023.2.20f1'} into pkginfo
{'Output': {'pkginfo': {'catalogs': ['testing'],
                        'category': 'Application Development',
                        'description': 'Unity is a flexible and powerful '
                                       'development platform for creating '
                                       'multiplatform 3D and 2D games and '
                                       "interactive experiences. It's a "
                                       'complete ecosystem for anyone who aims '
                                       'to build a business on creating '
                                       'high-end content and connecting to '
                                       'their most loyal and enthusiastic '
                                       'players and customers.',
                        'developer': 'Unity Technologies',
                        'display_name': 'Unity 3D',
                        'installs': [{'CFBundleIdentifier': 'com.unity3d.UnityEditor5.x',
                                      'CFBundleName': 'Unity',
                                      'CFBundleShortVersionString': 'Unity '
                                                                    'version '
                                                                    '2023.2.20f1',
                                      'CFBundleVersion': '2023.2.20f1',
                                      'minosversion': '10.14.0',
                                      'path': '/Applications/Unity/Unity.app',
                                      'type': 'application',
                                      'version_comparison_key': 'CFBundleVersion'}],
                        'minimum_os_version': '10.14.0',
                        'name': 'Unity 3D',
                        'unattended_install': True,
                        'version': '2023.2.20f1'}}}
MunkiImporter
{'Input': {'MUNKI_REPO': '/Users/Shared/munki_repo',
           'pkg_path': '/Users/paul.cossey/Library/AutoPkg/Cache/com.github.joshua-d-miller.autopkg.munki.Unity3D/downloads/Unity '
                       '3D.pkg',
           'pkginfo': {'catalogs': ['testing'],
                       'category': 'Application Development',
                       'description': 'Unity is a flexible and powerful '
                                      'development platform for creating '
                                      'multiplatform 3D and 2D games and '
                                      "interactive experiences. It's a "
                                      'complete ecosystem for anyone who aims '
                                      'to build a business on creating '
                                      'high-end content and connecting to '
                                      'their most loyal and enthusiastic '
                                      'players and customers.',
                       'developer': 'Unity Technologies',
                       'display_name': 'Unity 3D',
                       'installs': [{'CFBundleIdentifier': 'com.unity3d.UnityEditor5.x',
                                     'CFBundleName': 'Unity',
                                     'CFBundleShortVersionString': 'Unity '
                                                                   'version '
                                                                   '2023.2.20f1',
                                     'CFBundleVersion': '2023.2.20f1',
                                     'minosversion': '10.14.0',
                                     'path': '/Applications/Unity/Unity.app',
                                     'type': 'application',
                                     'version_comparison_key': 'CFBundleVersion'}],
                       'minimum_os_version': '10.14.0',
                       'name': 'Unity 3D',
                       'unattended_install': True,
                       'version': '2023.2.20f1'},
           'repo_subdirectory': 'apps/unity'}}
MunkiImporter: No value supplied for MUNKI_REPO_PLUGIN, setting default value of: FileRepo
MunkiImporter: No value supplied for MUNKILIB_DIR, setting default value of: /usr/local/munki
MunkiImporter: No value supplied for force_munki_repo_lib, setting default value of: False
MunkiImporter: Using repo lib: AutoPkgLib
MunkiImporter:         plugin: FileRepo
MunkiImporter:           repo: /Users/Shared/munki_repo
MunkiImporter: Copied pkginfo to: /Users/Shared/munki_repo/pkgsinfo/apps/unity/Unity 3D-2023.2.20f1.plist
MunkiImporter:            pkg to: /Users/Shared/munki_repo/pkgs/apps/unity/Unity 3D-2023.2.20f1.pkg
{'Output': {'munki_importer_summary_result': {'data': {'catalogs': 'testing',
                                                       'icon_repo_path': '',
                                                       'name': 'Unity 3D',
                                                       'pkg_repo_path': 'apps/unity/Unity '
                                                                        '3D-2023.2.20f1.pkg',
                                                       'pkginfo_path': 'apps/unity/Unity '
                                                                       '3D-2023.2.20f1.plist',
                                                       'version': '2023.2.20f1'},
                                              'report_fields': ['name',
                                                                'version',
                                                                'catalogs',
                                                                'pkginfo_path',
                                                                'pkg_repo_path',
                                                                'icon_repo_path'],
                                              'summary_text': 'The following '
                                                              'new items were '
                                                              'imported into '
                                                              'Munki:'},
            'munki_info': {'_metadata': {'created_by': 'paul.cossey',
                                         'creation_date': datetime.datetime(2024, 6, 5, 17, 25, 23),
                                         'munki_version': '6.3.2.4588',
                                         'os_version': '14.5'},
                           'autoremove': False,
                           'catalogs': ['testing'],
                           'category': 'Application Development',
                           'description': 'Unity is a flexible and powerful '
                                          'development platform for creating '
                                          'multiplatform 3D and 2D games and '
                                          "interactive experiences. It's a "
                                          'complete ecosystem for anyone who '
                                          'aims to build a business on '
                                          'creating high-end content and '
                                          'connecting to their most loyal and '
                                          'enthusiastic players and customers.',
                           'developer': 'Unity Technologies',
                           'display_name': 'Unity 3D',
                           'installed_size': 7532645,
                           'installer_item_hash': 'c7e203a316b308acab23a81bba16c17be94c65fa210a4c0e5f083d83f2c10b3f',
                           'installer_item_location': 'apps/unity/Unity '
                                                      '3D-2023.2.20f1.pkg',
                           'installer_item_size': 4088201,
                           'installs': [{'CFBundleIdentifier': 'com.unity3d.UnityEditor5.x',
                                         'CFBundleName': 'Unity',
                                         'CFBundleShortVersionString': 'Unity '
                                                                       'version '
                                                                       '2023.2.20f1',
                                         'CFBundleVersion': '2023.2.20f1',
                                         'minosversion': '10.14.0',
                                         'path': '/Applications/Unity/Unity.app',
                                         'type': 'application',
                                         'version_comparison_key': 'CFBundleVersion'}],
                           'minimum_os_version': '10.14.0',
                           'name': 'Unity 3D',
                           'receipts': [{'installed_size': 7532645,
                                         'packageid': 'com.unity3d.UnityEditor5.x',
                                         'version': '0'}],
                           'unattended_install': True,
                           'uninstall_method': 'removepackages',
                           'uninstallable': True,
                           'version': '2023.2.20f1'},
            'munki_repo_changed': True,
            'pkg_repo_path': '/Users/Shared/munki_repo/pkgs/apps/unity/Unity '
                             '3D-2023.2.20f1.pkg',
            'pkginfo_repo_path': '/Users/Shared/munki_repo/pkgsinfo/apps/unity/Unity '
                                 '3D-2023.2.20f1.plist'}}
Receipt written to /Users/paul.cossey/Library/AutoPkg/Cache/com.github.joshua-d-miller.autopkg.munki.Unity3D/receipts/Unity3D.munki-receipt-20240605-182528.plist

The following new items were downloaded:
    Download Path                                                                                                     
    -------------                                                                                                     
    /Users/paul.cossey/Library/AutoPkg/Cache/com.github.joshua-d-miller.autopkg.munki.Unity3D/downloads/Unity 3D.pkg  

The following new items were imported into Munki:
    Name      Version      Catalogs  Pkginfo Path                           Pkg Repo Path                        Icon Repo Path  
    ----      -------      --------  ------------                           -------------                        --------------  
    Unity 3D  2023.2.20f1  testing   apps/unity/Unity 3D-2023.2.20f1.plist  apps/unity/Unity 3D-2023.2.20f1.pkg
paul-cossey commented 3 months ago

Hi, @joshua-d-miller

Anything I can do to help get this merged? We've been running the changes in this PR as temp recipes with no issues.

Thanks!