irgaly / xcode-cache

A GitHub Action to store Xcode's Build Cache for incremental build on CI
Other
37 stars 3 forks source link
github-actions ios xcode

xcode-cache

A GitHub Action to store Xcode's Build Cache for incremental build on CI.

Usage

Use this action in GitHub Actions workflow.

    - uses: actions/checkout@v4
      ...
    - uses: irgaly/xcode-cache@v1
      with:
        key: xcode-cache-deriveddata-${{ github.workflow }}-${{ github.sha }}
        restore-keys: xcode-cache-deriveddata-${{ github.workflow }}-
      ...
    - name: (Your build step)
      run: |
        fastlane ...

Xcode's DerivedData is used for incremental build, so it's recommended to use github.sha in cache key.

Configuration examples

Custom DerivedData and SourcePackages locations

    - uses: irgaly/xcode-cache@v1
      with:
        key: xcode-cache-deriveddata-${{ github.workflow }}-${{ github.sha }}
        restore-keys: xcode-cache-deriveddata-${{ github.workflow }}-
        deriveddata-directory: DerivedData
        sourcepackages-directory: SourcePackages
      ...

Store all project file's mtime attributes

    - uses: irgaly/xcode-cache@v1
      with:
        key: xcode-cache-deriveddata-${{ github.workflow }}-${{ github.sha }}
        restore-keys: xcode-cache-deriveddata-${{ github.workflow }}-
        restore-mtime-targets: |
          YourApp/**/*
      ...

Use custom cache key for SourcePackages cache

The cache key of SourcePackages is default to irgaly/xcode-cache-sourcepackages-${{ hashFiles('.../Package.resolved') }}. You can specify your custom key.

    - uses: irgaly/xcode-cache@v1
      with:
        key: xcode-cache-deriveddata-${{ github.workflow }}-${{ github.sha }}
        restore-keys: xcode-cache-deriveddata-${{ github.workflow }}-
        swiftpm-cache-key: your-soucepackages-${{ hashFiles('your/path/to/Package.resolved') }}
        swiftpm-cache-restore-keys: |
          your-custom-restore-keys-here-...
      ...

Platform

This action is for only macOS runner.

Caching details

This action caches below entries.

DerivedData

The DerivedData directory has all of intermediates build output files such as compiled objects.

A DerivedData directory that is default to ~/Library/Developer/Xcode/DerivedData or specified by deriveddata-directory input.

This directory will be cached with nanosecond resolution mtime by @actions/cache.

SourcePackages

The SourcePackages directory has clones of SwiftPM if you used SwiftPM dependencies with Xcode.

A SourcePackages directory that is default to ~/Library/Developer/Xcode/DerivedData/{App name}-{ID}/SourcePackages or specified by sourcepackages-directory input.

This directory will be cached with nanosecond resolution mtime by @actions/cache.

Source Code's mtime attributes

Xcode stores build input file's mtime information with nanosecond resolution to DerivedData. So, on CI environment, it's required to restore all input file's mtime from previous build after checkout sources.

This action will store input file's mtime attributes and their SHA-256 hash to (DerivedData directory)/xcode-cache-mtime.json.

Then this action will restore their mtime attributes if their SHA-256 are same after checkout sources.

For example, xcode-cache-mtime.json's contents will be:

[
  {
    "path": "sample/MyApp/MyApp/ContentView.swift",
    "time": "1694751978.570357000",
    "sha256": "a1a6707fc09625c0a5f49c3b8127da42358085506bbe2246469f00c0a7a2276b"
  },
  {
    "path": "sample/MyApp/MyApp/MyAppApp.swift",
    "time": "1694751978.543212000",
    "sha256": "0b97d516fc64a2ec833b9eefe769d658947c66cc528ada637ac916da7b87f5bc"
  },
  ...
]

Default target file's to store mtime attributes

If use-default-mtime-targets is set to true (default), this action will store these file's mtime attributes:

You can add any target by glob pattern with restore-mtime-targets input.

Delete old incremental build cache when job succeeded

If delete-used-deriveddata-cache: true is configured, xcode-cache will delete old DerivedData cache from GitHub Actions Cache Storage. This will help you to manage your repository's Cache Storage space.

This operation will use GitHub Actions API for deleting cache. Be sure actions: write has granted to your token.

Please see the official document of GitHub Actions Cache management for more details.

All Options

    - uses: irgaly/xcode-cache@v1
      with:
        # Cache key for DerivedData cache
        #
        # required
        key: { your derived data key }

        # Restore keys for DerivedData cache
        #
        # optional, multiline
        # dofault: empty
        restore-keys: |
          {your derived data restore keys}

        # DerivedData directory path
        #
        # optional
        # default: ~/Library/Developer/Xcode/DerivedData
        deriveddata-directory: { your DerivedData directory path }

        # SourcePackages directory path
        #
        # optional, multiline
        # default: {DerivedDirectory path}/SourcePackages
        sourcepackages-directory: { your SourcePackages directory path }

        # Target file glob patterns to store mtime attributes
        # This glob pattern is applied with GitHub Actions toolkit glob option implicitDescendants = false
        #
        # optional, multiline
        # default: empty
        restore-mtime-targets: |
          your/target/**/*

        # Xcode's Package.resolved file path glob patterns
        # Package.resolved file is used for swiftpm-cache-key if it is not specified
        #
        # optional, multiline
        # default:
        #   **/*.xcodeproj/project.xcworkspace/xcshareddata/swiftpm/Package.resolved
        #   **/*.xcworkspace/xcshareddata/swiftpm/Package.resolved
        swiftpm-package-resolved-file: |
          YourApp.xcodeproj/project.xcworkspace/xcshareddata/swiftpm/Package.resolved

        # Cache key for SourcePackages
        #
        # optional
        # default: irgaly/xcode-cache-sourcepackages-${{ hashFiles( {swiftpm-package-resolved-file} ) }}'
        swiftpm-cache-key: { your SourcePackages cache key }

        # Cache restore keys for SourcePackages
        #
        # optional
        # default: empty
        swiftpm-cache-restore-keys:

        # Use default target file glob patterns to store mtime attributes
        #
        # optional
        # default: true
        use-default-mtime-targets: true

        # Delete the DerivedData cache that used for this build,
        # only when this job has succeeded, the cache has hit from `restore-keys` and
        # the Cache belongs to same branch from this job.
        #
        # actions: write permission is required for your token to use this feature.
        #
        # Cache will be deleted by GitHub Actions API
        # https://docs.github.com/en/rest/actions/cache?apiVersion=2022-11-28#delete-github-actions-caches-for-a-repository-using-a-cache-key
        #
        # optional
        # default: false
        delete-used-deriveddata-cache: false

        # The GitHub Token for deleting DerivedData cache
        # This is used to access GitHub Actions Cache API
        #
        # optional
        # default: ${{ github.token }}
        token: ${{ github.token }}

        # More detailed logging
        #
        # optional
        # default: false
        verbose: false

        # Cache read-only mode
        # If true, the action will only read from the cache and not write to it
        #
        # optional
        # default: false
        cache-read-only: false

Outputs

This action provides some step outputs.

For example, you can use these values by ${{ steps.{step id}.outputs.restored }}

key value
restored true: DerivedData restored from cache (includes restore-keys hit) / false: DerivedData cache not hit
restored-key The key of DerivedData cache hit. This will not set when cache has not hit.
swiftpm-restored true: SourcePackages restored from cache (includes swiftpm-cache-restore-keys hit) / false: SourcePackages cache not hit
swiftpm-restored-key The key of SourcePackages cache hit. This will not set when cache has not hit.

Appendix

Ruby one-liner for restoring mtimes

This is a ruby one-liner for restoring mtimes from xcode-cache-mtime.json. You may use this one-liner if you'd like to restore at any time you want in GitHub Actions workflow step.

% ruby -rjson -rdigest -rbigdecimal -e 'JSON.parse(STDIN.read).each{|i|f=i["path"];t=BigDecimal(i["time"]);File.utime(t,t,f)if(File.exist?(f)&&(File.directory?(f)?Digest::SHA256.new.yield_self{|s|Dir.children(f).sort.each{s.update(_1)};s.hexdigest}:Digest::SHA256.file(f).hexdigest)==i["sha256"])}' < DerivedData/xcode-cache-mtime.json