Consider Performance test baseline

[MP0w]

Hi, I tried to search about this but I couldn't find anything. Is there a way to consider the baselines for performance tests stored in the .xcodeproj shared data? Here is the build on travis: https://travis-ci.org/devlucky/Kakapo/jobs/121923285

thank you in advance

[mmmulani]

no clue about this. In this a feature Xcode/xcodebuild supports already? If it's only in the Xcode UI then the answer is probably no.

[MP0w]

I'm trying to understand more but I'm not sure how it works, when testing form Xcode the baseline are considered. In the derived data the .xctest bundle contains a plist with the baselines and a .xctestconfiguration.

Looking at the logs doesn't help to understand how xcodebuild is used but :

18:20:13.231 Xcode[3780:4251410] F33E60DD-E216-46E0-9BFC-7A44F0001929: Spawning executable at path: /Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/Library/Xcode/Agents/xctest and options: {
    arguments =     (
        "/Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/Library/Xcode/Agents/xctest",
        "-NSTreatUnknownArgumentsAsOpen",
        NO,
        "-ApplePersistenceIgnoreState",
        YES
    );
    binpref = "x86_64";
    environment =     {
        "DTX_CONNECTION_SERVICES_PATH" = "/Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/SDKs/iPhoneSimulator.sdk/Developer/Library/PrivateFrameworks/DTXConnectionServices.framework";
        "DYLD_FRAMEWORK_PATH" = "/Users/mpow/Library/Developer/Xcode/DerivedData/perf-gklptntretqlvyddhwgxyryqhvqu/Build/Products/Debug-iphonesimulator:/Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/Library/Frameworks";
        "DYLD_LIBRARY_PATH" = "/Users/mpow/Library/Developer/Xcode/DerivedData/perf-gklptntretqlvyddhwgxyryqhvqu/Build/Products/Debug-iphonesimulator:/Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/Library/Frameworks";
        NSUnbufferedIO = YES;
        "OBJC_DISABLE_GC" = YES;
        "XCODE_DBG_XPC_EXCLUSIONS" = "com.apple.dt.xctestSymbolicator";
        XCTestConfigurationFilePath = "/Users/mpow/Library/Developer/Xcode/DerivedData/perf-gklptntretqlvyddhwgxyryqhvqu/Build/Products/Debug-iphonesimulator/perfTests.xctest/perfTests-F9798CD4-4BC6-4E23-B08E-6BD55578ECCD.xctestconfiguration";
    };
    stderr = 91;
    stdin = 83;
    stdout = 88;
    "wait_for_debugger" = 1;
}

[ExtremeMan]

Sorry, but we won't be working on this. Though we very welcome pull requests and happy to add new features with the help of open source community.