search

exercism / swift-test-runner

GNU Affero General Public License v3.0
0 stars 8 forks source link

"The 1st Rule of Poetry Club" – Website marks solution as "Failed" even though all tests pass #35

Closed der-computerist closed 2 years ago

der-computerist commented 2 years ago

Hi there,

I just finished implementing a solution for the "The 1st Rule of Poetry Club" exercise on the Swift track. When the website runs all the tests, it reports a "Failure". However, when I go and check the test run logs, all tests seem to have passed ("Executed 13 tests, with 0 failures..."). When I run the tests locally in my machine, everything passes as well.

I'm attaching the test run log generated by the website:

Building for debugging...
[1/6] Emitting module PoetryClub
[2/6] Compiling PoetryClub PoetryClub.swift
[5/8] Wrapping AST for PoetryClub for debugging
[6/10] Emitting module PoetryClubTests
[7/10] Compiling PoetryClubTests PoetryClubTests.swift
[8/11] Compiling PoetryClubTests XCTestManifests.swift
[11/13] Wrapping AST for PoetryClubTests for debugging
[12/15] Compiling PoetryClubPackageTests LinuxMain.swift
[13/15] Emitting module PoetryClubPackageTests
[16/17] Wrapping AST for PoetryClubPackageTests for debugging
[17/17] Linking PoetryClubPackageTests.xctest
Build complete! (4.98s)
Test Suite 'All tests' started at 2022-03-18 17:30:26.377
Test Suite 'debug.xctest' started at 2022-03-18 17:30:26.409
Test Suite 'PoetryClubTests' started at 2022-03-18 17:30:26.409
Test Case 'PoetryClubTests.testSplitNewlines' started at 2022-03-18 17:30:26.409
Test Case 'PoetryClubTests.testSplitNewlines' passed (0.001 seconds)
Test Case 'PoetryClubTests.testSplitNoNewlines' started at 2022-03-18 17:30:26.410
Test Case 'PoetryClubTests.testSplitNoNewlines' passed (0.0 seconds)
Test Case 'PoetryClubTests.testFirstLetter' started at 2022-03-18 17:30:26.410
Test Case 'PoetryClubTests.testFirstLetter' passed (0.0 seconds)
Test Case 'PoetryClubTests.testFirstLetterEmpty' started at 2022-03-18 17:30:26.410
Test Case 'PoetryClubTests.testFirstLetterEmpty' passed (0.0 seconds)
Test Case 'PoetryClubTests.testCapitalize' started at 2022-03-18 17:30:26.410
Test Case 'PoetryClubTests.testCapitalize' passed (0.0 seconds)
Test Case 'PoetryClubTests.testTrimWithWhitespace' started at 2022-03-18 17:30:26.410
Test Case 'PoetryClubTests.testTrimWithWhitespace' passed (0.0 seconds)
Test Case 'PoetryClubTests.testTrimWithoutWhitespace' started at 2022-03-18 17:30:26.410
Test Case 'PoetryClubTests.testTrimWithoutWhitespace' passed (0.0 seconds)
Test Case 'PoetryClubTests.testLastLetter' started at 2022-03-18 17:30:26.411
Test Case 'PoetryClubTests.testLastLetter' passed (0.0 seconds)
Test Case 'PoetryClubTests.testLastLetterEmpty' started at 2022-03-18 17:30:26.411
Test Case 'PoetryClubTests.testLastLetterEmpty' passed (0.0 seconds)
Test Case 'PoetryClubTests.testBackdoorPassword' started at 2022-03-18 17:30:26.411
Test Case 'PoetryClubTests.testBackdoorPassword' passed (0.0 seconds)
Test Case 'PoetryClubTests.testIthLetter' started at 2022-03-18 17:30:26.411
Test Case 'PoetryClubTests.testIthLetter' passed (0.0 seconds)
Test Case 'PoetryClubTests.testIthLetterInvalid' started at 2022-03-18 17:30:26.411
Test Case 'PoetryClubTests.testIthLetterInvalid' passed (0.0 seconds)
Test Case 'PoetryClubTests.testSecretRoomPassword' started at 2022-03-18 17:30:26.411
Test Case 'PoetryClubTests.testSecretRoomPassword' passed (0.0 seconds)
Test Suite 'PoetryClubTests' passed at 2022-03-18 17:30:26.411
     Executed 13 tests, with 0 failures (0 unexpected) in 0.003 (0.003) seconds
Test Suite 'debug.xctest' passed at 2022-03-18 17:30:26.411
     Executed 13 tests, with 0 failures (0 unexpected) in 0.003 (0.003) seconds
Test Suite 'All tests' passed at 2022-03-18 17:30:26.411
     Executed 13 tests, with 0 failures (0 unexpected) in 0.003 (0.003) seconds

Looks like something might be broken somewhere in the test runner. 🤔

SleeplessByte commented 2 years ago

Looks like something might be broken somewhere in the test runner. 🤔

That seems to be the case!

@exercism/swift @ErikSchierboom (cuz swift is empty?)

dlwalter commented 2 years ago

This seems to be occurring with every swift exercise - I've experienced it with hello-world, lasagna, custom-signs, and freelancer-rates.

SleeplessByte commented 2 years ago

@dlwalter yes, the test-runner itself is currently broken.