Local tests always fully pass (100% false positive)

[raikesy]

Latest versions of IntelliJ and Windows 10. Fresh install of IDE and plugin. Using the 'Run Tests' feature of the plugin always results in 100% pass. It passes instantly and there is no breakdown of the individual tests, showing that they are not being run at all. I tried reinstalling the plugin but this did not help. All other features work as expected.

[pilino1234]

This happens when your code has errors, try running the code using the green play button and see what happens.

[raikesy]

Unfortunately not the case here. This occurs when the code has zero errors. I just tried it with the unedited week5-085 template (which runs without error) to test this and it instantly passed the local tests. The problem also occurs on completed exercises; it says the code passes 100% but the individual tests do not display in the test results window so it seems like the code isn't being tested at all.

[pilino1234]

Hmm, yes, I've been seeing this on exercise 90, now I have to submit the exercise and wait for the test results from the server. Then the test results show up like the local tests do.

I tried a couple of things to try to solve this, but none of them worked:

• switch to a different exercise and run tests, then switch back
• restart intellij
• delete the cache directory that is created in the exercise and restart intellij

The next exercise seems to work again though…

[pilino1234]

@raikesy do you have any lines like

ArrayList<int> numbers = new ArrayList<>();

in your code? If so, try replacing them with

ArrayList<int> numbers = new ArrayList<int>();

etc. for other types of ArrayLists. Note the second explicit type declaration. This "fix" has solved the problem for a couple of times now

[rlmhermans]

The problem you describe is very familiair to me. When you push the run test button it will pretend to run the test with 100% pass, but not actually do so. Uploading the test will fail it on server. Manually running the test from the project window will actually run the test with fails. Does the test run fine when you choose run tests from the TMC menu item?

Most of my students have this problem as well. I can't reproduce it anymore, but when I started out, had the same problem. See my replies to #101. Maybe a restart of your PC solves the problem? That might have been it for me.

Weird thing is the one student on a mac didn't have this issue.

[rlmhermans]

I confirmed this is an issue with my students when the bin folder containing javac is missing from the PATH environment variable. Adding it and restarting IntelliJ fixed the issue. I got the idea from issue #113 where @cxcorp mentioned: "Issue also manifests itself when javac is missing from the PATH."