eclipse-platform / eclipse.platform.releng.aggregator

Aggregated repository for Eclipse Java IDE
https://www.eclipse.org/eclipse/
Eclipse Public License 2.0
36 stars 75 forks source link

org.eclipse.ua.tests.doc.internal.linkchecker.ApiDocTest fails since I20221002-0330 #613

Closed iloveeclipse closed 2 years ago

iloveeclipse commented 2 years ago

https://download.eclipse.org/eclipse/downloads/drops4/I20221005-1800/testresults/html/org.eclipse.ua.tests.doc_ep426I-unit-cen64-gtk3-java11_linux.gtk.x86_64_11.html

expected:<[]> but was:<[ * Unexpected exported API packages in topics_Reference.xml: org.eclipse.equinox.http.jetty ]>

org.junit.ComparisonFailure: expected:<[]> but was:<[
* Unexpected exported API packages in topics_Reference.xml:
org.eclipse.equinox.http.jetty
]>
at org.junit.Assert.assertEquals(Assert.java:117)
at org.junit.Assert.assertEquals(Assert.java:146)
at org.eclipse.ua.tests.doc.internal.linkchecker.ApiDocTest.testTopicsReference(ApiDocTest.java:183)

Interestingly, the test failed initially on all platforms , but now on all except Windows. ???

akurtakov commented 2 years ago

That's really weird. I touched all doc bundles via https://ci.eclipse.org/releng/job/Touch_doc_bundles/58/ to make sure that it's not some issue caused by the javadoc issues lately.

iloveeclipse commented 2 years ago

Probably related commits on aggregator went into I20221002-0330:

iloveeclipse commented 2 years ago

Good news: the test is now consistently failing on all platforms. Bad news: it still fails.

Just in case it might be still needed, I've triggered https://ci.eclipse.org/releng/job/Touch_doc_bundles/60/

iloveeclipse commented 2 years ago

the test is now consistently failing on all platforms.

Nope. It looks like fails on some random platforms every day. Why it is random?

akurtakov commented 2 years ago

My investigation pointed me in the direction that o.e.equinox.http.jetty sometimes is/isn't in the State returned here https://github.com/eclipse-platform/eclipse.platform.ua/blob/901a358e5cc6b64a4ed254affb7fb76ecd3ed9f8/org.eclipse.ua.tests.doc/src/org/eclipse/ua/tests/doc/internal/linkchecker/ApiDocTest.java#L284 . Maybe @tjwatson can help here?

akurtakov commented 2 years ago

I looked for this issue so I can close it in ua and .github repos but haven't thought to look for it here :)