search

eclipse / xtext

Eclipse Xtext™ is a language development framework
http://www.eclipse.org/Xtext
Eclipse Public License 2.0
767 stars 320 forks source link

Xtext Nightly update site is broken #1478

Closed cdietrich closed 5 years ago

cdietrich commented 5 years ago 
ERROR: org.eclipse.equinox.p2.director code=10053 Cannot complete the install because one or more required items could not be found.
  at org.eclipse.oomph.targlets.internal.core.TargletContainer.forceUpdate(TargletContainer.java:806)
  at org.eclipse.oomph.setup.targlets.impl.TargletTaskImpl$4.run(TargletTaskImpl.java:1167)
  at org.eclipse.oomph.util.pde.TargetPlatformUtil.runWithTargetPlatformService(TargetPlatformUtil.java:120)
  at org.eclipse.oomph.setup.targlets.impl.TargletTaskImpl.perform(TargletTaskImpl.java:1033)
  at org.eclipse.oomph.setup.internal.core.SetupTaskPerformer.doPerformNeededSetupTasks(SetupTaskPerformer.java:3824)
  at org.eclipse.oomph.setup.internal.core.SetupTaskPerformer.access$1(SetupTaskPerformer.java:3767)
  at org.eclipse.oomph.setup.internal.core.SetupTaskPerformer$WorkspaceUtil$1.run(SetupTaskPerformer.java:5125)
  at org.eclipse.core.internal.resources.Workspace.run(Workspace.java:2295)
  at org.eclipse.core.internal.resources.Workspace.run(Workspace.java:2322)
  at org.eclipse.oomph.setup.internal.core.SetupTaskPerformer$WorkspaceUtil.performNeededSetupTasks(SetupTaskPerformer.java:5119)
  at org.eclipse.oomph.setup.internal.core.SetupTaskPerformer$WorkspaceUtil.access$0(SetupTaskPerformer.java:5117)
  at org.eclipse.oomph.setup.internal.core.SetupTaskPerformer.performNeededSetupTasks(SetupTaskPerformer.java:3758)
  at org.eclipse.oomph.setup.internal.core.SetupTaskPerformer.performTriggeredSetupTasks(SetupTaskPerformer.java:3733)
  at org.eclipse.oomph.setup.internal.core.SetupTaskPerformer.perform(SetupTaskPerformer.java:3626)
  at org.eclipse.oomph.setup.ui.wizards.ProgressPage$9.run(ProgressPage.java:575)
  at org.eclipse.oomph.setup.ui.wizards.ProgressPage$11$1.run(ProgressPage.java:701)
  at org.eclipse.core.internal.jobs.Worker.run(Worker.java:63)
  ERROR: org.eclipse.equinox.p2.director code=0 Software being installed: artificial_root 1.0.0.v1559206377001
  ERROR: org.eclipse.equinox.p2.director code=0 Missing requirement: artificial_root 1.0.0.v1559206377001 requires 'org.eclipse.equinox.p2.iu; org.eclipse.xtext.xbase.lib.feature.group 2.14.0' but it could not be found

??????????

cdietrich commented 5 years ago

have no idea which update site the feature was pulled from before

cdietrich commented 5 years ago

No repository found at http://download.eclipse.org/modeling/tmf/xtext/updates/nightly/head. => @kthoms is our nightly update site broken?

cdietrich commented 5 years ago

i wonder how this can happen. do we delete stuff and then decide not to redeploy cause we think it is already deployed?


publish.build.stage.2:
     [echo] Used launcher: /opt/public/common/buckminster-4.3/plugins/org.eclipse.equinox.launcher_1.3.0.v20130327-1440.jar
     [java] Picked up JAVA_TOOL_OPTIONS: -Xmx2G -Djava.io.tmpdir=/tmp/genie.xtext
     [java] Buildfile: /jobs/genie.xtext/common-deploy/workspace/build-result/promoter.ant
     [java] 
     [java] -check.property.file.location:
     [java] 
     [java] -load.properties.as.is:
     [java] 
     [java] -load.properties.with.prefix:
     [java] 
     [java] -load.properties:
     [java] 
     [java] publish.build.from.framework:
     [java] 
     [java] publish:
     [java] 
     [java] echo-status:
     [java]      [echo] Build N201905291758 already promoted, nothing to do...
     [java] BUILD SUCCESSFUL
     [java] 
     [java] BUILD SUCCESSFUL
     [java] Total time: 0 seconds
cdietrich commented 5 years ago

or is this done by https://ci.eclipse.org/xtext/job/xtext-snapshots ? https://ci.eclipse.org/xtext/job/xtext-snapshots/1074/console

Could not read error output of command '/opt/public/common/java/oracle/jdk1.8.0_192_x64/jre/bin/pack200'.
java.io.IOException: Stream Closed
    at java.io.FileOutputStream.writeBytes(Native Method)
    at java.io.FileOutputStream.write(FileOutputStream.java:326)
    at org.gradle.process.internal.streams.ExecOutputHandleRunner.forwardContent(ExecOutputHandleRunner.java:66)
    at org.gradle.process.internal.streams.ExecOutputHandleRunner.run(ExecOutputHandleRunner.java:52)
    at org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42)
    at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63)
    at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:46)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:55)
    at java.lang.Thread.run(Thread.java:748)
Pack build-result/p2.repository/plugins/org.eclipse.xtext.ui.t

but build was green anyway

cdietrich commented 5 years ago

https://ci.eclipse.org/xtext/job/common-deploy/11384/console

cdietrich commented 5 years ago

still have no idea who delete the dir and how to recreate it

cdietrich commented 5 years ago

zips are bad too https://www.eclipse.org/modeling/tmf/downloads/

cdietrich commented 5 years ago

Sebastian reverted the change to publishing so the nightly is deployed again

cdietrich commented 5 years ago

@kthoms @Hejado how shall we proceed. are you working on a fix for xtext/publishing

NicoPrediger commented 5 years ago

Didn't we already find/fix the issue for this on monday, @kthoms ?

NicoPrediger commented 5 years ago

Not sure, if I'm missing something...

kthoms commented 5 years ago

We have a fix and it is available on the branch. We should merge that when we have the time to repair it for the case that something breaks. I think we should do this on tuesday. I don't have time today/tomorrow.

cdietrich commented 5 years ago

https://bugs.eclipse.org/bugs/show_bug.cgi?id=548397

cdietrich commented 5 years ago

@kthoms still does not work. try to revert your changes again

cdietrich commented 5 years ago

the xtext-snapshots has also bogus messages in the log

Pack build-result/p2.repository/plugins/org.eclipse.xtext.ui.codetemplates.ui_2.19.0.v20190618-0537.jar

Could not read error output of: command '/opt/public/common/java/oracle/jdk1.8.0_192_x64/jre/bin/pack200'.
java.io.IOException: Stream Closed
    at java.io.FileOutputStream.writeBytes(Native Method)
    at java.io.FileOutputStream.write(FileOutputStream.java:326)
    at org.gradle.process.internal.streams.ExecOutputHandleRunner.run(ExecOutputHandleRunner.java:55)
    at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63)
    at org.gradle.internal.concurrent.StoppableExecutorImpl$1.run(StoppableExecutorImpl.java:46)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
cdietrich commented 5 years ago

deploy did not work cause it thinks its already deployed this crap needs to be more stable

cdietrich commented 5 years ago 
[java] echo-status:
     [java]      [echo] Build N201906180629 already promoted, nothing to do...
     [java] BUILD SUCCESSFUL
cdietrich commented 5 years ago

@kthoms

[ERROR] Failed to resolve target definition /home/travis/build/itemis/xtext-reference-projects/greetings-tycho/2.19.0/org.xtext.example.mydsl.target/org.xtext.example.mydsl.target.target: Failed to load p2 metadata repository from location https://download.eclipse.org/modeling/tmf/xtext/updates/nightly/: Unable to read repository at https://download.eclipse.org/modeling/tmf/xtext/updates/nightly. Artifact not found: https://download.eclipse.org/modeling/tmf/xtext/updates/nightly/head/content.xml.xz. -> [Help 1]

=> the update site is deleted again

https://ci.eclipse.org/xtext/job/xtext-snapshots/1119/console is red

kthoms commented 5 years ago

Will check today

kthoms commented 5 years ago

Download folder contains "workspace.zip" screenshot 132

The zip file should be N.zip screenshot 131

cdietrich commented 5 years ago

still an issue

cdietrich commented 5 years ago

log contains

 Additional action for task ':zipXtextP2Repository': was implemented by the Java lambda 'io.typefox.publishing.EclipsePublishing$$Lambda$159/568787640'. Using Java lambdas is not supported, use an (anonymous) inner class instead.

this might be the issue.

we call doFirst and doLast at several places. the generated code looks like

final Action<Task> _function_13 = (Task task2) -> {
.....
kthoms commented 5 years ago

We changed recently the Xtext/Xtend version in publishing/buildSrc/build.gradle. Has this something to do with that?

kthoms commented 5 years ago

Note: The issue might be resolved with the new deployment job on ci-staging.

cdietrich commented 5 years ago

yes. i converted the lamdas to classes. lets see what happens

cdietrich commented 5 years ago

yes but the code is broken

task viech(type: Zip) {
    //archiveFileName = "my-distribution.zip"
    destinationDirectory = file("$buildDir/dist")
    from "lele"
    archiveFileName = provider {
        "demo.zip"
    }
}

is needed with newer gradle

cdietrich commented 5 years ago

also the gradle api still seems 4.8 am not sure why

kthoms commented 5 years ago

First successful deployment with new job sign-and-deploy:

director -l -r http://download.eclipse.org/modeling/tmf/xtext/updates/composite/latest/
201906242045.Default=1.0.0.8h3-cKYB3-_kE7Ag7QAY3AgMU
201906242045.mwe2lang=1.0.0.67U3cLSXLr7E7Ag7UEME7MQ
a.jre.javase=10.0.0
a.jre.javase=10.0.0
a.jre.javase=11.0.0
a.jre.javase=11.0.0
com.google.guava=27.1.0.v20190517-1946
com.google.guava=27.1.0.v20190517-1946
com.google.guava.source=27.1.0.v20190517-1946
com.google.guava.source=27.1.0.v20190517-1946
...
org.eclipse.xtext=2.19.0.v20190628-0955
org.eclipse.xtext.activities=2.19.0.v20190703-0145
org.eclipse.xtext.activities.source=2.19.0.v20190703-0145
org.eclipse.xtext.builder=2.19.0.v20190703-0145
org.eclipse.xtext.builder.source=2.19.0.v20190703-0145
...
cdietrich commented 5 years ago

=> you use the workspace zip name and rename back? i have pushed a fixed version for the broken api

kthoms commented 5 years ago

No, I ignore the zip that the publishing plugin creates and zip it with a shell command.

kthoms commented 5 years ago

=> the plugin still creates a zip with wrong name

kthoms commented 5 years ago

https://ci-staging.eclipse.org/xtext/job/releng/job/sign-and-deploy/lastSuccessfulBuild/artifact/build-result/downloads/

cdietrich commented 5 years ago

should the nightly deploy job be deactivated too?

kthoms commented 5 years ago

nightly-deploy it triggers the common-deploy and simrel-tests job nightly with the result from xtext-snapshots.

The new job combines that all together. It runs nightly for the master branch, builds the repository for upload and deploys it to the nightly site. It is also already prepared to do the same for milestone/release builds.

I have disabled nightly-deploy now.

kthoms commented 5 years ago

https://download.eclipse.org/modeling/tmf/xtext/updates/nightly/ contains the latest build result from the sign-and-deploy job. This job is triggered nightly for branch master.

I consider this fixed now.