search

030 / n3dr

Nexus3 Disaster Recovery (N3DR) is a tool that is capable of downloading all artifacts from a Nexus3 server and to migrate them to another one.
https://n3dr.releasesoftwaremoreoften.com/
MIT License
141 stars 37 forks source link

cannot upload repository #251

Open sulucky5 opened 2 years ago

sulucky5 commented 2 years ago

What happened: ERRO[0403]/home/runner/work/n3dr/n3dr/internal/artifacts/upload.go:353 github.com/030/n3dr/internal/artifacts.(*Nexus3).readMavenFilesAndUpload() skipErrors: 'true'. Error: 'HTTPStatusCode: '400'; ResponseMessage: '[{"id":"groupId","message":"Missing required component field 'Group ID'"},{"id":"artifactId","message":"Missing required component field 'Artifact ID'"},{"id":"version","message":"Missing required component field 'Version'"}]'; ErrorMessage: '''

What you expected to happen:

How to reproduce it (as minimally and precisely as possible):

Anything else we need to know?: n3dr backup -u username -p userpassword -n http://nexus3:8081 -r maven-snapshots --directory-prefix /home/nexus/down/ n3dr upload -u username -p userpassword -n http://nexus3:8081 -r maven-snapshots --directory-prefix /home/nexus/down/ -s

All components upload fail....

Environment:

030 commented 2 years ago

@sulucky5 Could you try whether the backup and upload works when the repositoriesV2 command is used?

030 commented 2 years ago

@sulucky5 How do the file names look like? Could you try version 6.6.1? This version supports the upload of Maven artifacts that contain underscores and uppercases.

homiakos commented 2 years ago

I have same problem with upload maven n3dr upload -u admin --n3drURL https://url.com-r repo -s

ERRO[0067]/Users/runner/work/n3dr/n3dr/internal/artifacts/upload.go:353 github.com/030/n3dr/internal/artifacts.(Nexus3).readMavenFilesAndUpload() skipErrors: 'true'. Error: 'HTTPStatusCode: '400'; ResponseMessage: '[{"id":"groupId","message":"Missing required component field 'Group ID'"},{"id":"artifactId","message":"Missing required component field 'Artifact ID'"},{"id":"version","message":"Missing required component field 'Version'"},{"id":"","message":"The assets 1 and 7 have identical coordinates"},{"id":"*","message":"The assets 2 and 8 have identical coordinates"}]'; ErrorMessage: '''

n3dr --version n3dr version refs/tags/6.6.1

030 commented 2 years ago

@homiakos Could you provide the file paths? There is a regex that determines the elements. Does the issue also occur when version 6.6.0 is used?

homiakos commented 2 years ago

@030

with version 6.6.0 the same error. let him not understand. The application finds artifacts and tries to download them. This can be seen from the log, but does not fill in the required fields. uploaded artifacts from same nexus version also nd3dr

INFO[0096]/Users/runner/work/n3dr/n3dr/internal/artifacts/upload.go:97 github.com/030/n3dr/internal/artifacts.artifactTypeDetector() ArtifactElements: '[lmg-common/ru/lmg/commons/0.0.9-SNAPSHOT/commons-0.0.9-20201008.123243-1-javadoc.jar 0.0.9-SNAPSHOT commons commons -0.0.9-20201008.123243-1-javadoc 0.0.9-20201008.123243-1-javadoc -javadoc javadoc jar]'. ArtifactElementLength: '11' INFO[0096]/Users/runner/work/n3dr/n3dr/internal/artifacts/upload.go:115 github.com/030/n3dr/internal/artifacts.artifactTypeDetector() Artifact: 'commons', Version: '0.0.9-SNAPSHOT', Classifier: 'javadoc', Extension: 'jar'. INFO[0096]/Users/runner/work/n3dr/n3dr/internal/artifacts/upload.go:97 github.com/030/n3dr/internal/artifacts.artifactTypeDetector() ArtifactElements: '[lmg-common/ru/lmg/commons/0.0.9-SNAPSHOT/commons-0.0.9-20201008.123243-1-sources.jar 0.0.9-SNAPSHOT commons commons -0.0.9-20201008.123243-1-sources 0.0.9-20201008.123243-1-sources -sources sources jar]'. ArtifactElementLength: '11' INFO[0096]/Users/runner/work/n3dr/n3dr/internal/artifacts/upload.go:115 github.com/030/n3dr/internal/artifacts.artifactTypeDetector() Artifact: 'commons', Version: '0.0.9-SNAPSHOT', Classifier: 'sources', Extension: 'jar'. INFO[0096]/Users/runner/work/n3dr/n3dr/internal/artifacts/upload.go:97 github.com/030/n3dr/internal/artifacts.artifactTypeDetector() ArtifactElements: '[lmg-common/ru/lmg/commons/0.0.9-SNAPSHOT/commons-0.0.9-20201008.123243-1.jar 0.0.9-SNAPSHOT commons commons -0.0.9-20201008.123243-1 0.0.9-20201008.123243-1 -1 1 jar]'. ArtifactElementLength: '11' INFO[0096]/Users/runner/work/n3dr/n3dr/internal/artifacts/upload.go:115 github.com/030/n3dr/internal/artifacts.artifactTypeDetector() Artifact: 'commons', Version: '0.0.9-SNAPSHOT', Classifier: '1', Extension: 'jar'. INFO[0096]/Users/runner/work/n3dr/n3dr/internal/artifacts/upload.go:97 github.com/030/n3dr/internal/artifacts.artifactTypeDetector() ArtifactElements: '[lmg-common/ru/lmg/commons/0.0.9-SNAPSHOT/commons-0.0.9-20201008.123243-1.module 0.0.9-SNAPSHOT commons commons -0.0.9-20201008.123243-1 0.0.9-20201008.123243-1 -1 1 module]'. ArtifactElementLength: '11' INFO[0096]/Users/runner/work/n3dr/n3dr/internal/artifacts/upload.go:115 github.com/030/n3dr/internal/artifacts.artifactTypeDetector() Artifact: 'commons', Version: '0.0.9-SNAPSHOT', Classifier: '1', Extension: 'module'. INFO[0096]/Users/runner/work/n3dr/n3dr/internal/artifacts/upload.go:97 github.com/030/n3dr/internal/artifacts.artifactTypeDetector() ArtifactElements: '[lmg-common/ru/lmg/commons/0.0.9-SNAPSHOT/commons-0.0.9-20201008.123243-1.pom 0.0.9-SNAPSHOT commons commons -0.0.9-20201008.123243-1 0.0.9-20201008.123243-1 -1 1 pom]'. ArtifactElementLength: '11' INFO[0096]/Users/runner/work/n3dr/n3dr/internal/artifacts/upload.go:115 github.com/030/n3dr/internal/artifacts.artifactTypeDetector() Artifact: 'commons', Version: '0.0.9-SNAPSHOT', Classifier: '1', Extension: 'pom'. INFO[0096]/Users/runner/work/n3dr/n3dr/internal/artifacts/upload.go:97 github.com/030/n3dr/internal/artifacts.artifactTypeDetector() ArtifactElements: '[lmg-common/ru/lmg/commons/0.0.9-SNAPSHOT/commons-0.0.9-20201008.123318-2-javadoc.jar 0.0.9-SNAPSHOT commons commons -0.0.9-20201008.123318-2-javadoc 0.0.9-20201008.123318-2-javadoc -javadoc javadoc jar]'. ArtifactElementLength: '11' INFO[0096]/Users/runner/work/n3dr/n3dr/internal/artifacts/upload.go:115 github.com/030/n3dr/internal/artifacts.artifactTypeDetector() Artifact: 'commons', Version: '0.0.9-SNAPSHOT', Classifier: 'javadoc', Extension: 'jar'. INFO[0096]/Users/runner/work/n3dr/n3dr/internal/artifacts/upload.go:97 github.com/030/n3dr/internal/artifacts.artifactTypeDetector() ArtifactElements: '[lmg-common/ru/lmg/commons/0.0.9-SNAPSHOT/commons-0.0.9-20201008.123318-2-sources.jar 0.0.9-SNAPSHOT commons commons -0.0.9-20201008.123318-2-sources 0.0.9-20201008.123318-2-sources -sources sources jar]'. ArtifactElementLength: '11' INFO[0096]/Users/runner/work/n3dr/n3dr/internal/artifacts/upload.go:115 github.com/030/n3dr/internal/artifacts.artifactTypeDetector() Artifact: 'commons', Version: '0.0.9-SNAPSHOT', Classifier: 'sources', Extension: 'jar'. INFO[0096]/Users/runner/work/n3dr/n3dr/internal/artifacts/upload.go:97 github.com/030/n3dr/internal/artifacts.artifactTypeDetector() ArtifactElements: '[lmg-common/ru/lmg/commons/0.0.9-SNAPSHOT/commons-0.0.9-20201008.123318-2.jar 0.0.9-SNAPSHOT commons commons -0.0.9-20201008.123318-2 0.0.9-20201008.123318-2 -2 2 jar]'. ArtifactElementLength: '11' INFO[0096]/Users/runner/work/n3dr/n3dr/internal/artifacts/upload.go:115 github.com/030/n3dr/internal/artifacts.artifactTypeDetector() Artifact: 'commons', Version: '0.0.9-SNAPSHOT', Classifier: '2', Extension: 'jar'. INFO[0096]/Users/runner/work/n3dr/n3dr/internal/artifacts/upload.go:97 github.com/030/n3dr/internal/artifacts.artifactTypeDetector() ArtifactElements: '[lmg-common/ru/lmg/commons/0.0.9-SNAPSHOT/commons-0.0.9-20201008.123318-2.module 0.0.9-SNAPSHOT commons commons -0.0.9-20201008.123318-2 0.0.9-20201008.123318-2 -2 2 module]'. ArtifactElementLength: '11' INFO[0096]/Users/runner/work/n3dr/n3dr/internal/artifacts/upload.go:115 github.com/030/n3dr/internal/artifacts.artifactTypeDetector() Artifact: 'commons', Version: '0.0.9-SNAPSHOT', Classifier: '2', Extension: 'module'. INFO[0096]/Users/runner/work/n3dr/n3dr/internal/artifacts/upload.go:97 github.com/030/n3dr/internal/artifacts.artifactTypeDetector() ArtifactElements: '[lmg-common/ru/lmg/commons/0.0.9-SNAPSHOT/commons-0.0.9-20201008.123318-2.pom 0.0.9-SNAPSHOT commons commons -0.0.9-20201008.123318-2 0.0.9-20201008.123318-2 -2 2 pom]'. ArtifactElementLength: '11' INFO[0096]/Users/runner/work/n3dr/n3dr/internal/artifacts/upload.go:115 github.com/030/n3dr/internal/artifacts.artifactTypeDetector() Artifact: 'commons', Version: '0.0.9-SNAPSHOT', Classifier: '2', Extension: 'pom'. INFO[0096]/Users/runner/work/n3dr/n3dr/internal/artifacts/upload.go:97 github.com/030/n3dr/internal/artifacts.artifactTypeDetector() ArtifactElements: '[lmg-common/ru/lmg/commons/0.0.9-SNAPSHOT/maven-metadata.xml 0.0.9-SNAPSHOT maven-metadata maven-metadata xml]'. ArtifactElementLength: '11' INFO[0096]/Users/runner/work/n3dr/n3dr/internal/artifacts/upload.go:115 github.com/030/n3dr/internal/artifacts.artifactTypeDetector() Artifact: 'maven-metadata', Version: '0.0.9-SNAPSHOT', Classifier: '', Extension: 'xml'. INFO[0096]/Users/runner/work/n3dr/n3dr/internal/artifacts/upload.go:350 github.com/030/n3dr/internal/artifacts.(Nexus3).readMavenFilesAndUpload() 46 Upload 'maven2.asset1=@lmg-common/ru/lmg/commons/0.0.9-SNAPSHOT/commons-0.0.9-20201008.123243-1-javadoc.jar,maven2.asset1.extension=jar,maven2.asset1.classifier=javadoc,maven2.asset2=@lmg-common/ru/lmg/commons/0.0.9-SNAPSHOT/commons-0.0.9-20201008.123243-1-sources.jar,maven2.asset2.extension=jar,maven2.asset2.classifier=sources,maven2.asset3=@lmg-common/ru/lmg/commons/0.0.9-SNAPSHOT/commons-0.0.9-20201008.123243-1.jar,maven2.asset3.extension=jar,maven2.asset3.classifier=1,maven2.asset4=@lmg-common/ru/lmg/commons/0.0.9-SNAPSHOT/commons-0.0.9-20201008.123243-1.module,maven2.asset4.extension=module,maven2.asset4.classifier=1,maven2.asset5=@lmg-common/ru/lmg/commons/0.0.9-SNAPSHOT/commons-0.0.9-20201008.123243-1.pom,maven2.asset5.extension=pom,maven2.asset5.classifier=1,maven2.asset6=@lmg-common/ru/lmg/commons/0.0.9-SNAPSHOT/commons-0.0.9-20201008.123318-2-javadoc.jar,maven2.asset6.extension=jar,maven2.asset6.classifier=javadoc,maven2.asset7=@lmg-common/ru/lmg/commons/0.0.9-SNAPSHOT/commons-0.0.9-20201008.123318-2-sources.jar,maven2.asset7.extension=jar,maven2.asset7.classifier=sources,maven2.asset8=@lmg-common/ru/lmg/commons/0.0.9-SNAPSHOT/commons-0.0.9-20201008.123318-2.jar,maven2.asset8.extension=jar,maven2.asset8.classifier=2,maven2.asset9=@lmg-common/ru/lmg/commons/0.0.9-SNAPSHOT/commons-0.0.9-20201008.123318-2.module,maven2.asset9.extension=module,maven2.asset9.classifier=2,maven2.asset10=@lmg-common/ru/lmg/commons/0.0.9-SNAPSHOT/commons-0.0.9-20201008.123318-2.pom,maven2.asset10.extension=pom,maven2.asset10.classifier=2,maven2.asset11=@lmg-common/ru/lmg/commons/0.0.9-SNAPSHOT/maven-metadata.xml,maven2.asset11.extension=xml,' ERRO[0097]/Users/runner/work/n3dr/n3dr/internal/artifacts/upload.go:353 github.com/030/n3dr/internal/artifacts.(Nexus3).readMavenFilesAndUpload() skipErrors: 'true'. Error: 'HTTPStatusCode: '400'; ResponseMessage: '[{"id":"groupId","message":"Missing required component field 'Group ID'"},{"id":"artifactId","message":"Missing required component field 'Artifact ID'"},{"id":"version","message":"Missing required component field 'Version'"},{"id":"","message":"The assets 1 and 7 have identical coordinates"},{"id":"","message":"The assets 2 and 8 have identical coordinates"}]'; ErrorMessage: '''

vramakris commented 2 years ago

Hi, we have seen similar issue while uploading the snapshots repo. Using 6.6.2 version. Any suggestions on how to fix this?

n3dr --version n3dr version refs/tags/6.6.2

zhaileilei123 commented 2 years ago

hi ,I have the same problem. n3dr --version n3dr version refs/tags/6.7.1 n3dr upload -u admin -p xxxxxx -n http://xxxxx:8081 -r big_data_snapshot -s

NFO[0041]/home/runner/work/n3dr/n3dr/internal/artifacts/upload.go:350 github.com/030/n3dr/internal/artifacts.(Nexus3).readMavenFilesAndUpload() 50 Upload 'maven2.asset1=@big_data_snapshot/org/mongoflink/mongo-flink/0.2-SNAPSHOT/maven-metadata.xml,maven2.asset1.extension=xml,maven2.asset2=@big_data_snapshot/org/mongoflink/mongo-flink/0.2-SNAPSHOT/mongo-flink-0.2-20220309.124012-1.jar,maven2.asset2.extension=jar,maven2.asset2.classifier=1,maven2.asset3=@big_data_snapshot/org/mongoflink/mongo-flink/0.2-SNAPSHOT/mongo-flink-0.2-20220309.124012-1.pom,maven2.asset3.extension=pom,maven2.asset3.classifier=1,' ERRO[0042]/home/runner/work/n3dr/n3dr/internal/artifacts/upload.go:353 github.com/030/n3dr/internal/artifacts.(Nexus3).readMavenFilesAndUpload() skipErrors: 'true'.Error: 'HTTPStatusCode: '400'; ResponseMessage: '[{"id":"groupId","message":"Missing required component field 'Group ID'"},{"id":"artifactId","message":"Missing required component field 'Artifact ID'"},{"id":"version","message":"Missing required component field 'Version'"}]'; ErrorMessage: '''