uyuni-project / uyuni

Source code for Uyuni
https://www.uyuni-project.org/
GNU General Public License v2.0
428 stars 178 forks source link

unable to sync RHEL8 appstream repo #9151

Closed jawahk closed 1 week ago

jawahk commented 1 month ago

Problem description

we are trying to sync RHEL8 appstream repo, its not working.

we used the same RHEL certificates as per uyuni documentation , RHEL7 rpm, RHEL8(baseOS) and RHEL9(baseOS, appstream) working without any issues.

but when we tried on rhel8 appstream we encounter below issues during sync.

Preparing custom SSL CAPATH at /var/cache/rhn/reposync/.ssl-certs/1 2024/08/08 09:16:58 -00:00 2024/08/08 09:16:58 -00:00 Importing modules file 405520336540d4a26a71668f8b77eab9e52969c3abc0718246143662d3222eee-modules.yaml.gz. 2024/08/08 09:16:58 -00:00 *** NOTE: Importing modules file for the channel 'rhel8appstream'. Previous modules will be discarded. 2024/08/08 09:16:59 -00:00 An error occurred while reading module metadata: An error occurred while indexing a module entry: 2024/08/08 09:16:59 -00:00 Failed to parse buildorder in component: 18446744073709551615: The integer value is larger than 9223372036854775807 [line 118 col 9] 2024/08/08 09:16:59 -00:00 Failed to parse buildorder in component: 18446744073709551615: The integer value is larger than 9223372036854775807 [line 118 col 9] 2024/08/08 09:16:59 -00:00 Failed to parse buildorder in component: 18446744073709551615: The integer value is larger than 9223372036854775807 [line 107 col 9] 2024/08/08 09:16:59 -00:00 Failed to parse buildorder in component: 18446744073709551615: The integer value is larger than 9223372036854775807 [line 114 col 9]

Steps to reproduce

1.create repo for rhel8 appstream (URL - https://cdn.redhat.com/content/dist/rhel8/8.9/x86_64/appstream/os/) 2.add the repo to channel 3.try sync it ...

Uyuni version

Information for package Uyuni-Server-release:
---------------------------------------------
Repository     : uyuni-server-stable
Name           : Uyuni-Server-release
Version        : 2024.07-230900.219.1.uyuni3
Arch           : x86_64
Vendor         : obs://build.opensuse.org/systemsmanagement:Uyuni
Support Level  : Level 3
Installed Size : 1.4 KiB
Installed      : No
Status         : not installed
Source package : Uyuni-Server-release-2024.07-230900.219.1.uyuni3.src
Upstream URL   : https://www.uyuni-project.org/
Summary        : Uyuni Server
Description    :
    Uyuni lets you efficiently manage physical, virtual,
    and cloud-based Linux systems. It provides automated and cost-effective
    configuration and software management, asset management, and system
    provisioning.

Uyuni proxy version (if used)

No response

Useful logs

Preparing custom SSL CAPATH at /var/cache/rhn/reposync/.ssl-certs/1
2024/08/08 09:16:58 -00:00 
2024/08/08 09:16:58 -00:00   Importing modules file 405520336540d4a26a71668f8b77eab9e52969c3abc0718246143662d3222eee-modules.yaml.gz.
2024/08/08 09:16:58 -00:00 *** NOTE: Importing modules file for the channel 'rhel8appstream'. Previous modules will be discarded.
2024/08/08 09:16:59 -00:00 An error occurred while reading module metadata: An error occurred while indexing a module entry:
2024/08/08 09:16:59 -00:00     Failed to parse buildorder in component: 18446744073709551615: The integer value is larger than 9223372036854775807 [line 118 col 9]
2024/08/08 09:16:59 -00:00     Failed to parse buildorder in component: 18446744073709551615: The integer value is larger than 9223372036854775807 [line 118 col 9]
2024/08/08 09:16:59 -00:00     Failed to parse buildorder in component: 18446744073709551615: The integer value is larger than 9223372036854775807 [line 107 col 9]
2024/08/08 09:16:59 -00:00     Failed to parse buildorder in component: 18446744073709551615: The integer value is larger than 9223372036854775807 [line 114 col 9]

Additional information

we tried to follow below fix from git but its not helping.

https://github.com/uyuni-project/uyuni/issues/9123

jay2theb commented 1 month ago

I was having the same issue syncing a RHEL 8 repo, but following the work around specifically posted by @pititof and @bamorrow in #9123 worked for me on 2024.07:

Preparing custom SSL CAPATH at /var/cache/rhn/reposync/.ssl-certs/1 2024/08/08 08:37:06 -07:00 2024/08/08 08:37:06 -07:00 Importing modules file 9f5ad8bd81fd75889db9031eb86c95a3408df9ec811fede13b818793454bef4a-modules.yaml.gz. 2024/08/08 08:37:07 -07:00 NOTE: Importing modules file for the channel 'rhel8-appstream'. Previous modules will be discarded. 2024/08/08 08:37:07 -07:00 An error occurred while reading module metadata: An error occurred while indexing a module entry: 2024/08/08 08:37:07 -07:00 Failed to parse buildorder in component: 18446744073709551615: The integer value is larger than 9223372036854775807 [line 118 col 9] 2024/08/08 08:37:07 -07:00 Failed to parse buildorder in component: 18446744073709551615: The integer value is larger than 9223372036854775807 [line 118 col 9] 2024/08/08 08:37:07 -07:00 Failed to parse buildorder in component: 18446744073709551615: The integer value is larger than 9223372036854775807 [line 107 col 9] 2024/08/08 08:37:07 -07:00 Failed to parse buildorder in component: 18446744073709551615: The integer value is larger than 9223372036854775807 [line 114 col 9] 2024/08/08 10:38:52 -07:00 Command: ['/usr/bin/spacewalk-repo-sync', '--channel', 'rhel8-appstream', '--type', 'yum', '--non-interactive'] 2024/08/08 10:38:52 -07:00 Sync of channel started. Preparing custom SSL CAPATH at /var/cache/rhn/reposync/.ssl-certs/1 2024/08/08 10:39:03 -07:00 2024/08/08 10:39:03 -07:00 Importing modules file 9f5ad8bd81fd75889db9031eb86c95a3408df9ec811fede13b818793454bef4a-modules.yaml.gz. 2024/08/08 10:39:03 -07:00 NOTE: Importing modules file for the channel 'rhel8-appstream'. Previous modules will be discarded. 2024/08/08 10:39:03 -07:00 2024/08/08 10:39:03 -07:00 Importing comps file 1d79326dae8b7e5f83125023f0ed7cacf09bf7fa58776ea080723aa76f1548df-comps.xml. 2024/08/08 10:39:03 -07:00 Renaming non-standard filename 1d79326dae8b7e5f83125023f0ed7cacf09bf7fa58776ea080723aa76f1548df-comps.xml to comps.xml. 2024/08/08 10:39:03 -07:00 *** NOTE: Importing comps file for the channel 'rhel8-appstream'. Previous comps will be discarded. 2024/08/08 10:39:05 -07:00 Repo URL: https://cdn.redhat.com/content/dist/rhel8/8/x86_64/appstream/os 2024/08/08 10:39:05 -07:00 Packages in repo: 38803 2024/08/08 10:40:02 -07:00 Packages already synced: 0 2024/08/08 10:40:02 -07:00 Packages to sync: 38803 2024/08/08 10:40:04 -07:00 New packages to download: 38783 2024/08/08 10:40:04 -07:00 Downloading packages: 2024/08/08 10:40:04 -07:00 1/38783 : 389-ds-base-1.4.0.20-7.module+el8+2750+1f4079fb.x86_64.rpm 2024/08/08 10:40:05 -07:00 2/38783 : 389-ds-base-1.4.3.8-5.module+el8.3.0+7569+08175a8a.x86_64.rpm 2024/08/08 10:40:05 -07:00 3/38783 : 389-ds-base-1.4.0.20-10.module+el8.0.0+3096+101825d5.x86_64.rpm 2024/08/08 10:40:05 -07:00 4/38783 : 389-ds-base-1.4.2.4-10.module+el8.2.0+7749+4a513fb2.x86_64.rpm

jawahk commented 1 month ago

request @bamorrow @pititof help on this issue

jawahk commented 1 month ago

i tried to sync until rhel8.1 appstream, which works fine . post that i am seeing issues. , could someone help on this

2024/08/09 12:38:53 -00:00 Command: ['/usr/bin/spacewalk-repo-sync', '--channel', 'rhel8appstream', '--type', 'yum', '--non-interactive'] 2024/08/09 12:38:53 -00:00 Sync of channel started. Preparing custom SSL CAPATH at /var/cache/rhn/reposync/.ssl-certs/1 2024/08/09 12:39:03 -00:00 2024/08/09 12:39:03 -00:00 Importing modules file 9f5ad8bd81fd75889db9031eb86c95a3408df9ec811fede13b818793454bef4a-modules.yaml.gz. 2024/08/09 12:39:03 -00:00 *** NOTE: Importing modules file for the channel 'rhel8appstream'. Previous modules will be discarded. 2024/08/09 12:39:04 -00:00 An error occurred while reading module metadata: An error occurred while indexing a module entry: 2024/08/09 12:39:04 -00:00 Failed to parse buildorder in component: 18446744073709551615: The integer value is larger than 9223372036854775807 [line 118 col 9] 2024/08/09 12:39:04 -00:00 Failed to parse buildorder in component: 18446744073709551615: The integer value is larger than 9223372036854775807 [line 118 col 9] 2024/08/09 12:39:04 -00:00 Failed to parse buildorder in component: 18446744073709551615: The integer value is larger than 9223372036854775807 [line 107 col 9] 2024/08/09 12:39:04 -00:00 Failed to parse buildorder in component: 18446744073709551615: The integer value is larger than 9223372036854775807 [line 114 col 9]

bamorrow commented 1 month ago

The only fix is to follow the instruction in #9123 and rebuild a newer libmodulemd. I did version 2.15.0.

jawahk commented 1 month ago

@bamorrow thank you , i tried the same on my side but its not helping . could you help me with the complete steps how you have performed, ill try to recreate the same.

thank you.

bamorrow commented 1 month ago

can you contact me directly at brett.morrow@noaa.gov?

bamorrow commented 1 month ago

I did manage to build a set rpm to replace the system ones with libmodule 2.15.0

jawahk commented 1 month ago

Hello @bamorrow , could you help me with the step by step process how to build the same, so that I can replicate the same

jawahk commented 3 weeks ago

Hello @bamorrow could you help me with the steps how to get that done ??( build a set rpm to replace the system ones with libmodule 2.15.0) , i tried to perform the same but its not helping me.

cbbayburt commented 1 week ago

Closing as duplicate of https://github.com/uyuni-project/uyuni/issues/9123