uyuni-project / minima

A Simple Linux Repository Manager
BSD 3-Clause "New" or "Revised" License
21 stars 7 forks source link

Can't synchronize Ubuntu #20

Open Bischoff opened 4 years ago

Bischoff commented 4 years ago

Ubuntu can't be synchronized with minima:

2020/04/30 00:22:40 Processing repo: http://ubuntu.mirror.frontiernet.net/ubuntu/dists/bionic-updates/main/binary-amd64/
2020/04/30 00:22:40 First-time sync started
2020/04/30 00:22:40 Downloading repomd.xml...
2020/04/30 00:22:41 Downloading Release...
2020/04/30 00:22:41 Downloading Release.gpg...
2020/04/30 00:22:41 Got 404, ignoring...
2020/04/30 00:22:41 Missing SHA256 entry in Release file

Same on mirror.23media.com. It seems to be general.

Bischoff commented 4 years ago

After speaking with @cbosdo, it appeared it is a known problem.

Workaround is currently to use apt-mirror instead of minima.

Feel free to add "feature" label.

atighineanu commented 3 years ago

That Repo looks to be empty. http://ubuntu.mirror.frontiernet.net/ubuntu/dists/bionic-updates/main/binary-amd64/ The issue is that the parser (in syncer.go) expects in the Release file a line with "SHAxxx" followed by the actual hash, which doesn't exist inside this file: http://ubuntu.mirror.frontiernet.net/ubuntu/dists/bionic-updates/main/binary-amd64/Release. I am not an ubuntu expert, but to me this repo looks empty. I've wrote some code to unzip the files from /by-hash/SHA256/ and populate data structures for each package (there are like 10k). But it looks anyways there isn't any package in the repo.

srbarrios commented 3 years ago

Ubuntu's must be syncronized using another command: "apt-mirror" The config in our mirror is here:

minima-mirror-qam:/etc/cron.daily # cat /etc/apt-mirror.list
set mirror_path /srv/mirror/
set defaultarch amd64
set nthreads    10

# Ubuntu 16.04
deb http://archive.ubuntu.com/ubuntu xenial main
deb http://archive.ubuntu.com/ubuntu xenial-updates main
deb http://archive.ubuntu.com/ubuntu xenial-security main

# Ubuntu 18.04
deb http://archive.ubuntu.com/ubuntu bionic main
deb http://archive.ubuntu.com/ubuntu bionic-updates main
deb http://archive.ubuntu.com/ubuntu bionic-security main

# Ubuntu 20.04
deb http://archive.ubuntu.com/ubuntu focal main
deb http://archive.ubuntu.com/ubuntu focal-updates main
deb http://archive.ubuntu.com/ubuntu focal-security main
deb http://archive.ubuntu.com/ubuntu focal universe
minima-mirror-qam:/etc/cron.daily # cat apt-mirror.sh 
#! /bin/bash

date >> /var/log/apt-mirror.log
echo '---------------------------------------------------------' >> /var/log/apt-mirror.log
(apt-mirror 2>&1) >> /var/log/apt-mirror.log
echo >> /var/log/apt-mirror.log
srbarrios commented 3 years ago

@Bischoff @atighineanu unless you have any objection, let's close this card. I commented above how to sync Ubuntu or Debian products. @moio please close it.

Bischoff commented 3 years ago

Yes, i know we can sync with apt-mirror, @srbarrios . Still, it's suboptimal we cannot use minima for it. But close this if you wish.

srbarrios commented 3 years ago

Yes, i know we can sync with apt-mirror, @srbarrios . Still, it's suboptimal we cannot use minima for it. But close this if you wish.

Ah, I missunderstood the card, so this is not an issue but an enhacement that we want to do. Is in fact well labelled :) All good, sorry for the noise.

Bischoff commented 3 years ago

No worries.