fedora-infra / fedora-packages

A webapp that allows searching packages in Fedora. Written in Python using TurboGears2 and Moksha.
https://apps.fedoraproject.org/packages
GNU Affero General Public License v3.0
58 stars 59 forks source link

packages app not correctly adding new packages #229

Open gsauthof opened 8 years ago

gsauthof commented 8 years ago

When searching for 'vim-x11' or 'vim-X11' 0 results are returned:

https://apps.fedoraproject.org/packages/s/vim-X11

But dnf search vim-X11 returns something on a Fedora system:

vim-X11.x86_64 : The VIM version of the vi editor for the X Window System
nirik commented 6 years ago

Since this is the oldest report of this bug I am going to duplicate others here.

Yes, we know that packages isn't correctly updating for newly added packages. There is a re-write now in progress by @cverna that will hopefully fix this (and many other) bugs. Stay tuned and we will let folks know when to test. I'll leave to @cverna if there's any coding help we could us right now or not.

cverna commented 6 years ago

Thanks @nirik for going through the tickets. For now code wise we should be I am just waiting on https://src.fedoraproject.org/rpms/TurboGears2/pull-request/1 to be reviewed and merged.

nirik commented 6 years ago

reviewed and merged that and made f26/f27/rawhide builds.

avsej commented 6 years ago

Will it pickup all new packages which were added while fedora-packages app was broken?

cverna commented 6 years ago

@avsej yes it will, The verison which is currently in production is using pkgdb to get the list of packages, and as you might know pkgdb has been retired and it is not updated. The new verison of fedora-packages is using pdc to get the list of packages.

avsej commented 6 years ago

@cverna any plans when new version will be deployed?

cverna commented 6 years ago

@avsej Hopefully in the next couple of weeks. As you may know there are currently some maintenance work in the fedora-infrastructure. Once these works are finished we will be able to deploy the latest release.

junghans commented 6 years ago

lammps (#307) has a package page now, but newer packages, e.g. mpibash are still missing.

cverna commented 6 years ago

yes i think the mechanism to update the packages is not working :(. I ll try to investigate why

pypingou commented 6 years ago

Shot in the dark, it's listening for the fedmsg messages from pkgdb?

cverna commented 6 years ago

There is a fedmsg consumer but apparently it is listening to the mdapi message

https://github.com/fedora-infra/fedora-packages/blob/develop/fedoracommunity/consumers.py#L149

pypingou commented 6 years ago

hm, that looks problematic: https://apps.fedoraproject.org/datagrepper/raw?topic=org.fedoraproject.prod.mdapi.repo.update

cverna commented 6 years ago

So I think we know why this is not working :), any ideas why the mdapi.repo.update fedmsg is not sent anymore ?

pypingou commented 6 years ago

mdapi is sending messages again, let's see if fedora-packages catches them :)