search

NixOS / nixpkgs

Nix Packages collection & NixOS
MIT License
18.08k stars 14.06k forks source link

Zero Repology Problems [ZRP] for 18.03 #30636

Closed matthewbauer closed 6 years ago

matthewbauer commented 7 years ago

Hi all,

Repology publishes a list of `problems' in repositories. Mostly they're issues with homepage redirects and 404s but probably worth looking into.

https://repology.org/repository/nix_unstable/problems

Might be a good beginner issue for anyone wanting to help out.

mimame commented 7 years ago

@mattbillenstein, I've generated this list from the repology table. I hope to help. I (@pSub) have regenerated the list using the following command xmllint --shell table.html <<< 'cat //tr/td[position()=3]/text()' | grep -v ' -' | sed -e 's/^/- [ ] /'.

vcunat commented 7 years ago

Well, I personally wouldn't consider permanent redirects as problems...

c0bw3b commented 7 years ago

Basically it breaks down into:

  1. dead pages
  2. hosted on Google Code
  3. misc and not really that bad (includes http->https redirect)

@mimadrid did you start some work on your side? I'm willing to tackle the "Google Code" category. It should be ok to find a new homepage or mark as broken for most cases.

mimame commented 7 years ago

@c0bw3b, awesome, feel free to tackle the "Google Code" category @vcunat You're right. I've updated the list without redirects. Homepage redirects aren't a priority

c0bw3b commented 6 years ago

@pSub regenerating the list also reseted what was checked and what was not :( Plus there is plenty of duplicates in your list

pSub commented 6 years ago

I've had a look a some of the checked packages and they seemed to be fixed (i.e. no longer in the list). But you're right, I should have payed more attention and leave the checked ones there. I'll remove the duplicates. I'm really sorry for this quick shot!

c0bw3b commented 6 years ago

No harm done. And yes the already fixed ones are off the list so just sorting out duplicates would be enough to go on.

samueldr commented 6 years ago

Hi, I am using the repology API in a script to parse and classify the issues found by repology. This in turns is formatted as markdown comment.

Tell me if there's anything else you'd want to see from that script. I think I may be able to fetch the proper nixpkgs attribute names instead of the repology package names, haven't tried yet. (This should also give the proper filename).

(I have removed Homepage link is a permanent redirect from the list as I have a PR already fixing most of those automatically.)

Problem: Home page gone with status: cannot connect

Problem: Home page gone with status: connect timeout

Problem: Home page gone with status: DNS problem

Problem: Home page gone with status: HTTP error 400

Problem: Home page gone with status: HTTP error 404

Problem: Home page gone with status: HTTP error 500

Problem: Home page gone with status: HTTP error 502

Problem: Home page gone with status: HTTP error 503

Problem: Home page gone with status: HTTP error 521

Problem: Hoster gone (codeplex)

Problem: Hoster gone (Gna)

Problem: Hoster gone (Google Code)