processing / processing-website

Repository for the processing.org website
https://processing.org
GNU General Public License v2.0
68 stars 95 forks source link

Broken library links / sources.conf links #387

Open jeremydouglass opened 5 years ago

jeremydouglass commented 5 years ago

Issue description

These links from the processing.org libraries page

https://processing.org/reference/libraries/

are broken / 404, and need to be updated or removed:

jeremydouglass commented 5 years ago

Apologies, I'm working my way through the entire library page over the next hour, and I'm going to edit this issue a few more times to add things that I find. Should have waited to submit until I was done.

REAS commented 5 years ago

All fine. Thank you for moving through it.

jeremydouglass commented 5 years ago

Okay, finished. Thank you for looking at this. If there are ways you would like me to pull request changes more directly, please point me to the associated resources.

REAS commented 5 years ago

I'm late getting back to this... the issue with the libraries is the links are defined by the library owners, in a data file that they host. So, these links can only be fixed by the library owners. We can remove the library from the list, but we can't directly correct the links. Typically, @prisonerjohn will email people to request the change. I'll write to @prisonerjohn now to ask.

prisonerjohn commented 5 years ago

Hello, @jeremydouglass thanks for this audit and @REAS thanks for the ping. I should check GitHub more often than I do... I'll look through these over the next few days and see what's up. As Casey says, it's usually up to the library owners, all we can do is send them a note if something goes wrong.

jeremydouglass commented 5 years ago

@prisonerjohn -- strangely, I also discovered a problem with the Processing.R mode -- and I'm the maintainer of that mode! A local install was preventing me from seeing that it wasn't available through contributions manager due to a moved txt file. I'll make a pull request now to fix that one.

Done: https://github.com/processing/processing-docs/pull/769

jeremydouglass commented 5 years ago

broken sources.conf links

In the course of working on an archiver for all publicly available Processing materials, I developed something that walks sources.conf and logs of everything that fails. This is different from broken links on the library website page, but generally the same root cause -- moved / missing contributions -- so I'm leaving it part of the same issue.

Here is the latest run as of ~last week, grouped by error type. Some may have been temporarily down.

Notably, one of them (opencv) has a valid .txt, but the .zip has bad permissions.

Also, there are a bunch of old things that were published via Dropbox. I believe that Dropbox changed their API long since and that those things aren't going to work again -- they would need new URLs (probably on a different service).

403: Forbidden:http://ubaa.net/shared/processing/opencv/download/opencv.zip

404: Not Found:http://ccl.angusforbes.com/stereo.txt
404: Not Found:http://ccl.angusforbes.com/stereo.zip

404: Not Found:http://dl.dropbox.com/u/69944346/SketchOutline/SketchOutline.txt
404: Not Found:http://dl.dropbox.com/u/69944346/SketchOutline/SketchOutline.zip

404: Not Found:http://download.processing.org/pdeX.txt
404: Not Found:http://download.processing.org/pdeX.zip

404: Not Found:http://libraries.seltar.org/motion/motion.txt
404: Not Found:http://libraries.seltar.org/motion/motion.zip

404: Not Found:http://libraries.seltar.org/postToWeb/postToWeb.txt
404: Not Found:http://libraries.seltar.org/postToWeb/postToWeb.zip

404: Not Found:http://libraries.seltar.org/unzipit/unzipit.txt
404: Not Found:http://libraries.seltar.org/unzipit/unzipit.zip

404: Not Found:http://mrzl.net/yahooweather/YahooWeather.txt
404: Not Found:http://mrzl.net/yahooweather/YahooWeather.zip

404: Not Found:http://poifox.com/bootstrap/download/Bootstrap.txt
404: Not Found:http://poifox.com/bootstrap/download/Bootstrap.zip

404: Not Found:http://poifox.com/templater/download/Templater.txt
404: Not Found:http://poifox.com/templater/download/Templater.zip

404: Not Found:http://saitoobjloader.googlecode.com/files/OBJLoader.txt
404: Not Found:http://saitoobjloader.googlecode.com/files/OBJLoader.zip

404: Not Found:http://sixthsensor.dk/code/p5/point2line/download/point2line.txt
404: Not Found:http://sixthsensor.dk/code/p5/point2line/download/point2line.zip

404: Not Found:http://www.carljohanrosen.com/processing/images/cellnoise-latest.txt
404: Not Found:http://www.carljohanrosen.com/processing/images/cellnoise-latest.zip

404: Not Found:http://www.muvium.com/frappuccino/frappuccino.txt
404: Not Found:http://www.muvium.com/frappuccino/frappuccino.zip

404: Not Found:https://dl.dropbox.com/u/87680069/executor.txt
404: Not Found:https://dl.dropbox.com/u/87680069/executor.zip

404: Not Found:https://dl.dropbox.com/u/87680069/frames.txt
404: Not Found:https://dl.dropbox.com/u/87680069/frames.zip

404: Not Found:https://dl.dropbox.com/u/87680069/gamepad.txt
404: Not Found:https://dl.dropbox.com/u/87680069/gamepad.zip

404: Not Found:https://dl.dropbox.com/u/87680069/LeapMotion.txt
404: Not Found:https://dl.dropbox.com/u/87680069/LeapMotion.zip

404: Not Found:https://dl.dropbox.com/u/87680069/piccolo2d.txt
404: Not Found:https://dl.dropbox.com/u/87680069/piccolo2d.zip

404: Not Found:https://dl.dropboxusercontent.com/u/6030446/bRigid/bRigid.txt
404: Not Found:https://dl.dropboxusercontent.com/u/6030446/bRigid/bRigid.zip

404: Not Found:https://dl.dropboxusercontent.com/u/6030446/punktiert/punktiert.txt
404: Not Found:https://dl.dropboxusercontent.com/u/6030446/punktiert/punktiert.zip

404: Not Found:https://dl.dropboxusercontent.com/u/6990683/Processing/papaya.txt
404: Not Found:https://dl.dropboxusercontent.com/u/6990683/Processing/papaya.zip

404: Not Found:https://dl.dropboxusercontent.com/u/69944346/ColorSelectorPlus/ColorSelectorPlusTool.txt
404: Not Found:https://dl.dropboxusercontent.com/u/69944346/ColorSelectorPlus/ColorSelectorPlusTool.zip

404: Not Found:https://simple-openni.googlecode.com/svn/trunk/SimpleOpenNI-2.0/dist/all/SimpleOpenNI.txt
404: Not Found:https://simple-openni.googlecode.com/svn/trunk/SimpleOpenNI-2.0/dist/all/SimpleOpenNI.zip

408: Request Timeout:http://wyldco.com/romefeeder/download/romefeeder.txt
408: Request Timeout:http://wyldco.com/romefeeder/download/romefeeder.zip

503: Service Unavailable:http://kenai.com/downloads/l-system-utilities/lsystem.txt
503: Service Unavailable:http://kenai.com/downloads/l-system-utilities/lsystem.zip

<urlopen error [Errno 8] nodename nor servname provided, or not known>:http://thomasdiewald.at/processing/libraries/dLibs_freenect/download/dLibs_freenect.txt
<urlopen error [Errno 8] nodename nor servname provided, or not known>:http://thomasdiewald.at/processing/libraries/dLibs_freenect/download/dLibs_freenect.zip
<urlopen error [Errno 8] nodename nor servname provided, or not known>:http://thomasdiewald.com/processing/tools/TabManager/download/TabManager.txt
<urlopen error [Errno 8] nodename nor servname provided, or not known>:http://thomasdiewald.com/processing/tools/TabManager/download/TabManager.zip
jeremydouglass commented 4 years ago

sources.conf has two new entries returning 404 pages when scanned:

033 \ http://ekeneijeoma.com/processing/ijeomamotion/download/ijeomamotion.txt

http://ekeneijeoma.com is redirecting to http://studioijeoma.com, and the txt/zip files are no longer on the same path. The github https://github.com/studioijeoma/ijeomamotion/ is still up, but it doesn't have the files in a release for linking.

066 \ http://ketailibrary.org/ketai.txt

http://ketailibrary.org is gone. http://ketai.org is still up, but the txt/zip files are not on the path there. https://github.com/ketai/ketai/ is still up, but it doesn't have the files in a release for linking.

jeremydouglass commented 4 years ago

The ezgestures listing in sources.conf is now broken due to domain forwarding into a 404:

http://www.silentlycrashing.net/ezgestures/files/ezgestures.txt

Looks like the site is forwarding to "http://prisonerjohn.com/", whoever that is @prisonerjohn ;)

jeremydouglass commented 4 years ago

New errors scanning sources.conf:

404: Not Found:http://hci.soc.napier.ac.uk/GazeTrack/GazeTrack.txt 404: Not Found:https://github.com/Syphon/Processing/releases/download/latest/Syphon.txt 503: Service Unavailable:http://www.stefanobaldan.com/projects/ipcapture/download/IPCapture.txt