search

processing / processing-docs

[Deprecated] Processing reference, examples, tutorials, and website
https://processing.org
371 stars 179 forks source link

contribs.txt not updating? #861

Closed jeremydouglass closed 3 years ago

jeremydouglass commented 3 years ago

(accidentally posted to https://github.com/processing/processing/issues/6208 -- reposting here)

Example:

https://raw.githubusercontent.com/processing/processing-docs/master/contrib_generate/sources.conf

lists:

220 \ https://github.com/processing-r/Processing.R/releases/latest/download/RLangMode.txt

The file RLangMode.txt lists:

version = 109
prettyVersion = v1.0.9

however

http://download.processing.org/contribs

lists

prettyVersion=v1.0.7
maxVersion=0
paragraph=
version=107

which was last true four days ago. This is the same file that is being download by PDE as contribs.txt and listed in Library Manager.

So, Processing.R 108 was released three days ago, 109 yesterday -- so it seems like whatever process is building contribs.txt is taking more than three days? Is this expected, or has the process failed?

@prisonerjohn -- I'm not sure if I should ping you on this.

I tried to do more investigating, but the role of contribs.txt vs. sources.conf isn't described at all in the wiki docs on distribution -- it only describes PDE downloading sources.conf directly, which I'm guessing that description is out of date since ~2014/15

prisonerjohn commented 3 years ago

Thank you @jeremydouglass We are in the process of updating all this, the generation script got lost in the shuffle of the new website. It'll be working again shortly.

jeremydouglass commented 3 years ago

Great news, @prisonerjohn. It will really help with updating modes / libraries and getting the latest changes in front of Processing 3 / 4 users.

jeremydouglass commented 3 years ago

Hi @prisonerjohn -- just wanted to ping on this. Anything I can do to help get mode and library updating working again? Unless it is a more specific scraping problem for the test cases I'm examining, I think it is still not working, and if so I think that means no contribution updates can be detected by PDE from any contributor....

prisonerjohn commented 3 years ago

Hi @jeremydouglass This should be working again now, and updating the list daily automatically. Let me know if you're running into any issues.

jeremydouglass commented 3 years ago

Thanks @prisonerjohn. I just repeated the same test and it seems to fail:

  1. load sources https://raw.githubusercontent.com/processing/processing-docs/master/contrib_generate/sources.conf
  2. load 220 \ https://github.com/processing-r/Processing.R/releases/latest/download/RLangMode.txt
    • version = 109
  3. load http://download.processing.org/contribs
    • version = 107
  4. open PDE
    • version v1.0.7 available

So the mode and its listed .txt are still 109, and /contribs and PDE contributions manager are still 107.

It seems like the source files in sources.conf still aren't having their data copied over to /contribs?

prisonerjohn commented 3 years ago

We are not using this repo anymore, so you won't see updates here. However, https://download.processing.org/contribs is reporting version 109 for me, maybe you're loading a cached version?

jeremydouglass commented 3 years ago

I can see the update on /contribs now. Maybe just a cache / delay. Thank you!

When you say:

We are not using this repo anymore, so you won't see updates here.

Do you mean:

I ask because I can't find anything like contrib-generate or sources.conf on any other repo. Being able to inspect the current catalog data would be very helpful when supporting tool and library authors who are dealing with sync problems.

jeremydouglass commented 3 years ago

Okay, so http://download.processing.org/contribs is showing the old version (Processing.R 107), https://download.processing.org/contribs is showing the new version (Processing.R 109). So that's why I was confused -- I was checking the old http url, and the new https url is where the update happened.

Also, perhaps Processing 3.5.4 might be checking the out-of-date http version, not the updated https version...? I'm not seeing a refresh in Contributions Manager after multiple restarts.

prisonerjohn commented 3 years ago

Good catch, we are looking into it. cc @benfry

As for your question, this repo is being archived in favor of another one that is just used for managing contributions. It's currently private but we can make it public once all the dust settles.

benfry commented 3 years ago

Sorry about that, had missed another path that needed to be updated. All set now.

jeremydouglass commented 3 years ago

Thank you! Confirming that everything looks good -- urls updated, Contribution Manager displayed versions in 3.5.4, and installs performed correctly.