pulibrary / pdc_discovery

Princeton Data Commons discovery portal for Research Data
10 stars 0 forks source link

Crawlers and Globus #633

Open hectorcorrea opened 2 weeks ago

hectorcorrea commented 2 weeks ago

We are having issues with Globus going down and all signs point to crawlers overloading our Globus endpoint.

We have talked about rendering a page with all the metadata but not the links to the actual files when a crawler visit our site as a way to alleviate this issue.

See also #607