openaustralia / morph

Take the hassle out of web scraping
https://morph.io
GNU Affero General Public License v3.0
461 stars 74 forks source link

morph.io website is very slow to load #1167

Closed LoveMyData closed 6 years ago

LoveMyData commented 6 years ago

the web site easily take 30 plus seconds to load in a browser.

LoveMyData commented 6 years ago

If i open https://morph.io in incognito mode, morph.io is pretty quick to load. but as soon as I go to page like https://morph.io/planningalerts-scrapers/. it is taking forever to load.

henare commented 6 years ago

I'm not even able to access the site in private browsing. When I first tried I got this error:

screenshot from 2017-12-13 14-16-11

Now I'm getting no response at all. http://downforeveryoneorjustme.com/morph.io says,

It's not just you! morph.io looks down from here.

mlandauer commented 6 years ago

A few speed optimisations have been made in 628d6194cb7b09c4456626d7c877673aeb7d8aad, fa603afbb2cc452dbd00305b2355f1391a81dc71, 157528bb1796c6d0a48f532575e63ff98542be83 and 5a47b48f798ffb2b8cec83130c63e9eea6e48f07.

These speed up the home page (when logged in), user or organisation pages with lots of scrapers (like https://morph.io/planningalerts-scrapers/) and scraper pages with lots of runs on them.

The pages don't exactly load super fast now but they're not like craaazzy long anymore. I do think that the site overall needs a lot more work to make it feel really speedy again (like in the good old days) but i think the current fixes are good enough to at least close this ticket.