search

oorestisime / gatsby-source-instagram

Create nodes from instagram posts hashtags and profiles
https://gatsby-src-instagram.netlify.com/
MIT License
149 stars 53 forks source link

Public scraping methods fail due to login screen on Instagram on production builds #24

Closed wjx0820 closed 2 years ago

wjx0820 commented 5 years ago

I use this plugin in my demo and could not work, it says could not fetch instagram posts, no Gatsby nodes generated(I did't use any token and just want to Public scraping for posts). So I cloned your repo, cd into /example, yarn install and run 'npm run develop'. And then it seems like the same problem happened. Wonder to know if i am missing something? Thanks!

matteocarpi commented 3 years ago

hey @tijsluitse thanks for the links!

I was facing this issue and I followed that procedure and was able to get an access token. Though unfortunately I wasn't able to get a token that never expires :/. Simply when I click "debug" for the second time I get told it still expires in three months.

The only thing that I had to do different is using v10.0 of the Graph API, as I had no other option given in the Explorer.

kanlanc commented 3 years ago

@matteocarpi I have the same thing that I cannot access any other API version, but I cant find the permissions mentioned, were they available for you?

matteocarpi commented 3 years ago

hey @kanlanc yes, but it was tricky.

When you click on "Generate Access Token" and a new window pops up, you should be able to click on "Edit settings" or something similar, and allow the app to access the facebook page connected to the instagram account (if that makes sense). at that point, once you confirm and go back to the API Explorer, you should be able to see all the permissions you need.

Hope that helps :)

knhn1004 commented 3 years ago

same, my clients bothered me recently and I still cannot resolve the issue I would have to remove the "Posts" area for their website temporarily seems like an issue with the connection between netlify and instagram

kekshibata commented 3 years ago

So, public scraping is no longer available...? It works for me on local development, but on gatsby cloud build it fails

reaganchisholm commented 3 years ago

So, public scraping is no longer available...? It works for me on local development, but on gatsby cloud build it fails

Public scraping will fail more frequently on hosting sites like Netlify and Gatsby Cloud because there are likely many sites doing public scraping on Instagram via those hosts. Instagram then rate limits those host servers by returning a login page, which causes most builds using public scraping to fail on those hosts.

oorestisime commented 2 years ago

Closing this as i dont think we can do anything more here!