nacimgoura / instagram-profilecrawl

:computer: Quickly crawl the information (e.g. followers, tags, etc...) of an instagram profile. No login required!
MIT License
121 stars 30 forks source link

Some fields changed #42

Open Raidus opened 6 years ago

Raidus commented 6 years ago

Hi,

thanks for providing this open source code. It's a pleasure to work with :-)

I guess instagram changed their UI, so some fields are not scraped correctly.

Here is my element.json which works in my case:

{
    "notExist": ".dialog-404",
    "dismissInvitationLogin": ".coreSpriteDismissLarge",
    "alias": " div.-vDIg > h1", //changed
    "username": "h1",
    "isOfficial": "span.coreSpriteVerifiedBadge",
    "descriptionProfile": "div.-vDIg > span", //changed
    "urlImgProfile": "header img",
    "website": "div.-vDIg > a",
    "isPrivate": "h2",
    "numberPosts": "ul li:first-child a span", //changed
    "numberFollowers": "ul li:nth-child(2) span",
    "numberFollowing": "ul li:nth-child(3) span",
    "listPost": "article div > a",
    "numberLike": "article section div span > span",
    "numberComments": "article li",
    "numberView": "views",
    "urlImage": "article div > img",
    "video": "video",
    "description": "article ul > li:first-child",
    "tags": "span",
    "mentions": "mentions",
    "date": "time",
    "multipleImage": ".coreSpriteRightChevron"
}

Additionally I had an issue with puppeteer but the fix mentioned in https://github.com/GoogleChrome/puppeteer/issues/2746 solved my problem.

nacimgoura commented 6 years ago

It's true that I haven't looked at this project in a long time. I look at it when I get back from my vacation.