Fixes stop redirect to login pages and fix meta fetch condition - Githubissues

badoux / goscraper

Golang pkg to quickly return a preview of a webpage (title/description/images)

MIT License

108 stars 38 forks source link

Fixes stop redirect to login pages and fix meta fetch condition #10

Closed shawara closed 3 years ago

shawara commented 4 years ago

1-Fix meta data scraping ex: https://www.meetup.com/Berlinstartups/ 2-Added check redirect middleware to prevent url like this from redirect to login https://www.meetup.com/Berlinstartups/?_xtd=gqFyqTIzNjg1ODg3M6Fwp2FuZHJvaWQ&from=ref