karhai / TcorsMiner

0 stars 3 forks source link

Population of Instagram user bio data #7

Open karhai opened 8 years ago

karhai commented 8 years ago

User meta-data is populated a single time when it is initially stored, but never updated. REPLACE'ing users would help to force repopulation (since it initially sets meta-data to null), but would require more usage of quota.

karhai commented 8 years ago

Refactored user scraping to use new code which now only grabs newest Instagram posts. This should significantly cut down on new posts -- and thus, users connected to these posts -- and might allow for using more user scraping, as it will not affect quota as much. Considering it...