search

liberaliscomputing / network-mapping

Mozilla Public License 2.0
6 stars 2 forks source link

API Limitation #1

Open liberaliscomputing opened 8 years ago

liberaliscomputing commented 8 years ago

This application aims to facilitate effective networking between people who attend MozFest 2016. If the number of queries exceeds the limitation of API (for example, we only can send 15 queries to collect user information per 15 minutes), however, it returns errors. Given that at least there will be 600 people (the number grows annually), scaling this application is difficult. Is there a Mozilla owned API or MozFest owned API that we can make use of as better data source? Or any suggestion?

cadecairos commented 7 years ago

I misunderstood the problem when I thought I had an idea.

Let me see if I understand the issue - for every person in the tool, we're going to request their following/followers list, in order to build a map of connections with other people in the tool?

It really does sound like this won't scale, and I doubt Twitter's enterprise API is on the table. We could set up an endpoint that syncs data from twitter every 15 minutes for new entries (up to the rate limit for that 15 minute window) and use the Heroku Scheduler add on (it's like cron, for Heroku) to trigger a sync via curl.