search

mozilla / scrumbugz

Scrummy look at Bugzilla data. Discuss in #scrum on irc.mozilla.org.
http://scrumbugz.rtfd.org
Other
32 stars 20 forks source link

Bugzilla Sync Broken #113

Closed mikeizworkin closed 11 years ago

mikeizworkin commented 11 years ago

Scrumbugs is no longer automatically syncing Bugzilla changes.

In the past syncing seemed to occur within 30 seconds of making Bugzilla changes. Since 2013.08.02 I've noticed these bugs not being synced:

I've manually synced each of the bugs above because waiting was impeding my team's progress but automatic sync needs to be restored as soon as possible.

To manually sync bugs I've had to visit the following URL modifying it for each bug

pmclanahan commented 11 years ago

The cause seems to be an enormous jump in the volume of bugmail coming into the system. The daily total volume used to be around 35,000 emails/day, and it recently jumped to somewhere over 200,000 emails/day. This caused the system to back up as it wasn't expecting this, which caused long delays for updates. I'm working on making sure it can handle the volume, and also trying to track down the cause of the volume.

pmclanahan commented 11 years ago

This was actually caused by a flaw in the bugmail checking code; it was not deleting non-bugmail. Apparently the bugmail address for scrumbugz was harvested and started getting twitter and linkedin spam. It wasn't much, but it built up and email was being checked from oldest to newest, and since it checks the email in chunks, the spam was becoming a whole chunk's worth, and thus no other email was being checked. I changed it so that it now deletes all mail it checks, and the queue is once again clear.

mikeizworkin commented 11 years ago

Thanks for the investigation and fix @pmclanahan! :+1:

mikeizworkin commented 11 years ago

@pmclanahan looks like this is happening again. Noticed it yesterday with bug 912709 and today with bug 910876