mozilla / spade

Automated scraping markup+CSS from a list of relevant URLs, using a variety of user-agent strings. Provides reporting on usage of CSS properties and apparent user-agent sniffing.
22 stars 9 forks source link

Fix db integrity error on data aggregation #66

Open maurodoglio opened 11 years ago

maurodoglio commented 11 years ago

Executing the "aggregate" django custom command an error is raised:

IntegrityError: (1062, "Duplicate entry '2603' for key 'urlcontent_id'")