Closed chrismytton closed 9 years ago
If a Twitter handle in the source data doesn't exist we should just skip it rather than erroring.
2015-09-04T15:35:11.777010+00:00 app[worker.1]: 2015-09-04T15:35:11.776Z 3 TID-os4kc4klw WARN: {"class"=>"FetchDataJob", "args"=>["5"], "retry"=>true, "queue"=>"default", "jid"=>"391d04596328b5 f3f870cc33", "enqueued_at"=>1441379479.8638542, "error_message"=>"Cannot find specified user.", "error_class"=>"Twitter::Error::Forbidden", "failed_at"=>1441379488.531681, "retry_count"=>6, "re tried_at"=>1441380911.770735} 2015-09-04T15:35:11.777077+00:00 app[worker.1]: 2015-09-04T15:35:11.777Z 3 TID-os4kc4klw WARN: Cannot find specified user. 2015-09-04T15:35:11.777130+00:00 app[worker.1]: 2015-09-04T15:35:11.777Z 3 TID-os4kc4klw WARN: /app/vendor/bundle/ruby/2.0.0/gems/twitter-5.14.0/lib/twitter/rest/response/raise_error.rb:13:in ` on_complete' 2015-09-04T15:35:11.777132+00:00 app[worker.1]: /app/vendor/bundle/ruby/2.0.0/gems/faraday-0.9.1/lib/faraday/response.rb:9:in `block in call' 2015-09-04T15:35:11.777134+00:00 app[worker.1]: /app/vendor/bundle/ruby/2.0.0/gems/faraday-0.9.1/lib/faraday/response.rb:57:in `on_complete' 2015-09-04T15:35:11.777135+00:00 app[worker.1]: /app/vendor/bundle/ruby/2.0.0/gems/faraday-0.9.1/lib/faraday/response.rb:8:in `call' 2015-09-04T15:35:11.777137+00:00 app[worker.1]: /app/vendor/bundle/ruby/2.0.0/gems/faraday-0.9.1/lib/faraday/request/url_encoded.rb:15:in `call' 2015-09-04T15:35:11.777138+00:00 app[worker.1]: /app/vendor/bundle/ruby/2.0.0/gems/faraday-0.9.1/lib/faraday/request/multipart.rb:14:in `call' 2015-09-04T15:35:11.777139+00:00 app[worker.1]: /app/vendor/bundle/ruby/2.0.0/gems/twitter-5.14.0/lib/twitter/rest/request/multipart_with_file.rb:17:in `call' 2015-09-04T15:35:11.777140+00:00 app[worker.1]: /app/vendor/bundle/ruby/2.0.0/gems/faraday-0.9.1/lib/faraday/rack_builder.rb:139:in `build_response' 2015-09-04T15:35:11.777143+00:00 app[worker.1]: /app/vendor/bundle/ruby/2.0.0/gems/faraday-0.9.1/lib/faraday/connection.rb:177:in `post' 2015-09-04T15:35:11.777141+00:00 app[worker.1]: /app/vendor/bundle/ruby/2.0.0/gems/faraday-0.9.1/lib/faraday/connection.rb:377:in `run_request' 2015-09-04T15:35:11.777144+00:00 app[worker.1]: /app/vendor/bundle/ruby/2.0.0/gems/twitter-5.14.0/lib/twitter/rest/request.rb:33:in `perform' 2015-09-04T15:35:11.777145+00:00 app[worker.1]: /app/vendor/bundle/ruby/2.0.0/gems/twitter-5.14.0/lib/twitter/rest/utils.rb:51:in `perform_request' 2015-09-04T15:35:11.777146+00:00 app[worker.1]: /app/vendor/bundle/ruby/2.0.0/gems/twitter-5.14.0/lib/twitter/rest/utils.rb:73:in `perform_request_with_object' 2015-09-04T15:35:11.777147+00:00 app[worker.1]: /app/vendor/bundle/ruby/2.0.0/gems/twitter-5.14.0/lib/twitter/rest/utils.rb:65:in `perform_post_with_object' 2015-09-04T15:35:11.777149+00:00 app[worker.1]: /app/vendor/bundle/ruby/2.0.0/gems/twitter-5.14.0/lib/twitter/rest/lists.rb:459:in `block in list_from_response_with_users' 2015-09-04T15:35:11.777150+00:00 app[worker.1]: /app/vendor/bundle/ruby/2.0.0/gems/twitter-5.14.0/lib/twitter/utils.rb:37:in `block in pmap' 2015-09-04T15:35:11.777151+00:00 app[worker.1]: /app/vendor/bundle/ruby/2.0.0/gems/twitter-5.14.0/lib/twitter/utils.rb:37:in `each_slice' 2015-09-04T15:35:11.777152+00:00 app[worker.1]: /app/vendor/bundle/ruby/2.0.0/gems/twitter-5.14.0/lib/twitter/utils.rb:37:in `each' 2015-09-04T15:35:11.777153+00:00 app[worker.1]: /app/vendor/bundle/ruby/2.0.0/gems/twitter-5.14.0/lib/twitter/utils.rb:37:in `collect' 2015-09-04T15:35:11.777154+00:00 app[worker.1]: /app/vendor/bundle/ruby/2.0.0/gems/twitter-5.14.0/lib/twitter/utils.rb:37:in `pmap' 2015-09-04T15:35:11.777156+00:00 app[worker.1]: /app/vendor/bundle/ruby/2.0.0/gems/twitter-5.14.0/lib/twitter/rest/lists.rb:458:in `list_from_response_with_users' 2015-09-04T15:35:11.777157+00:00 app[worker.1]: /app/vendor/bundle/ruby/2.0.0/gems/twitter-5.14.0/lib/twitter/rest/lists.rb:207:in `add_list_members' 2015-09-04T15:35:11.777158+00:00 app[worker.1]: /app/app/jobs/fetch_data_job.rb:61:in `block in create_lists_for_areas' 2015-09-04T15:35:11.777159+00:00 app[worker.1]: /app/app/jobs/fetch_data_job.rb:44:in `map' 2015-09-04T15:35:11.777160+00:00 app[worker.1]: /app/app/jobs/fetch_data_job.rb:44:in `create_lists_for_areas' 2015-09-04T15:35:11.777162+00:00 app[worker.1]: /app/app/jobs/fetch_data_job.rb:11:in `perform'
If a Twitter handle in the source data doesn't exist we should just skip it rather than erroring.