search

vinay20045 / json-to-csv

Nested JSON to CSV Converter
https://askvinay.com/post/converting-nested-json-to-csv-8-december-2013.html
MIT License
285 stars 219 forks source link

Nested Json to csv in python 3 #20

Closed ravikuc closed 6 years ago

ravikuc commented 6 years ago

I am trying to convert JSON data into a CSV in Python3, but it no longer works with this script, giving me different errors. Anyone know how to fix for Python 3? Thanks.

Below is my JSON data:

{ "fruit": [ { "name": "Apple", "binomial name": "Malus domestica", "major_producers": [ "China", "United States", "Turkey" ], "nutrition": { "carbohydrates": "13.81g", "fat": "0.17g", "protein": "0.26g" } }, { "name": "Orange", "binomial name": "Citrus x sinensis", "major_producers": [ "Brazil", "United States", "India" ], "nutrition": { "carbohydrates": "11.75g", "fat": "0.12g", "protein": "0.94g" } }, { "name": "Mango", "binomial name": "Mangifera indica", "major_producers": [ "India", "China", "Thailand" ], "nutrition": { "carbohydrates": "15g", "fat": "0.38g", "protein": "0.82g" } } ] }

ravikuc commented 6 years ago

The output CSV should look like: capture

vinay20045 commented 6 years ago

Hey, what's the error you are seeing?

Have you checked issue #18 ?

ravikuc commented 6 years ago

I am getting the below errors: IndexError: list index out of range 'dict_keys' object is not subscriptable TypeError: string indices must be integers

And, the output CSV file is not generating

vinay20045 commented 6 years ago

Alright, looks like wherever x.keys() is present, it fails in Python 3.X... It will take me some time to look into this in detail as I'm busy with something else at the moment :(

My suggestion to you would be to install Python2.7 in a different (non default) location and run the script with it.

If you happen to fix the issue though, please do submit a pull request and I will review it...

ravikuc commented 6 years ago

@vinay20045, Thanks for investing your valuable time to look into this. I tried with other versions as well, but am unable to get the solution, since my JSON file is a nested one and it has dictionaries. Kindly help me out in this case, it will be useful for me for generating my reports.

vinay20045 commented 6 years ago

Can you please give me a sample set from your actual JSON file? I will try to look into it later today...

ravikuc commented 6 years ago

@vinay20045, please find the below sample JSON file:

{ "took": 4, "timed_out": false, "_shards": { "total": 5, "successful": 5, "failed": 0 }, "hits": { "total": 97, "max_score": 1, "hits": [ { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeb3qumvXnGNd_lTy4", "_score": 1, "_source": { "input": { "crawlTime": 1524149962, "userId": "sushreel", "resolveAction": "RefreshCrawls", "description": "SEQ - Site Layout Change", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "ShoeMall" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 3324, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeb3u2Y5GWheKz7x0d", "_score": 1, "_source": { "input": { "crawlTime": 1524150103, "userId": "sushreel", "resolveAction": "RefreshCrawls", "description": "SEQ - Site Layout Change", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "ShoeMall" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 1204, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLehfGtv1W4uL47gHcd", "_score": 1, "_source": { "input": { "crawlTime": 1524151741, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Samsclub" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "22054-11792-11793-11798" ] } } }, "countOfErrorsDeleted": 3, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeb31dltrfOSLGsOze", "_score": 1, "_source": { "input": { "crawlTime": 1524149962, "userId": "sushreel", "resolveAction": "RefreshCrawls", "description": "SEQ - Site Layout Change", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "ShoeMall" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 5217, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeHG_cJkIL0Hdh_Csz", "_score": 1, "_source": { "input": { "crawlTime": 1524144818, "userId": "tanmoyb", "resolveAction": "RefreshCrawls", "description": "SEQ - Site Layout Change", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "MidwayUSA" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 145, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLennxmmvXnGNd_lXqu", "_score": 1, "_source": { "input": { "crawlTime": 1524153349, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Walgreens" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "45820-40614" ] } } }, "countOfErrorsDeleted": 11, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLel2lAltrfOSLGsSOC", "_score": 1, "_source": { "input": { "crawlTime": 1524152885, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Newegg" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "32737-21561" ] } } }, "countOfErrorsDeleted": 19, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLemTU3PJMavbrmft6k", "_score": 1, "_source": { "input": { "crawlTime": 1524153004, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Newegg" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "29158-21561" ] } } }, "countOfErrorsDeleted": 2, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLemXjCv1W4uL47gI5r", "_score": 1, "_source": { "input": { "crawlTime": 1524153021, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Newegg" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "33234-32711" ] } } }, "countOfErrorsDeleted": 2, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLekhsOv1W4uL47gIXn", "_score": 1, "_source": { "input": { "crawlTime": 1524152538, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Bhphotovideo" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "23710" ] } } }, "countOfErrorsDeleted": 2, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeoKOcJkIL0Hdh_MrJ", "_score": 1, "_source": { "input": { "crawlTime": 1524153491, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Walgreens" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "46115" ] } } }, "countOfErrorsDeleted": 1, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLek69vPJMavbrmftlH", "_score": 1, "_source": { "input": { "crawlTime": 1524152642, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "VitaCost" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "9382" ] } } }, "countOfErrorsDeleted": 1, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLemL8TfAcjqPFe0ygr", "_score": 1, "_source": { "input": { "crawlTime": 1524152973, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Newegg" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "32733" ] } } }, "countOfErrorsDeleted": 4, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLembryqm4M2SWd07Ao", "_score": 1, "_source": { "input": { "crawlTime": 1524152786, "userId": "tanmoyb", "resolveAction": "RefreshCrawls", "description": "SEQ - Site Layout Change", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "OverStock" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 4296, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLerB4PwgP7goBTETE9", "_score": 1, "_source": { "input": { "crawlTime": 1524154133, "userId": "shetagar", "resolveAction": "RefreshCrawls", "description": "CEQ - Read time out errors", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "marketplace": { "operator": "In", "operands": [ "CA" ] }, "errorType": { "operator": "In", "operands": [ "IET_ERROR" ] }, "competitor": { "operator": "In", "operands": [ "Wayfair-Canada" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "43982-43983" ] } } }, "countOfErrorsDeleted": 1736, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLe7xTpJkIL0Hdh_T5U", "_score": 1, "_source": { "input": { "crawlTime": 1524158569, "userId": "shetagar", "resolveAction": "RefreshCrawls", "description": "CEQ - Read time out errors", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "competitorTag": { "operator": "In", "operands": [ "SIC" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "errorType": { "operator": "In", "operands": [ "IET_ERROR" ] }, "competitor": { "operator": "In", "operands": [ "HomeDepot" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "36130" ] } } }, "countOfErrorsDeleted": 960, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLe4LfVfAcjqPFe03ml", "_score": 1, "_source": { "input": { "crawlTime": 1524157623, "userId": "amisahoo", "resolveAction": "RefreshCrawls", "description": "SEQ - Crawl Issue", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "marketplace": { "operator": "In", "operands": [ "US" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "competitor": { "operator": "In", "operands": [ "Safeway-SAC" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "35005-35006" ] } } }, "countOfErrorsDeleted": 1043, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLe2KxSmvXnGNd_ldZY", "_score": 1, "_source": { "input": { "crawlTime": 1524157058, "userId": "amisahoo", "resolveAction": "RefreshCrawls", "description": "SEQ - Site Layout Change", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "marketplace": { "operator": "In", "operands": [ "US" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "competitor": { "operator": "In", "operands": [ "4MDMedical-US" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 1618, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLfPNPFJkIL0Hdh_dX7", "_score": 1, "_source": { "input": { "crawlTime": 1524163708, "userId": "hryashas", "resolveAction": "RefreshCrawls", "description": "SEQ - Crawl Issue", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "marketplace": { "operator": "In", "operands": [ "AU" ] }, "competitor": { "operator": "In", "operands": [ "Fishpond-AU" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 129, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeo6dsY5GWheKz71E5", "_score": 1, "_source": { "input": { "crawlTime": 1524153682, "userId": "roshkhan", "resolveAction": "RefreshCrawls", "description": "SEQ - Crawl Issue", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "competitorTag": { "operator": "In", "operands": [ "NIC" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "competitor": { "operator": "In", "operands": [ "Opentip" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 103, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLfMJfYmvXnGNd_lm0I", "_score": 1, "_source": { "input": { "crawlTime": 1524162804, "userId": "hryashas", "resolveAction": "RefreshCrawls", "description": "SEQ - Crawl Issue", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "marketplace": { "operator": "In", "operands": [ "AU" ] }, "competitor": { "operator": "In", "operands": [ "Myer-AU" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 124, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLfMnr5HpoWqDAfMt--", "_score": 1, "_source": { "input": { "crawlTime": 1524163041, "userId": "shahak", "resolveAction": "RefreshCrawls", "description": "IET - Crawl Issue", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "WasserStrom_MCMT" ] }, "errorType": { "operator": "In", "operands": [ "IET_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "38217" ] } } }, "countOfErrorsDeleted": 129, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeG-uIwgP7goBTELeK", "_score": 1, "_source": { "input": { "crawlTime": 1524144786, "userId": "tanmoyb", "resolveAction": "RefreshCrawls", "description": "IET - Site Layout Change", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "MidwayUSA" ] }, "errorType": { "operator": "In", "operands": [ "IET_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "21989" ] } } }, "countOfErrorsDeleted": 113, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeHiYoHpoWqDAfMU0J", "_score": 1, "_source": { "input": { "crawlTime": 1524144939, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "CEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Costco-CA" ] }, "errorType": { "operator": "In", "operands": [ "CRAWL_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "11427" ] } } }, "countOfErrorsDeleted": 1, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLefzVWfAcjqPFe0w9b", "_score": 1, "_source": { "input": { "crawlTime": 1524151264, "userId": "sushreel", "resolveAction": "RefreshCrawls", "description": "CEQ - Read time out errors", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "marketplace": { "operator": "In", "operands": [ "US" ] }, "competitor": { "operator": "In", "operands": [ "Summit Racing" ] }, "errorType": { "operator": "In", "operands": [ "CRAWL_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 613, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeglHWwgP7goBTEQ1k", "_score": 1, "_source": { "input": { "crawlTime": 1524150751, "userId": "mkvy", "resolveAction": "RefreshCrawls", "description": "CEQ - Read time out errors", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "marketplace": { "operator": "In", "operands": [ "CA" ] }, "competitor": { "operator": "In", "operands": [ "Overstock-CA" ] }, "errorType": { "operator": "In", "operands": [ "CRAWL_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 11078, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeQVrAY5GWheKz7vAI", "_score": 1, "_source": { "input": { "crawlTime": 1524147154, "userId": "roshkhan", "resolveAction": "RefreshCrawls", "description": "SEQ - Crawl Issue", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "competitorTag": { "operator": "In", "operands": [ "NIC" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "competitor": { "operator": "In", "operands": [ "Houzz" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 1459, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeiuDav1W4uL47gH2m", "_score": 1, "_source": { "input": { "crawlTime": 1524152065, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "BestBuy-CA" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "11046-29170-26004-24808" ] } } }, "countOfErrorsDeleted": 5, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeaTbpv1W4uL47gE-C", "_score": 1, "_source": { "input": { "crawlTime": 1524149838, "userId": "tanmoyb", "resolveAction": "RefreshCrawls", "description": "CEQ - Read time out errors", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "PartsTrain" ] }, "errorType": { "operator": "In", "operands": [ "CRAWL_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "9134" ] } } }, "countOfErrorsDeleted": 342, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeHzQUfAcjqPFe0rrg", "_score": 1, "_source": { "input": { "crawlTime": 1524145008, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "BestBuy-MX" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "24233" ] } } }, "countOfErrorsDeleted": 4, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLehTjIHpoWqDAfMcpl", "_score": 1, "_source": { "input": { "crawlTime": 1524151694, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Samsclub" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "11807" ] } } }, "countOfErrorsDeleted": 6, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeZpihv1W4uL47gExk", "_score": 1, "_source": { "input": { "crawlTime": 1524149464, "userId": "tanmoyb", "resolveAction": "RefreshCrawls", "description": "IET - Crawl Issue", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "PartsTrain" ] }, "errorType": { "operator": "In", "operands": [ "IET_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "9134" ] } } }, "countOfErrorsDeleted": 1151, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLegd5CwgP7goBTEQ0I", "_score": 1, "_source": { "input": { "crawlTime": 1524151462, "userId": "sushreel", "resolveAction": "RefreshCrawls", "description": "SEQ - Site Layout Change", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "ShoeMall" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 210, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLekHfbltrfOSLGsRtZ", "_score": 1, "_source": { "input": { "crawlTime": 1524152311, "userId": "amisahoo", "resolveAction": "RefreshCrawls", "description": "SEQ - Site Layout Change", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "marketplace": { "operator": "In", "operands": [ "AU", "MX", "PrimeNow_US", "PrimeNow_JP", "PrimeNow_SG" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "competitor": { "operator": "In", "operands": [ "Itoyokado-PrimeNow_JP" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 840, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeoaFomvXnGNd_lX5w", "_score": 1, "_source": { "input": { "crawlTime": 1524153512, "userId": "sushreel", "resolveAction": "RefreshCrawls", "description": "CEQ - Read time out errors", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "marketplace": { "operator": "In", "operands": [ "US" ] }, "competitor": { "operator": "In", "operands": [ "AutoZone" ] }, "errorType": { "operator": "In", "operands": [ "CRAWL_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "23564" ] } } }, "countOfErrorsDeleted": 679, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLem9OQJkIL0Hdh_MU9", "_score": 1, "_source": { "input": { "crawlTime": 1524153026, "userId": "sushreel", "resolveAction": "RefreshCrawls", "description": "CEQ - Read time out errors", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "marketplace": { "operator": "In", "operands": [ "US" ] }, "competitor": { "operator": "In", "operands": [ "AutoZone" ] }, "errorType": { "operator": "In", "operands": [ "CRAWL_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 2417, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLekjoQmvXnGNd_lWxn", "_score": 1, "_source": { "input": { "crawlTime": 1524152546, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Bhphotovideo" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "43173" ] } } }, "countOfErrorsDeleted": 2, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLenVEAmvXnGNd_lXlx", "_score": 1, "_source": { "input": { "crawlTime": 1524153272, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Walgreens" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "45835" ] } } }, "countOfErrorsDeleted": 31, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLel9ogltrfOSLGsSPz", "_score": 1, "_source": { "input": { "crawlTime": 1524152914, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Newegg" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "32714" ] } } }, "countOfErrorsDeleted": 14, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLenpmCv1W4uL47gJSC", "_score": 1, "_source": { "input": { "crawlTime": 1524153348, "userId": "tanmoyb", "resolveAction": "RefreshCrawls", "description": "CEQ - Read time out errors", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "OverStock" ] }, "errorType": { "operator": "In", "operands": [ "CRAWL_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 157, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLembzNltrfOSLGsSYM", "_score": 1, "_source": { "input": { "crawlTime": 1524152786, "userId": "tanmoyb", "resolveAction": "RefreshCrawls", "description": "SEQ - Site Layout Change", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "OverStock" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 1243, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeoCW7mvXnGNd_lXyn", "_score": 1, "_source": { "input": { "crawlTime": 1524153459, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "CEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Walgreens" ] }, "errorType": { "operator": "In", "operands": [ "CRAWL_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 1, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLfMbSzqm4M2SWd1HER", "_score": 1, "_source": { "input": { "crawlTime": 1524162960, "userId": "hryashas", "resolveAction": "RefreshCrawls", "description": "SEQ - Crawl Issue", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "marketplace": { "operator": "In", "operands": [ "AU" ] }, "competitor": { "operator": "In", "operands": [ "Ebay-AU" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "46526" ] } } }, "countOfErrorsDeleted": 267, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLe3J4GJkIL0Hdh_Sh0", "_score": 1, "_source": { "input": { "crawlTime": 1524157326, "userId": "amisahoo", "resolveAction": "RefreshCrawls", "description": "SEQ - Site Layout Change", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "marketplace": { "operator": "In", "operands": [ "US" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "competitor": { "operator": "In", "operands": [ "Allmodern" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 1430, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLepiU5PJMavbrmfurh", "_score": 1, "_source": { "input": { "crawlTime": 1524153835, "userId": "sushreel", "resolveAction": "RefreshCrawls", "description": "SEQ - Crawl Issue", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "marketplace": { "operator": "In", "operands": [ "US" ] }, "competitor": { "operator": "In", "operands": [ "AutoZone" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 243, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeOdySPJMavbrmfn7K", "_score": 1, "_source": { "input": { "crawlTime": 1524146706, "userId": "tanmoyb", "resolveAction": "RefreshCrawls", "description": "SEQ - Crawl Issue", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "McMaster" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "11196-11197" ] } } }, "countOfErrorsDeleted": 771, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLefyHVJkIL0Hdh_KC-", "_score": 1, "_source": { "input": { "crawlTime": 1524151295, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "BestBuy-MX" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "45510" ] } } }, "countOfErrorsDeleted": 1, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLehJhxqm4M2SWd05yb", "_score": 1, "_source": { "input": { "crawlTime": 1524151652, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Samsclub" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "37198" ] } } }, "countOfErrorsDeleted": 13, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeZpfqPJMavbrmfqqH", "_score": 1, "_source": { "input": { "crawlTime": 1524149464, "userId": "tanmoyb", "resolveAction": "RefreshCrawls", "description": "IET - Crawl Issue", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "PartsTrain" ] }, "errorType": { "operator": "In", "operands": [ "IET_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "9134" ] } } }, "countOfErrorsDeleted": 3580, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeb3tDY5GWheKz7x0c", "_score": 1, "_source": { "input": { "crawlTime": 1524149962, "userId": "sushreel", "resolveAction": "RefreshCrawls", "description": "SEQ - Site Layout Change", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "ShoeMall" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 1212, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLePnb9fAcjqPFe0tMD", "_score": 1, "_source": { "input": { "crawlTime": 1524147048, "userId": "tanmoyb", "resolveAction": "RefreshCrawls", "description": "SEQ - Site Layout Change", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "McMaster" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 149, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLehOKPPJMavbrmfsql", "_score": 1, "_source": { "input": { "crawlTime": 1524151671, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Samsclub" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "37676-37677-57702" ] } } }, "countOfErrorsDeleted": 12, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLehixqfAcjqPFe0xgs", "_score": 1, "_source": { "input": { "crawlTime": 1524151757, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Samsclub" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "37997-37677-57702" ] } } }, "countOfErrorsDeleted": 1, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLejzLrmvXnGNd_lWkO", "_score": 1, "_source": { "input": { "crawlTime": 1524152348, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Bhphotovideo" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "23706-11822" ] } } }, "countOfErrorsDeleted": 3, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLej2G3v1W4uL47gILU", "_score": 1, "_source": { "input": { "crawlTime": 1524152360, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Bhphotovideo" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "22996" ] } } }, "countOfErrorsDeleted": 2, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLek0uywgP7goBTERzH", "_score": 1, "_source": { "input": { "crawlTime": 1524152616, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "VitaCost" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "20038" ] } } }, "countOfErrorsDeleted": 3, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLehV1BPJMavbrmfss9", "_score": 1, "_source": { "input": { "crawlTime": 1524151704, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Samsclub" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "24196" ] } } }, "countOfErrorsDeleted": 5, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLejdJ7JkIL0Hdh_LV4", "_score": 1, "_source": { "input": { "crawlTime": 1524152258, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "TheBay" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "10555" ] } } }, "countOfErrorsDeleted": 6, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLem7kAltrfOSLGsSg-", "_score": 1, "_source": { "input": { "crawlTime": 1524153168, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "HomeDepot" ] }, "errorType": { "operator": "In", "operands": [ "CRAWL_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 26, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLejaaOqm4M2SWd06Wb", "_score": 1, "_source": { "input": { "crawlTime": 1524152246, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "CEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "TheBay" ] }, "errorType": { "operator": "In", "operands": [ "CRAWL_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 6, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLerB2pv1W4uL47gKXl", "_score": 1, "_source": { "input": { "crawlTime": 1524154133, "userId": "shetagar", "resolveAction": "RefreshCrawls", "description": "CEQ - Read time out errors", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "marketplace": { "operator": "In", "operands": [ "CA" ] }, "errorType": { "operator": "In", "operands": [ "IET_ERROR" ] }, "competitor": { "operator": "In", "operands": [ "Wayfair-Canada" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "43982-43983" ] } } }, "countOfErrorsDeleted": 456, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeo-xGY5GWheKz71GR", "_score": 1, "_source": { "input": { "crawlTime": 1524153663, "userId": "amisahoo", "resolveAction": "RefreshCrawls", "description": "IET - Crawl Issue", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "marketplace": { "operator": "In", "operands": [ "US" ] }, "errorType": { "operator": "In", "operands": [ "IET_ERROR" ] }, "competitor": { "operator": "In", "operands": [ "Target" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "35846" ] } } }, "countOfErrorsDeleted": 650, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLem9K2fAcjqPFe0yrD", "_score": 1, "_source": { "input": { "crawlTime": 1524153026, "userId": "sushreel", "resolveAction": "RefreshCrawls", "description": "CEQ - Read time out errors", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "marketplace": { "operator": "In", "operands": [ "US" ] }, "competitor": { "operator": "In", "operands": [ "AutoZone" ] }, "errorType": { "operator": "In", "operands": [ "CRAWL_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 1390, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLem9VGltrfOSLGsShe", "_score": 1, "_source": { "input": { "crawlTime": 1524153173, "userId": "sushreel", "resolveAction": "RefreshCrawls", "description": "CEQ - Read time out errors", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "marketplace": { "operator": "In", "operands": [ "US" ] }, "competitor": { "operator": "In", "operands": [ "AutoZone" ] }, "errorType": { "operator": "In", "operands": [ "CRAWL_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 60, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeVbPqHpoWqDAfMY22", "_score": 1, "_source": { "input": { "crawlTime": 1524148541, "userId": "devanars", "resolveAction": "RefreshCrawls", "description": "IET - Crawl Issue", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "marketplace": { "operator": "In", "operands": [ "US" ] }, "errorType": { "operator": "In", "operands": [ "IET_ERROR" ] }, "competitor": { "operator": "In", "operands": [ "NationalBuilderSupply" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "39000" ] } } }, "countOfErrorsDeleted": 628, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeglHKPJMavbrmfsc2", "_score": 1, "_source": { "input": { "crawlTime": 1524150751, "userId": "mkvy", "resolveAction": "RefreshCrawls", "description": "CEQ - Read time out errors", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "marketplace": { "operator": "In", "operands": [ "CA" ] }, "competitor": { "operator": "In", "operands": [ "Overstock-CA" ] }, "errorType": { "operator": "In", "operands": [ "CRAWL_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 13882, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLegI78PJMavbrmfsSW", "_score": 1, "_source": { "input": { "crawlTime": 1524151388, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Mrchewy" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "11140" ] } } }, "countOfErrorsDeleted": 2, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeGq2NHpoWqDAfMUle", "_score": 1, "_source": { "input": { "crawlTime": 1524144711, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "CEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Wayfair" ] }, "errorType": { "operator": "In", "operands": [ "CRAWL_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 4, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeiPbOqm4M2SWd06GU", "_score": 1, "_source": { "input": { "crawlTime": 1524151815, "userId": "hryashas", "resolveAction": "RefreshCrawls", "description": "CEQ - Read time out errors", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "marketplace": { "operator": "In", "operands": [ "AU" ] }, "competitor": { "operator": "In", "operands": [ "Dick Smith-AU" ] }, "errorType": { "operator": "In", "operands": [ "FAILED_USER_ACTION_EXECUTION" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "45628" ] } } }, "countOfErrorsDeleted": 884, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeph0WmvXnGNd_lYQp", "_score": 1, "_source": { "input": { "crawlTime": 1524153746, "userId": "amisahoo", "resolveAction": "RefreshCrawls", "description": "IET - Crawl Issue", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "marketplace": { "operator": "In", "operands": [ "US" ] }, "errorType": { "operator": "In", "operands": [ "IET_ERROR" ] }, "competitor": { "operator": "In", "operands": [ "Macy_s" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "59058" ] } } }, "countOfErrorsDeleted": 1578, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeifApY5GWheKz7zqk", "_score": 1, "_source": { "input": { "crawlTime": 1524152002, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "BestBuy-CA" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "11046-29170-44311-24808" ] } } }, "countOfErrorsDeleted": 18, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeklgQwgP7goBTERwF", "_score": 1, "_source": { "input": { "crawlTime": 1524152555, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Bhphotovideo" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "23722-11822" ] } } }, "countOfErrorsDeleted": 1, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLenvSAPJMavbrmfuPR", "_score": 1, "_source": { "input": { "crawlTime": 1524153370, "userId": "tanmoyb", "resolveAction": "RefreshCrawls", "description": "CEQ - Read time out errors", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "OverStock" ] }, "errorType": { "operator": "In", "operands": [ "CRAWL_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "9101" ] } } }, "countOfErrorsDeleted": 161, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLejDeQmvXnGNd_lWXK", "_score": 1, "_source": { "input": { "crawlTime": 1524152152, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "TheBay" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "11941" ] } } }, "countOfErrorsDeleted": 13, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLelz0sv1W4uL47gIvv", "_score": 1, "_source": { "input": { "crawlTime": 1524152872, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Newegg" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "32711" ] } } }, "countOfErrorsDeleted": 65, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLenumCJkIL0Hdh_MjZ", "_score": 1, "_source": { "input": { "crawlTime": 1524153378, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Walgreens" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 3, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLenDMxmvXnGNd_lXgV", "_score": 1, "_source": { "input": { "crawlTime": 1524153200, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "HomeDepot" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 1, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLexI4nmvXnGNd_lbP2", "_score": 1, "_source": { "input": { "crawlTime": 1524155680, "userId": "sushanti", "resolveAction": "RefreshCrawls", "description": "SEQ - Crawl Issue", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "competitorTag": { "operator": "In", "operands": [ "IC" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "competitor": { "operator": "In", "operands": [ "Frys" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 1485, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLfMWy8JkIL0Hdh_buU", "_score": 1, "_source": { "input": { "crawlTime": 1524162964, "userId": "shahak", "resolveAction": "RefreshCrawls", "description": "IET - Crawl Issue", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "WasserStrom_MCMT" ] }, "errorType": { "operator": "In", "operands": [ "IET_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "38217-38218-38219-38220" ] } } }, "countOfErrorsDeleted": 247, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeglHIY5GWheKz7zH6", "_score": 1, "_source": { "input": { "crawlTime": 1524150751, "userId": "mkvy", "resolveAction": "RefreshCrawls", "description": "CEQ - Read time out errors", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "marketplace": { "operator": "In", "operands": [ "CA" ] }, "competitor": { "operator": "In", "operands": [ "Overstock-CA" ] }, "errorType": { "operator": "In", "operands": [ "CRAWL_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 12279, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLefo4oY5GWheKz7yyK", "_score": 1, "_source": { "input": { "crawlTime": 1524151257, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "BestBuy-MX" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "44511" ] } } }, "countOfErrorsDeleted": 2, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeHeCYfAcjqPFe0roD", "_score": 1, "_source": { "input": { "crawlTime": 1524144922, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Costco-CA" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "11425" ] } } }, "countOfErrorsDeleted": 3, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeG3quY5GWheKz7s_j", "_score": 1, "_source": { "input": { "crawlTime": 1524144751, "userId": "tanmoyb", "resolveAction": "RefreshCrawls", "description": "CEQ - Read time out errors", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "MidwayUSA" ] }, "errorType": { "operator": "In", "operands": [ "CRAWL_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 203, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeb3qSPJMavbrmfrKF", "_score": 1, "_source": { "input": { "crawlTime": 1524150103, "userId": "sushreel", "resolveAction": "RefreshCrawls", "description": "SEQ - Site Layout Change", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "ShoeMall" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 3080, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLefb9tltrfOSLGsQA0", "_score": 1, "_source": { "input": { "crawlTime": 1524151167, "userId": "sushreel", "resolveAction": "RefreshCrawls", "description": "SEQ - Site Layout Change", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "ShoeMall" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 641, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeHCKSv1W4uL47f_WV", "_score": 1, "_source": { "input": { "crawlTime": 1524144807, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Walmart-CA-Online" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 1, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeXvYOltrfOSLGsNpV", "_score": 1, "_source": { "input": { "crawlTime": 1524149186, "userId": "devanars", "resolveAction": "MarkAsPRM", "description": "IET - GL Not Monitored", "filters": { "competitor": { "operator": "In", "operands": [ "Yodobashi" ] }, "errorType": { "operator": "In", "operands": [ "IET_ERROR" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "11002" ] } } }, "countOfErrorsDeleted": 2, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLe7xrPmvXnGNd_lfH6", "_score": 1, "_source": { "input": { "crawlTime": 1524158569, "userId": "shetagar", "resolveAction": "RefreshCrawls", "description": "CEQ - Read time out errors", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "competitorTag": { "operator": "In", "operands": [ "SIC" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "errorType": { "operator": "In", "operands": [ "IET_ERROR" ] }, "competitor": { "operator": "In", "operands": [ "HomeDepot" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "36130" ] } } }, "countOfErrorsDeleted": 10, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLeph0-PJMavbrmfurX", "_score": 1, "_source": { "input": { "crawlTime": 1524153746, "userId": "amisahoo", "resolveAction": "RefreshCrawls", "description": "IET - Crawl Issue", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "marketplace": { "operator": "In", "operands": [ "US" ] }, "errorType": { "operator": "In", "operands": [ "IET_ERROR" ] }, "competitor": { "operator": "In", "operands": [ "Macy_s" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "59058" ] } } }, "countOfErrorsDeleted": 579, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLexI_EY5GWheKz73ha", "_score": 1, "_source": { "input": { "crawlTime": 1524155680, "userId": "sushanti", "resolveAction": "RefreshCrawls", "description": "SEQ - Crawl Issue", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "competitorTag": { "operator": "In", "operands": [ "IC" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "competitor": { "operator": "In", "operands": [ "Frys" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 2703, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLencYHfAcjqPFe0yxX", "_score": 1, "_source": { "input": { "crawlTime": 1524153302, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Walgreens" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "45756-40614" ] } } }, "countOfErrorsDeleted": 15, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLemJlOmvXnGNd_lXP6", "_score": 1, "_source": { "input": { "crawlTime": 1524152964, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Newegg" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "32762-21561" ] } } }, "countOfErrorsDeleted": 5, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLehljBfAcjqPFe0xhg", "_score": 1, "_source": { "input": { "crawlTime": 1524151767, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Samsclub" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "38310" ] } } }, "countOfErrorsDeleted": 1, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLemQanPJMavbrmft5x", "_score": 1, "_source": { "input": { "crawlTime": 1524152992, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Newegg" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "41092" ] } } }, "countOfErrorsDeleted": 3, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLemZoDv1W4uL47gI6N", "_score": 1, "_source": { "input": { "crawlTime": 1524153030, "userId": "shahak", "resolveAction": "MarkAsPRM", "description": "SEQ - Invalid URL", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "Newegg" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAMarketplace" ] }, "crawlPath": { "operator": "In", "operands": [ "32711" ] } } }, "countOfErrorsDeleted": 1, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLembuFwgP7goBTESHR", "_score": 1, "_source": { "input": { "crawlTime": 1524152786, "userId": "tanmoyb", "resolveAction": "RefreshCrawls", "description": "SEQ - Site Layout Change", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "competitor": { "operator": "In", "operands": [ "OverStock" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 3225, "countOfFailures": 0 } }, { "_index": "ues-log", "_type": "ResolveWorkItemLog", "_id": "AWLfMJgMJkIL0Hdh_bmA", "_score": 1, "_source": { "input": { "crawlTime": 1524162804, "userId": "hryashas", "resolveAction": "RefreshCrawls", "description": "SEQ - Crawl Issue", "filters": { "clientId": { "operator": "In", "operands": [ "CRAWLER" ] }, "subqualifier": { "operator": "In", "operands": [ "DEFAULT" ] }, "marketplace": { "operator": "In", "operands": [ "AU" ] }, "competitor": { "operator": "In", "operands": [ "Myer-AU" ] }, "errorType": { "operator": "In", "operands": [ "SCRAPE_ERROR" ] }, "qualifier": { "operator": "In", "operands": [ "NEW" ] }, "namespace": { "operator": "In", "operands": [ "AMZN" ] }, "source": { "operator": "In", "operands": [ "ONLINE" ] }, "region": { "operator": "In", "operands": [ "NAAmazon" ] }, "crawlPath": { "operator": "In", "operands": [ "" ] } } }, "countOfErrorsDeleted": 821, "countOfFailures": 0 } } ] } }

vinay20045 commented 6 years ago

Ok, I took a look into this and the script works just fine with Python3. No errors.

You probably need to modify your JSON a bit to get it to work the way you want... Here's what I did and my output...

  1. Modified your JSON to retain only the hits array...

    screen shot 2018-05-28 at 8 07 54 am

  2. Ran it with the script (in Python3, my version is 3.6.3)

    screen shot 2018-05-28 at 8 05 25 am

  3. And the output looks like...

    screen shot 2018-05-28 at 8 23 19 am

Let me know how it works out for you...

ravikuc commented 6 years ago

@vinay20045, Thank you so much. It helps me a lot.

ravikuc commented 6 years ago

@vinay20045, Can't we get the CVS data in same order?

Like this: capture2

What we are getting is like: capture1

Columns are not in same order.

vinay20045 commented 6 years ago

The sort is done explicitly to guarantee some order (in this case alphabetical). Read this post to fully understand the working.

You can try tinkering with the code to get your expected results. A good place to start is by commenting line 90.

PS: Please open a new issue with appropriate title in case you face any errors or want to discuss something. This will help preserve context for future readers :)