Closed JohnArrowwood closed 7 years ago
JohnArrowwood
commented
7 years ago I split the one folder (which had over 500 requests in it) into 4 folders. I then ran the whole collection, including all 4 folders. It worked fine. Which means there seems to be a problem with having so many requests in a single folder.
sdnts
commented
7 years ago @JohnArrowwood This looks like a performance issue. I see you have a pretty large collection (folder). There is no physical limit to the number of requests you can have in a folder.
I do have one suggestion, though. When the Runner runs a collection, it logs out the responses it receives (which stay in memory, and are viewable when you click on the request name), and that might cause memory to overflow. Can you try changing the value of the Log Responses dropdown in the Run parameter section to log out only some responses (only for failed requests, perhaps?) and see if that helps you get through the entire collection in one go?
patric-eberle
commented
7 years ago Can report the same (?) problem. I have a collection with a total of 44 request grouped in 18 folders. When I test the collection in the runner, only one two tests of each folder seems to get tested.
sdnts
commented
7 years ago @patric-eberle Can you also split up your collection to make it run properly? Can you guys try running your collection in Newman? It is extremely easy to set up, and will help me isolate where the problem lies.
The Runner and Newman both run on top of Postman Runtime, so you'll just have to export your collection (+ environment, if needed) and run it using so: newman run <collection>.json -e <environment>.json
patric-eberle
commented
7 years ago Removing the folders from the collection did not make a big difference. Still only some of the tests are executed. Interestingly it seems to pick the same requests. Newman executed all 44 tests.
Side note: I imported my endpoints from Swagger. I included a partial export of the Postman collection for you.
Some example data from the collection as JSON export.
{
"id": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"name": "Test examples",
"description": "Test examples",
"order": [],
"folders": [
{
"description": "Folder for configuration-attachments",
"id": "b7eaa893-d333-b9be-2886-db74447985b5",
"name": "configuration-attachments",
"order": [
"375bb87c-8af6-0a28-85ec-12a88191fdf7",
"08262047-6f09-99e5-1cdd-c06ccd16005a",
"fbc317e1-a368-2b98-4537-cf3e0fc9983a",
"f97f6661-3dbc-d548-539b-2e37f16946f0",
"9483256d-d2ec-c985-e81d-4efa319e5f48"
],
"owner": 0
},
{
"description": "Folder for configuration-element-restorations",
"id": "a7afaece-8561-300c-78bb-c3f4c06711ca",
"name": "configuration-element-restorations",
"order": [
"c3267c1f-c835-abf5-5d27-9230566e3e0c",
"f5a2cb81-95e2-9bba-f791-6e7c3397e7ff",
"0615e151-f048-e68b-ccaa-3cb25f992035",
"8e011064-db1a-5f03-dab6-bea2eea108d6",
"83178f68-6c04-a9c5-836a-1bb060c6ab39"
],
"owner": 0
},
{
"description": "Folder for configuration-main-restorations",
"id": "495f9224-d2a2-6075-0c47-29cab3a3128d",
"name": "configuration-main-restorations",
"order": [
"baa4b86e-8238-3298-c3b3-b253d42eed39",
"51b2e3e5-6667-226e-b7c5-5633624d0ac2",
"5dac03e4-b500-133a-f8fc-00c14c9be842",
"5326ae88-676d-f701-29a1-e09c4308b4b5"
],
"owner": 0
},
{
"description": "Folder for configurations",
"id": "cd0fd71b-8fd0-a32b-bd05-1647af21c01c",
"name": "configurations",
"order": [
"f08068ad-03b6-7da8-78d8-19e73d6d6960",
"805a004f-7b7a-e59f-de23-f90d5507289d",
"e61ebcd5-4c95-e4a5-acc6-242b910763e3",
"d78407ee-7d36-2ec6-041c-a5f4ed47a0f6"
],
"owner": 0
},
{
"description": "Folder for dashboard-items",
"id": "3ecd319a-08df-f4cd-ecbd-4559a97dde76",
"name": "dashboard-items",
"order": [
"13b4133a-7c5b-f497-9927-ef6d6c332a98"
],
"owner": 0
},
{
"description": "Folder for option-attribute-sets",
"id": "f72b2b46-d118-1f0f-a7ee-435979112c02",
"name": "option-attribute-sets",
"order": [
"8e8c1400-b293-dd4a-3efc-3adc6e7dfaae"
],
"owner": 0
},
{
"description": "Folder for option-attributes",
"id": "f52e62cf-0ef6-8833-b737-2cd2d4967be4",
"name": "option-attributes",
"order": [
"78646ce5-09e3-f5d0-04dc-adf4f7867a5a"
],
"owner": 0
},
{
"description": "Folder for option-configuration-types",
"id": "4742670f-6135-2eaf-046a-d55091d49faa",
"name": "option-configuration-types",
"order": [
"5d4e6a95-1310-5b5a-cd3c-74b72bda04e2"
],
"owner": 0
},
{
"description": "Folder for option-element-restorations",
"id": "e326e1f2-dfa9-69f1-4a63-4ac696b44963",
"name": "option-element-restorations",
"order": [
"e5a11dac-66b6-5a78-2a1d-3584ed4b4ebb"
],
"owner": 0
},
{
"description": "Folder for option-main-restorations",
"id": "01b0b37b-e99e-98a6-f360-a235a4aa1713",
"name": "option-main-restorations",
"order": [
"786e062f-b7fa-518d-37af-34caa2611d0c"
],
"owner": 0
},
{
"description": "Folder for order-sub-positions",
"id": "12e96d2d-9052-780f-7218-c75d3f4840fc",
"name": "order-sub-positions",
"order": [
"0fff9f9e-0646-b05a-ebd4-f5d9f3422352",
"876431bd-d064-7eb2-815b-16df0f5d67ac"
],
"owner": 0
},
{
"description": "Folder for orders",
"id": "3029407c-d447-311a-3fe7-a388612383c1",
"name": "orders",
"order": [
"3d718508-0f9a-c262-f2ff-7f794fa44a11",
"3556a48f-5b14-c633-9aed-5f163bbf824d",
"daa07787-bc8b-44ae-d514-ec384c066e7c"
],
"owner": 0
}
],
"timestamp": 1482221308535,
"owner": 0,
"public": false,
"requests": [
{
"id": "0615e151-f048-e68b-ccaa-3cb25f992035",
"headers": "Content-Type: application/json\nuser: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/configuration-element-restorations/:configurationElementRestorationId",
"preRequestScript": "",
"pathVariables": {
"configurationElementRestorationId": "{{configurationElementRestorationId}}"
},
"method": "PATCH",
"data": [],
"dataMode": "raw",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1482132871226,
"name": "PATCH configuration-main-restorations",
"description": "",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"rawModeData": "",
"folder": "a7afaece-8561-300c-78bb-c3f4c06711ca"
},
{
"id": "08262047-6f09-99e5-1cdd-c06ccd16005a",
"headers": "foo: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/configuration-attachments",
"preRequestScript": "",
"pathVariables": {},
"method": "OPTIONS",
"data": [],
"dataMode": "params",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481188953736,
"name": "OPT configuration-attachments + filter",
"description": "",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"folder": "b7eaa893-d333-b9be-2886-db74447985b5"
},
{
"id": "0fff9f9e-0646-b05a-ebd4-f5d9f3422352",
"headers": "foo: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/order-sub-positions/:orderSubPositionId",
"preRequestScript": "",
"pathVariables": {
"orderSubPositionId": "{{orderSubPositionId}}"
},
"method": "PATCH",
"data": [],
"dataMode": "raw",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481189139063,
"name": "PATCH order-sub-positions",
"description": "",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"rawModeData": "",
"folder": "12e96d2d-9052-780f-7218-c75d3f4840fc"
},
{
"id": "13b4133a-7c5b-f497-9927-ef6d6c332a98",
"headers": "foo: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/dashboard-items",
"preRequestScript": "",
"pathVariables": {},
"method": "GET",
"data": [],
"dataMode": "params",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481188546153,
"name": "GET dashboard-items",
"description": "",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"folder": "3ecd319a-08df-f4cd-ecbd-4559a97dde76"
},
{
"id": "3556a48f-5b14-c633-9aed-5f163bbf824d",
"headers": "foo: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/orders/:orderId",
"preRequestScript": "",
"pathVariables": {
"orderId": "{{orderId}}"
},
"method": "PATCH",
"data": [],
"dataMode": "raw",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481188621898,
"name": "PATCH orders",
"description": "",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"rawModeData": "",
"folder": "3029407c-d447-311a-3fe7-a388612383c1"
},
{
"id": "375bb87c-8af6-0a28-85ec-12a88191fdf7",
"headers": "Content-Type: application/json\nuser: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/configuration-attachments",
"preRequestScript": "",
"pathVariables": {},
"method": "POST",
"data": [],
"dataMode": "raw",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481188429667,
"name": "POST configuration-attachments",
"description": "",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"rawModeData": "",
"folder": "b7eaa893-d333-b9be-2886-db74447985b5"
},
{
"id": "3d718508-0f9a-c262-f2ff-7f794fa44a11",
"headers": "foo: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/orders?filter[configurationId]={{filter[configurationId]}}&include={{includeOrder}}",
"preRequestScript": "",
"pathVariables": {},
"method": "GET",
"data": [],
"dataMode": "params",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481188618177,
"name": "GET orders",
"description": "Note: user-addresses will be requested with the user on login\n",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"folder": "3029407c-d447-311a-3fe7-a388612383c1"
},
{
"id": "51b2e3e5-6667-226e-b7c5-5633624d0ac2",
"headers": "foo: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/configuration-main-restorations/:configurationMainRestorationId",
"preRequestScript": "",
"pathVariables": {
"configurationMainRestorationId": "{{configurationMainRestorationId}}"
},
"method": "PATCH",
"data": [],
"dataMode": "raw",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481192607987,
"name": "PATCH configuration-main-restorations",
"description": "",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"rawModeData": "",
"folder": "495f9224-d2a2-6075-0c47-29cab3a3128d"
},
{
"id": "5326ae88-676d-f701-29a1-e09c4308b4b5",
"headers": "foo: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/configuration-main-restorations/:configurationMainRestorationId",
"preRequestScript": "",
"pathVariables": {
"configurationMainRestorationId": "{{configurationMainRestorationId}}"
},
"method": "DELETE",
"data": [],
"dataMode": "params",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481188523694,
"name": "DEL configuration-main-restorations",
"description": "",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"folder": "495f9224-d2a2-6075-0c47-29cab3a3128d"
},
{
"id": "5d4e6a95-1310-5b5a-cd3c-74b72bda04e2",
"headers": "foo: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/option-configuration-types",
"preRequestScript": "",
"pathVariables": {},
"method": "GET",
"data": [],
"dataMode": "params",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481188594943,
"name": "GET option-configuration-types",
"description": "Gets available Option Configuration Types to be used to populate the Configurator form.\n",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"folder": "4742670f-6135-2eaf-046a-d55091d49faa"
},
{
"id": "5dac03e4-b500-133a-f8fc-00c14c9be842",
"headers": "foo: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/configuration-main-restorations/:configurationMainRestorationId",
"preRequestScript": "",
"pathVariables": {
"configurationMainRestorationId": "{{configurationMainRestorationId}}"
},
"method": "OPTIONS",
"data": [],
"dataMode": "params",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481188518949,
"name": "OPT configuration-main-restorations + id",
"description": "",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"folder": "495f9224-d2a2-6075-0c47-29cab3a3128d"
},
{
"id": "78646ce5-09e3-f5d0-04dc-adf4f7867a5a",
"headers": "foo: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/option-attributes",
"preRequestScript": "",
"pathVariables": {},
"method": "GET",
"data": [],
"dataMode": "params",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481188589262,
"name": "GET option-attributes",
"description": "",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"folder": "f52e62cf-0ef6-8833-b737-2cd2d4967be4"
},
{
"id": "786e062f-b7fa-518d-37af-34caa2611d0c",
"headers": "foo: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/option-main-restorations?include={{include}}",
"preRequestScript": "",
"pathVariables": {},
"method": "GET",
"data": [],
"dataMode": "params",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481188603104,
"name": "GET option-main-restorations",
"description": "Gets available Option Main Restorations to be used to populate the Configurator form.\n",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"folder": "01b0b37b-e99e-98a6-f360-a235a4aa1713"
},
{
"id": "805a004f-7b7a-e59f-de23-f90d5507289d",
"headers": "foo: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/configurations/:configurationId?include={{includeConfiguration}}",
"preRequestScript": "",
"pathVariables": {
"configurationId": "{{configurationId}}"
},
"method": "GET",
"data": [],
"dataMode": "params",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481188532855,
"name": "GET configurations",
"description": "",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"folder": "cd0fd71b-8fd0-a32b-bd05-1647af21c01c"
},
{
"id": "83178f68-6c04-a9c5-836a-1bb060c6ab39",
"headers": "foo: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/configuration-element-restorations/:configurationElementRestorationId",
"preRequestScript": "",
"pathVariables": {
"configurationElementRestorationId": "{{configurationElementRestorationId}}"
},
"method": "DELETE",
"data": [],
"dataMode": "params",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481188503924,
"name": "DEL configuration-element-restorations",
"description": "",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"folder": "a7afaece-8561-300c-78bb-c3f4c06711ca"
},
{
"id": "876431bd-d064-7eb2-815b-16df0f5d67ac",
"headers": "foo: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/order-sub-positions/:orderSubPositionId",
"preRequestScript": "",
"pathVariables": {
"orderSubPositionId": "{{orderSubPositionId}}"
},
"method": "OPTIONS",
"data": [],
"dataMode": "params",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481188611312,
"name": "OPT order-sub-positions + id",
"description": "",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"folder": "12e96d2d-9052-780f-7218-c75d3f4840fc"
},
{
"id": "8e011064-db1a-5f03-dab6-bea2eea108d6",
"headers": "foo: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/configuration-element-restorations/:configurationElementRestorationId",
"preRequestScript": "",
"pathVariables": {
"configurationElementRestorationId": "{{configurationElementRestorationId}}"
},
"method": "OPTIONS",
"data": [],
"dataMode": "params",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481188499907,
"name": "OPT configuration-element-restorations + id",
"description": "",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"folder": "a7afaece-8561-300c-78bb-c3f4c06711ca"
},
{
"id": "8e8c1400-b293-dd4a-3efc-3adc6e7dfaae",
"headers": "foo: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/option-attribute-sets?filter[mainRestorationId]={{filter[mainRestorationId]}}&filter[materialId]={{filter[materialId]}}&include={{include}}",
"preRequestScript": "",
"pathVariables": {},
"method": "GET",
"data": [],
"dataMode": "params",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481188583902,
"name": "GET option-attribute-sets",
"description": "",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"folder": "f72b2b46-d118-1f0f-a7ee-435979112c02"
},
{
"id": "9483256d-d2ec-c985-e81d-4efa319e5f48",
"headers": "foo: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/configuration-attachments/:configurationAttachmentId",
"preRequestScript": "",
"pathVariables": {
"configurationAttachmentId": "{{configurationAttachmentId}}"
},
"method": "DELETE",
"data": [],
"dataMode": "params",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481188456134,
"name": "DEL configuration-attachments",
"description": "",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"folder": "b7eaa893-d333-b9be-2886-db74447985b5"
},
{
"id": "baa4b86e-8238-3298-c3b3-b253d42eed39",
"headers": "Content-Type: application/json\nuser: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/configuration-main-restorations",
"preRequestScript": "",
"pathVariables": {},
"method": "POST",
"data": [],
"dataMode": "raw",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481192393845,
"name": "POST configuration-main-restorations",
"description": "",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"rawModeData": "",
"folder": "495f9224-d2a2-6075-0c47-29cab3a3128d"
},
{
"id": "c3267c1f-c835-abf5-5d27-9230566e3e0c",
"headers": "Content-Type: application/json\nuser: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/configuration-element-restorations",
"preRequestScript": "",
"pathVariables": {},
"method": "POST",
"data": [],
"dataMode": "raw",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1482132806963,
"name": "POST configuration-element-restorations",
"description": "",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"rawModeData": "",
"folder": "a7afaece-8561-300c-78bb-c3f4c06711ca"
},
{
"id": "d78407ee-7d36-2ec6-041c-a5f4ed47a0f6",
"headers": "foo: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/configurations/:configurationId",
"preRequestScript": "",
"pathVariables": {
"configurationId": "{{configurationId}}"
},
"method": "OPTIONS",
"data": [],
"dataMode": "params",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481188541824,
"name": "OPT configurations + id",
"description": "",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"folder": "cd0fd71b-8fd0-a32b-bd05-1647af21c01c"
},
{
"id": "daa07787-bc8b-44ae-d514-ec384c066e7c",
"headers": "foo: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/orders/:orderId",
"preRequestScript": "",
"pathVariables": {
"orderId": "{{orderId}}"
},
"method": "OPTIONS",
"data": [],
"dataMode": "params",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481188625930,
"name": "OPT orders + id",
"description": "",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"folder": "3029407c-d447-311a-3fe7-a388612383c1"
},
{
"id": "e5a11dac-66b6-5a78-2a1d-3584ed4b4ebb",
"headers": "foo: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/option-element-restorations",
"preRequestScript": "",
"pathVariables": {},
"method": "GET",
"data": [],
"dataMode": "params",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481188599167,
"name": "GET option-element-restorations",
"description": "Gets available Option Element Restorations to be used to populate the Configurator form.\n",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"folder": "e326e1f2-dfa9-69f1-4a63-4ac696b44963"
},
{
"id": "e61ebcd5-4c95-e4a5-acc6-242b910763e3",
"headers": "Content-Type: application/json\nuser: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/configurations/:configurationId",
"preRequestScript": "",
"pathVariables": {
"configurationId": "{{configurationId}}"
},
"method": "PATCH",
"data": [],
"dataMode": "raw",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481188537719,
"name": "PATCH configurations",
"description": "",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"rawModeData": "",
"folder": "cd0fd71b-8fd0-a32b-bd05-1647af21c01c"
},
{
"id": "f08068ad-03b6-7da8-78d8-19e73d6d6960",
"headers": "Content-Type: application/json\nuser: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/configurations",
"preRequestScript": "",
"pathVariables": {},
"method": "POST",
"data": [],
"dataMode": "raw",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481188528399,
"name": "POST configurations",
"description": "",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"rawModeData": "",
"folder": "cd0fd71b-8fd0-a32b-bd05-1647af21c01c"
},
{
"id": "f5a2cb81-95e2-9bba-f791-6e7c3397e7ff",
"headers": "foo: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/configuration-element-restorations",
"preRequestScript": "",
"pathVariables": {},
"method": "OPTIONS",
"data": [],
"dataMode": "params",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481188491466,
"name": "OPT configuration-element-restorations",
"description": "",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"folder": "a7afaece-8561-300c-78bb-c3f4c06711ca"
},
{
"id": "f97f6661-3dbc-d548-539b-2e37f16946f0",
"headers": "foo: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/configuration-attachments/:configurationAttachmentId",
"preRequestScript": "",
"pathVariables": {
"configurationAttachmentId": "{{configurationAttachmentId}}"
},
"method": "OPTIONS",
"data": [],
"dataMode": "params",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481188447437,
"name": "OPT configuration-attachments + id",
"description": "",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"folder": "b7eaa893-d333-b9be-2886-db74447985b5"
},
{
"id": "fbc317e1-a368-2b98-4537-cf3e0fc9983a",
"headers": "Content-Type: application/json\nuser: {{foo}}\nbaa: {{baa}}\n",
"url": "{{url}}/configuration-attachments/:configurationAttachmentId",
"preRequestScript": "",
"pathVariables": {
"configurationAttachmentId": "{{configurationAttachmentId}}"
},
"method": "PATCH",
"data": [],
"dataMode": "raw",
"version": 2,
"tests": "",
"currentHelper": "normal",
"helperAttributes": {},
"time": 1481188433587,
"name": "PATCH configuration-attachments",
"description": "",
"collectionId": "5222928d-13dd-0c6f-7f35-cd25102a5850",
"responses": [],
"rawModeData": "",
"folder": "b7eaa893-d333-b9be-2886-db74447985b5"
}
]
}@patric-eberle Can you open up the DevTools and see if you see any errors there?
patric-eberle
commented
7 years ago No, there are no dev. console error logs.
But good news: I just loaded Postman 4.9.3 and it seems like all 44 tests are executed now. I should be able to do some production tests tomorrow and will report if the lead to the expected result.
patric-eberle
commented
7 years ago Have used the runner in Postman 4.9.3 again today and all tests seem to be executed now. Was not able to reproduce the bug from two days ago.
sdnts
commented
7 years ago @patric-eberle Ah that's good to hear. Just out of curiosity, do you use setNextRequest with a combination of environment variables in your requests?
@JohnArrowwood Is your problem solved as well?
patric-eberle
commented
7 years ago No. I don't use setNextRequest.
JohnArrowwood
commented
7 years ago I moved the requests from one folder into 4 folders. When run as 4 folders, it works.
It was PAINFUL to have to move that many requests (around 500), so unless there is a way created to move multiple requests at once (highly desirable), I'm not willing to take the time to move it back to test to see if the problem is fixed. I hope you can understand where I'm coming from, there.
On Wed, Dec 21, 2016 at 9:32 AM, Siddhant Sinha notifications@github.com wrote:
@patric-eberle https://github.com/patric-eberle Ah that's good to hear. Just out of curiosity, do you use setNextRequest with a combination of environment variables in your requests?
@JohnArrowwood https://github.com/JohnArrowwood Is your problem solved as well?
— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/postmanlabs/postman-app-support/issues/2551#issuecomment-268536390, or mute the thread https://github.com/notifications/unsubscribe-auth/AHd1xUAhnmwKhzUniG-VCNRaz5QFeDdnks5rKThqgaJpZM4LMObH .
-- John Arrowwood 503.863.4823
sdnts
commented
7 years ago We've made several improvements here, are you guys still seeing this?
patric-eberle
commented
7 years ago @JohnArrowwood did not use it on my last projects. But the problem seemed to be solved the last time I used it.
I created a "smoke test" collection folder for our application API. It exercises the "happy path" for every method of every endpoint in the API. When executed one after another, everything seems fine. When I try to use the collection runner on it, it gets to 35% and then just quits.
Using Postman 4.9.1 on Mac Standalone Using OS X El Capitan 10.11.6
The Interceptor is not on or enabled, as far as I know - I don't use it, don't know how to turn it on, or even how to see if it is on.
I do not know if this is new behavior or not.
The expected behavior is (of course) to execute the whole collection.
After the last successful request, the console says "undefined" four times.
The Developer Tools console is empty.
Steps to reproduce the problem: Don't know the root cause: may be request count, may be test count, may be something else. Would appreciate some guidance to help narrow this down.