perftool-incubator / CommonDataModel

Templates, scripts, and documentation on using a common data format for metrics, benchmark, and environment data
GNU General Public License v3.0
1 stars 3 forks source link

Query Failure in CommonDataModel During Traffic Generation Testing with Multiple Sample Scenarios #121

Open pradiptapks opened 2 months ago

pradiptapks commented 2 months ago

Recently I encountered during the traffic generation tests involving the CommonDataModel. Specifically, the query failed when executing tests with three sample scenarios. However, the test functioned correctly when only one sample was used.

Upon preliminary investigation, I suspect that the recent patch may have introduced this issue. Could you please review the changes and assist in diagnosing the problem?

For your reference, I have included the relevant logs here: Log.

Thank you in advance for your assistance.

Indexing to OpenSearch complete                                                                                                                                                               
Benchmark result now in OpenSearch, localhost:9200                                                                                                                                            
Generating benchmark summary report:                                                                                                                                                          /opt/crucible/repos/[https:github.com](https://app.slack.com/github.com):perftool-incubator/CommonDataModel/queries/cdmq/node_modules/http-response-object/lib/index.js:51                                                                    throw err;                                                                                                                                                                        
            ^                                                                                                                                                                                 

Error: Server responded to http://localhost:9200/cdmv7dev-metric_data/_msearch with status code 400:                                                                                          
{"error":{"root_cause":[{"type":"parse_exception","reason":"request body or source parameter is required"}],"type":"parse_exception","reason":"request body or source parameter is required"},
"status":400}                                                                                                                                                                                 
    at Response.getBody (/opt/crucible/repos/[https:github.com](https://app.slack.com/github.com):perftool-incubator/CommonDataModel/queries/cdmq/node_modules/http-response-object/lib/index.js:41:23)                           
    at esJsonArrRequest (/opt/crucible/repos/[https:github.com](https://app.slack.com/github.com):perftool-incubator/CommonDataModel/queries/cdmq/cdm.js:86:34)                                                                   
    at getMetricDataFromIdsSets (/opt/crucible/repos/[https:github.com](https://app.slack.com/github.com):perftool-incubator/CommonDataModel/queries/cdmq/cdm.js:1937:19)                                                         
    at Object.getMetricDataSets (/opt/crucible/repos/[https:github.com](https://app.slack.com/github.com):perftool-incubator/CommonDataModel/queries/cdmq/cdm.js:2155:18)                                                         
    at /opt/crucible/repos/[https:github.com](https://app.slack.com/github.com):perftool-incubator/CommonDataModel/queries/cdmq/get-result-summary.js:198:42                                                                      
    at Array.forEach (<anonymous>)                                                                                                                                                            
    at Object.<anonymous> (/opt/crucible/repos/[https:github.com](https://app.slack.com/github.com):perftool-incubator/CommonDataModel/queries/cdmq/get-result-summary.js:67:8)                                                   
    at Module._compile (node:internal/modules/cjs/loader:1369:14)                                                                                                                             
    at Module._extensions..js (node:internal/modules/cjs/loader:1427:10)                                                                                                                      
    at Module.load (node:internal/modules/cjs/loader:1206:32) {                                                                                                                               
  statusCode: 400,                                                                                                                                                                            
  headers: {                                                                                                                                                                                  
    'content-type': 'application/json; charset=UTF-8',                                                                                                                                        
    'content-length': '131'                                                                                                                                                                   
  },                                                                                                                                                                                          
  body: Buffer(203) [Uint8Array] [                                                                                                                                                            
    123,  34, 101, 114, 114, 111, 114,  34,  58, 123,  34, 114,                                                                                                                               
    111, 111, 116,  95,  99,  97, 117, 115, 101,  34,  58,  91,                                                                                                                               
    123,  34, 116, 121, 112, 101,  34,  58,  34, 112,  97, 114,                                                                                                                               
    115, 101,  95, 101, 120,  99, 101, 112, 116, 105, 111, 110,                                                                                                                               
     34,  44,  34, 114, 101,  97, 115, 111, 110,  34,  58,  34,                                                                                                                               
    114, 101, 113, 117, 101, 115, 116,  32,  98, 111, 100, 121,                                                                                                                               
     32, 111, 114,  32, 115, 111, 117, 114,  99, 101,  32, 112,                                                                                                                               
     97, 114,  97, 109, 101, 116, 101, 114,  32, 105, 115,  32,                                                                                                                               
    114, 101, 113, 117,                                                                                                                                                                       
    ... 103 more items                                                                                                                                                                        
  ],                                                                                                                                                                                          
  url: 'http://localhost:9200/cdmv7dev-metric_data/_msearch'                                                                                                                                  
}                                                                                                                                                                                             

Node.js v20.12.2                                                                                                                                                                              
ERROR: Could not generate benchmark summary                                                    
Archiving crucible log to /var/lib/crucible/run/trafficgen--2024-08-15_13:06:44_UTC--79c8acc1-a1a8-4160-9fa5-cae0dae579e8/crucible.log.xz