Closed kihyuk-nam closed 2 years ago
INPUT: SELECT SUM(col) FROM orders
SELECT SUM(col) FROM orders
RESULT
2022-08-24 14:24:50,808 [INFO ] Evaluate 'SELECT SUM(order_id) FROM orders :<train.ensemble_compilation.graph_representation.Query object at 0x7f165b6479a0>' 2022-08-24 14:24:50,808 [DEBUG] In evaluate_query 2022-08-24 14:24:50,808 [DEBUG] query.query_type = QueryType.AQP 2022-08-24 14:24:50,810 [DEBUG] predicted cardinality: 9853060.949424399 2022-08-24 14:24:50,810 [DEBUG] computed prototypical cardinality in 0.0012143210042268038 secs. 2022-08-24 14:24:50,810 [DEBUG] if len(query.group_bys) == 0 and confidence_intervals 2022-08-24 14:24:50,810 [DEBUG] query.query_type = QueryType.AQP 2022-08-24 14:24:50,811 [DEBUG] aggregation_operation_type = AggregationOperationType.AGGREGATION 2022-08-24 14:24:50,811 [DEBUG] aggregation_type = AggregationType.SUM ... File "main.py", line 53, in aqp_read value = estimate(schema, dataset, query, ensemble_location, show_confidence_intervals) File "main.py", line 211, in estimate result = evaluate_an_aqp_query(ensemble_location, query, schema, show_confidence_intervals) File "/home/nam/Projects/traindb/traindb-ml/evaluation/aqp_evaluation.py", line 111, in evaluate_an_aqp_query spn_ensemble.evaluate_query(query, File "/home/nam/Projects/traindb/traindb-ml/train/ensemble_compilation/spn_ensemble.py", line 890, in evaluate_query current_stds, aggregation_result = expectation_spn.evaluate_expectation_batch( AttributeError: 'NoneType' object has no attribute 'evaluate_expectation_batch'
SUSPECTED CAUSE
CF. Cardinality (COUNT)
2022-08-24 14:25:02,717 [INFO ] Evaluate 'SELECT COUNT(order_id) FROM orders :<train.ensemble_compilation.graph_representation.Query object at 0x7f165b658550>' 2022-08-24 14:25:02,717 [DEBUG] In evaluate_query 2022-08-24 14:25:02,717 [DEBUG] query.query_type = QueryType.AQP 2022-08-24 14:25:02,718 [DEBUG] predicted cardinality: 9853060.949424399 2022-08-24 14:25:02,718 [DEBUG] computed prototypical cardinality in 0.0009541769977658987 secs. 2022-08-24 14:25:02,718 [DEBUG] if len(query.group_bys) == 0 and confidence_intervals 2022-08-24 14:25:02,719 [DEBUG] query.query_type = QueryType.AQP 2022-08-24 14:25:02,720 [DEBUG] lower_bound: 9853060.949424399, upper_bound: 9853060.949424399 2022-08-24 14:25:02,720 [INFO ] Result: ((9853060.949424399, 9853060.949424399), 9853060.949424399)
2022-08-24 14:25:53,811 [INFO ] ESTIMATE Aggregations: SELECT COUNT(*) FROM orders where order_dow >= 2 2022-08-24 14:25:53,812 [INFO ] - Query: SELECT COUNT(*) FROM orders where order_dow >= 2, Model: ['model/instances/ensemble_single_instacart_10000000.pkl'] 2022-08-24 14:25:53,812 [INFO ] - Show Confidence Intervals: True 2022-08-24 14:25:53,812 [INFO ] Read the ensemble in ['model/instances/ensemble_single_instacart_10000000.pkl'] 2022-08-24 14:25:53,814 [DEBUG] - Including SPN with table_set {'orders'} with sampling ratio(3421084 / 9853060.949424399) 2022-08-24 14:25:53,815 [DEBUG] Stats: (---Structure Statistics--- # nodes 63 # sum nodes 0 # prod nodes 19 # leaf nodes 42 # params 42 # edges 43 # layers 5) 2022-08-24 14:25:53,815 [INFO ] : <train.ensemble_compilation.spn_ensemble.SPNEnsemble object at 0x7f165b663fd0> 2022-08-24 14:25:53,817 [INFO ] Evaluate 'SELECT COUNT(*) FROM orders where order_dow >= 2:<train.ensemble_compilation.graph_representation.Query object at 0x7f165b663670>' 2022-08-24 14:25:53,818 [DEBUG] In evaluate_query 2022-08-24 14:25:53,818 [DEBUG] query.query_type = QueryType.CARDINALITY 2022-08-24 14:25:53,819 [DEBUG] predicted cardinality: 1345755.105466 2022-08-24 14:25:53,819 [DEBUG] computed prototypical cardinality in 0.0012866021133959293 secs. 2022-08-24 14:25:53,820 [DEBUG] if len(query.group_bys) == 0 and confidence_intervals 2022-08-24 14:25:53,820 [DEBUG] lower_bound: 1343995.131280017, upper_bound: 1347515.079651983 2022-08-24 14:25:53,821 [INFO ] Result: ((1343995.131280017, 1347515.079651983), 1345755.105466) INFO: 127.0.0.1:45282 - "GET /estimate/?query=SELECT%20COUNT%28%2A%29%20FROM%20orders%20where%20order_dow%20%3E%3D%202&dataset=instacart&ensemble_location=model%2Finstances%2Fensemble_single_instacart_10000000.pkl&show_confidence_intervals=true HTTP/1.1" 200 OK
moved to the traindb-model
INPUT:
SELECT SUM(col) FROM orders
RESULT
SUSPECTED CAUSE
CF. Cardinality (COUNT)