search

sql-machine-learning / sqlflow

Brings SQL and AI together.
https://sqlflow.org
Apache License 2.0
5.1k stars 701 forks source link

Accelerate unit tests #1484

Open wangkuiyi opened 4 years ago

wangkuiyi commented 4 years ago

I downloaded the log from Travis CI and searched for unit tests that take more than 10 seconds to run.

yi@WangYis-iMac:~/goyaccfmt (reformat_readme)$ grep '\---.*[0-9][0-9]\..*s)' /tmp/log.txt 
--- PASS: TestStdinParseOnly (10.05s)
--- PASS: TestEnd2EndMySQL (209.82s)
    --- PASS: TestEnd2EndMySQL/TestTrainSQL (13.87s)
    --- PASS: TestEnd2EndMySQL/CaseTrainTextClassificationCustomLSTM (20.51s)
    --- PASS: TestEnd2EndMySQL/CaseTrainCustomModel (16.77s)
    --- PASS: TestEnd2EndMySQL/CaseTrainOptimizer (13.75s)
    --- PASS: TestEnd2EndMySQL/CaseTrainRegression (24.60s)
    --- PASS: TestEnd2EndMySQL/CaseTrainDeepWideModel (11.28s)
    --- PASS: TestEnd2EndMySQL/CaseTrainDeepWideModelOptimizer (12.05s)
    --- PASS: TestEnd2EndMySQL/CaseTrainFeatureDerivation (22.23s)
--- PASS: TestParseWithHive (57.29s)
--- PASS: TestParseWithCalcite (34.84s)
--- PASS: TestExternalParserCommonCasesForHive (36.78s)
--- PASS: TestExternalParserCommonCasesForMaxCompute (22.51s)
--- PASS: TestExternalParserCommonCasesForCalcite (22.59s)
--- PASS: TestRunSQLProgram (15.90s)
--- PASS: TestExecuteXGBoostClassifier (25.72s)
--- PASS: TestExecuteXGBoostRegression (15.81s)
--- PASS: TestExecutorTrainAndPredictDNN (14.28s)
--- PASS: TestExecutorTrainAndPredictClusteringLocalFS (15.27s)
--- PASS: TestExecutorTrainAndPredictDNNLocalFS (14.44s)
--- PASS: TestExecutorTrainAndPredictionDNNClassifierDENSE (267.52s)
wangkuiyi commented 4 years ago

By fixing https://github.com/sql-machine-learning/sqlflow/issues/1389, we could accelerate the following cases.

--- PASS: TestParseWithHive (57.29s)
--- PASS: TestParseWithCalcite (34.84s)
--- PASS: TestExternalParserCommonCasesForHive (36.78s)
--- PASS: TestExternalParserCommonCasesForMaxCompute (22.51s)
--- PASS: TestExternalParserCommonCasesForCalcite (22.59s)