oceanbase / miniob

MiniOB is a compact database that assists developers in understanding the fundamental workings of a database.
https://oceanbase.github.io/miniob/
Mulan Permissive Software License, Version 2
2.86k stars 1.01k forks source link

miniob-test2 #12

Closed hnwyllmm closed 2 years ago

hnwyllmm commented 2 years ago

大家找一块自己的地方,在一个comment里面,可以重复提交测试,每次comment变更,都可以检测到。 在一个时间段内,一个团队的任务提交,只会有一个任务执行。 使用方法:

# 执行测试
test <your-github-name> [case1] [case2] ...

# 查看失败原因
view <your-github-name> <case1> [case2] ...

FAQ:

Jeremy0953 commented 2 years ago

DBChat-OB: score:140, passed: basic,date,update,select-meta,select-tables,aggregation-func,drop-table,insert,join-tables,unique,order-by,group-by, commit id=f7261262ef0ab3bb3cc643b963bc450a809c5439, date=2021-11-17 21:37:29

Jeremy0953 commented 2 years ago

DBChat-OB:

null: result file difference(`-` is yours and `+` is base)
 ID | NUM | PRICE | BIRTHDAY
 SELECT * FROM NULL_TABLE WHERE NUM = NULL;
 ID | NUM | PRICE | BIRTHDAY
 SELECT * FROM NULL_TABLE WHERE NULL = NUM;
 ID | NUM | PRICE | BIRTHDAY
 SELECT * FROM NULL_TABLE WHERE NUM <> NULL;
 ID | NUM | PRICE | BIRTHDAY
 SELECT * FROM NULL_TABLE WHERE NUM > NULL;
 ID | NUM | PRICE | BIRTHDAY
 SELECT * FROM NULL_TABLE WHERE NUM < NULL;
-FAILURE
+ID | NUM | PRICE | BIRTHDAY
watchpoints commented 2 years ago

watchpoints:

text: result file difference(`-` is yours and `+` is base)
 3. UPDATE
 UPDATE TEXT_TABLE SET INFO='A TMP DATA' WHERE ID = 2;
-FAILURE
+SUCCESS
 SELECT * FROM TEXT_TABLE;
-2 | THIS IS A VERY VERY LONG STRING2
+2 | A TMP DATA
 3 | THIS IS A VERY VERY LONG STRING3
 ID | INFO
FLAYhhh commented 2 years ago

FLAYhhh:

null: result file difference(`-` is yours and `+` is base)
 SELECT * FROM NULL_TABLE WHERE 'A' IS NULL;
+ID | NUM | PRICE | BIRTHDAY
+SELECT * FROM null_table where 'a' is not null;
 1 | 18 | 10 | 2020-01-01
 2 | NULL | 20 | 2010-01-11
 3 | 12 | 30 | NULL
 4 | 15 | 30 | 2021-01-31
 ID | NUM | PRICE | BIRTHDAY
-SELECT * FROM NULL_TABLE WHERE 'A' IS NOT NULL;
-ID | NUM | PRICE | BIRTHDAY
 SELECT * FROM NULL_TABLE WHERE NULL='A';
 ID | NUM | PRICE | BIRTHDAY
 SELECT * FROM NULL_TABLE WHERE 'A'=NULL;
 ID | NUM | PRICE | BIRTHDAY
 SELECT * FROM NULL_TABLE WHERE 'A'<>NULL;
 ID | NUM | PRICE | BIRTHDAY
 SELECT * FROM NULL_TABLE WHERE 'A'>NULL;
 ID | NUM | PRICE | BIRTHDAY
 SELECT * FROM NULL_TABLE WHERE 'A'<NULL;
 ID | NUM | PRICE | BIRTHDAY
ByteYue commented 2 years ago

view sohardforaname text

tanruixiang commented 2 years ago

tanruixiang: score:60, passed: basic,date,update,select-meta,select-tables,drop-table,join-tables,null,unique,order-by, commit id=8671323f608c767873a3cf52d7f3e1169bf6646a, date=2021-11-17 21:47:25

FLAYhhh commented 2 years ago

FLAYhhh:

null: result file difference(`-` is yours and `+` is base)
 SELECT * FROM NULL_TABLE WHERE 'A' IS NULL;
+ID | NUM | PRICE | BIRTHDAY
+SELECT * FROM null_table where 'a' is not null;
 1 | 18 | 10 | 2020-01-01
 2 | NULL | 20 | 2010-01-11
 3 | 12 | 30 | NULL
 4 | 15 | 30 | 2021-01-31
 ID | NUM | PRICE | BIRTHDAY
-SELECT * FROM NULL_TABLE WHERE 'A' IS NOT NULL;
-ID | NUM | PRICE | BIRTHDAY
 SELECT * FROM NULL_TABLE WHERE NULL='A';
 ID | NUM | PRICE | BIRTHDAY
 SELECT * FROM NULL_TABLE WHERE 'A'=NULL;
 ID | NUM | PRICE | BIRTHDAY
 SELECT * FROM NULL_TABLE WHERE 'A'<>NULL;
 ID | NUM | PRICE | BIRTHDAY
 SELECT * FROM NULL_TABLE WHERE 'A'>NULL;
 ID | NUM | PRICE | BIRTHDAY
 SELECT * FROM NULL_TABLE WHERE 'A'<NULL;
 ID | NUM | PRICE | BIRTHDAY
shulanglhh commented 2 years ago

test shulanglhh select-meta

Emeralddddd commented 2 years ago

EmperorNiu: all cases failed., commit id=4b9f5e822b58bfe4ddd21c776380a67fdbc7f482, date=2021-11-17 21:55:00

Wind-Gone commented 2 years ago

obcontest:

complex-sub-query: result file difference(`-` is yours and `+` is base)
 1. SELECT
 SELECT * FROM CSQ_1 WHERE ID IN (SELECT CSQ_2.ID FROM CSQ_2 WHERE CSQ_2.ID IN (SELECT CSQ_3.ID FROM CSQ_3));
-1
 1 | 4 | 11.2
-2 | 2 | 12
-5
 ID | COL1 | FEAT1
shulanglhh commented 2 years ago

shulanglhh: score:20, passed: basic,select-meta, commit id=bc63c9b2f85b59208f179e7c3c404f012fa66c38, date=2021-11-17 22:30:26

FLAYhhh commented 2 years ago

FLAYhhh: all cases failed., commit id=70a3e70fd126189091ad4d9dcb6fcd2e1b7239c3, date=2021-11-17 22:34:50

FLAYhhh commented 2 years ago

test FLAYhhh null

ybzxw commented 2 years ago

ybzxw: score:60, passed: basic,date,select-meta,select-tables,aggregation-func,drop-table,insert,join-tables,null,order-by,group-by, commit id=c3cc0e17bfb7920e13ab2442a63d4d55ccb4d6ee, date=2021-11-17 22:18:42

yrvader commented 2 years ago

DBChat-OB: score:140, passed: basic,date,update,select-meta,select-tables,aggregation-func,drop-table,insert,join-tables,unique,order-by,group-by, commit id=f7261262ef0ab3bb3cc643b963bc450a809c5439, date=2021-11-17 21:37:29

yrvader commented 2 years ago

DBChat-OB:

null: result file difference(`-` is yours and `+` is base)
 ID | NUM | PRICE | BIRTHDAY
 SELECT * FROM NULL_TABLE WHERE NUM = NULL;
 ID | NUM | PRICE | BIRTHDAY
 SELECT * FROM NULL_TABLE WHERE NULL = NUM;
 ID | NUM | PRICE | BIRTHDAY
 SELECT * FROM NULL_TABLE WHERE NUM <> NULL;
 ID | NUM | PRICE | BIRTHDAY
 SELECT * FROM NULL_TABLE WHERE NUM > NULL;
 ID | NUM | PRICE | BIRTHDAY
 SELECT * FROM NULL_TABLE WHERE NUM < NULL;
-FAILURE
+ID | NUM | PRICE | BIRTHDAY
TaurusGGBOY commented 2 years ago

TaurusGGBOY: score:180, passed: basic,date,update,select-meta,select-tables,aggregation-func,drop-table,insert,join-tables,null,unique,simple-sub-query,multi-index,text,order-by, commit id=f3b4781e364390d15faab4de6133ddb51398aba7, date=2021-11-17 22:59:26

ybzxw commented 2 years ago

ybzxw:

update: result file difference(`-` is yours and `+` is base)
 1. UPDATE A ROW
 UPDATE UPDATE_TABLE_1 SET T_NAME='N01' WHERE ID=1;
-FAILURE
+SUCCESS
 SELECT * FROM UPDATE_TABLE_1;
-1 | N1 | 1 | 1
+1 | N01 | 1 | 1
 2 | N2 | 1 | 1
 3 | N3 | 2 | 1
 ID | T_NAME | COL1 | COL2
LJYer commented 2 years ago

view RUC-Seed-No-59 date

LJYer commented 2 years ago

RUC-Seed-No-59:

date: result file difference(`-` is yours and `+` is base)
 INITIALIZATION
 CREATE TABLE DATE_TABLE(ID INT, U_DATE DATE);
-FAILURE
+SUCCESS
 CREATE INDEX INDEX_ID ON DATE_TABLE(U_DATE);
-FAILURE
+SUCCESS
LJYer commented 2 years ago

RUC-Seed-No-59: all cases failed., commit id=8edb051061834dbc63a07a8001b11714a082edf5, date=2021-11-17 22:50:51

Zjiajia commented 2 years ago

RucHyy:

join-tables: result file difference(`-` is yours and `+` is base)
 JOIN_TABLE_2.NUM
 SELECT * FROM JOIN_TABLE_1 INNER JOIN JOIN_TABLE_2 ON JOIN_TABLE_1.ID=JOIN_TABLE_2.ID INNER JOIN JOIN_TABLE_3 ON JOIN_TABLE_1.ID=JOIN_TABLE_3.ID;
 1 | A | 1 | 2 | 1 | 120
 JOIN_TABLE_1.ID | JOIN_TABLE_1.NAME | JOIN_TABLE_2.ID | JOIN_TABLE_2.NUM | JOIN_TABLE_3.ID | JOIN_TABLE_3.NUM2
 SELECT * FROM JOIN_TABLE_1 INNER JOIN JOIN_TABLE_2 ON JOIN_TABLE_1.ID=JOIN_TABLE_2.ID AND JOIN_TABLE_2.NUM>13 WHERE JOIN_TABLE_1.NAME='B';
 2 | B | 2 | 15
 JOIN_TABLE_1.ID | JOIN_TABLE_1.NAME | JOIN_TABLE_2.ID | JOIN_TABLE_2.NUM
 SELECT * FROM JOIN_TABLE_1 INNER JOIN JOIN_TABLE_2 ON JOIN_TABLE_1.ID=JOIN_TABLE_2.ID AND JOIN_TABLE_2.NUM>13 WHERE JOIN_TABLE_1.NAME='A';
 JOIN_TABLE_1.ID | JOIN_TABLE_1.NAME | JOIN_TABLE_2.ID | JOIN_TABLE_2.NUM
 SELECT * FROM JOIN_TABLE_1 INNER JOIN JOIN_TABLE_2 ON JOIN_TABLE_1.ID=JOIN_TABLE_2.ID AND JOIN_TABLE_2.NUM>23 WHERE JOIN_TABLE_1.NAME='B';
+JOIN_TABLE_1.ID | JOIN_TABLE_1.NAME | JOIN_TABLE_2.ID | JOIN_TABLE_2.NUM
YeEmrick commented 2 years ago

test wangqiim complex-sub-query

baomengli commented 2 years ago

lsjy036: score:40, passed: basic,update,select-meta,drop-table,insert, commit id=fb8afb4226cac1570727625aa84470ffb0ba4205, date=2021-11-17 23:17:33

baomengli commented 2 years ago

lsjy036:

unique: result file difference(`-` is yours and `+` is base)
 1. UNIQUE TEST
 CREATE UNIQUE INDEX INDEX_ID ON UNIQUE_TABLE(ID);
 SUCCESS
 INSERT INTO UNIQUE_TABLE VALUES (2,1,1);
 SUCCESS
 CREATE UNIQUE INDEX INDEX_ID ON UNIQUE_TABLE(ID);
 FAILURE
 INSERT INTO UNIQUE_TABLE VALUES (3,2,1);
 SUCCESS
 INSERT INTO UNIQUE_TABLE VALUES (1,2,1);
-SUCCESS
+FAILURE
Emeralddddd commented 2 years ago

EmperorNiu: all cases failed., commit id=1c4e32adf8c40644f8af6fdb9d5a9ca0bdcbe80b, date=2021-11-17 23:19:46

nihaoshijiea commented 2 years ago

nihaoshijiea: score:10, passed: basic, commit id=1f96f9bbd36de74b63ec33c136d67a97af7835c4, date=2021-11-17 21:55:33

Emeralddddd commented 2 years ago

EmperorNiu: score:120, passed: basic,date,update,select-meta,select-tables,aggregation-func,drop-table,insert,unique,text,order-by, commit id=e4f2f5b5615b83d878641cb431d6421560b89d0e, date=2021-11-17 23:31:24

bbbearxyz commented 2 years ago

bbbearxyz: score:60, passed: basic,date,update,select-meta,select-tables,drop-table,insert,join-tables,null,unique,multi-index,order-by, commit id=9df6fee6924b2cd5f37b1af2ecea3a0b8229fe9e, date=2021-11-18 00:10:53

wangnengjie commented 2 years ago

test Coding-Hammer

bbbearxyz commented 2 years ago

bbbearxyz:

aggregation-func: result file difference(`-` is yours and `+` is base)
 6. ERROR WITH REDUNDANT COLUMNS
 SELECT COUNT(*,NUM) FROM AGGREGATION_FUNC;
-FAILED TO PARSE SQL: SELECT COUNT(*,NUM) FROM AGGREGATION_FUNC;, ERROR MSG: UNKNOWN ERROR
+FAILURE
 SELECT MIN(NUM,PRICE) FROM AGGREGATION_FUNC;
 FAILURE
 SELECT MAX(NUM,PRICE) FROM AGGREGATION_FUNC;
 FAILURE
 SELECT AVG(NUM,PRICE) FROM AGGREGATION_FUNC;
 FAILURE
bbbearxyz commented 2 years ago

bbbearxyz:

group-by: result file difference(`-` is yours and `+` is base)
 5. MULTI TABLE
 SELECT T_GROUP_BY.ID, T_GROUP_BY.NAME, AVG(T_GROUP_BY.SCORE), AVG(T_GROUP_BY_2.AGE) FROM T_GROUP_BY, T_GROUP_BY_2 WHERE T_GROUP_BY.ID=T_GROUP_BY_2.ID GROUP BY T_GROUP_BY.ID, T_GROUP_BY.NAME;
 1 | B | 2 | 10
-3 | A | 1 | 23.3333
-3 | C | 3 | 23.3333
-3 | D | 3 | 23.3333
-3 | F | 2 | 23.3333
+3 | A | 1 | 23.33
+3 | C | 3 | 23.33
+3 | D | 3 | 23.33
+3 | F | 2 | 23.33
 4 | C | 3 | 20
-ID | NAME | AVG(SCORE) | AVG(AGE)
+T_GROUP_BY.ID | T_GROUP_BY.NAME | AVG(T_GROUP_BY.SCORE) | AVG(T_GROUP_BY_2.AGE)
bbbearxyz commented 2 years ago

bbbearxyz:

group-b: result file difference(`-` is yours and `+` is base)
something error: diff: /test/dask/test-tmp/bbbearxyz/result/primary-group-b.result.tmp: No such file or directory
diff: /test/dask/miniob-test/result/primary-group-b.result: No such file or directory
a920264845 commented 2 years ago

coding01000: all cases failed., commit id=a51415defb824b9fa3f8608ee9a22616ae26ea31, date=2021-11-18 00:39:58

bbbearxyz commented 2 years ago

bbbearxyz: score:150, passed: basic,date,update,select-meta,select-tables,aggregation-func,drop-table,insert,join-tables,null,unique,multi-index,order-by, commit id=57a89fbdf964638b742bddddf07121f0da9e9fef, date=2021-11-18 00:29:47

xuhaoran1 commented 2 years ago

xuhaoran1: all cases failed., commit id=4cc08f8d0b5a6c2f4c5680e73af1753efe69001b, date=2021-11-18 00:26:40

bbbearxyz commented 2 years ago

bbbearxyz:

group-by: result file difference(`-` is yours and `+` is base)
 5. MULTI TABLE
 SELECT T_GROUP_BY.ID, T_GROUP_BY.NAME, AVG(T_GROUP_BY.SCORE), AVG(T_GROUP_BY_2.AGE) FROM T_GROUP_BY, T_GROUP_BY_2 WHERE T_GROUP_BY.ID=T_GROUP_BY_2.ID GROUP BY T_GROUP_BY.ID, T_GROUP_BY.NAME;
 1 | B | 2 | 10
 3 | A | 1 | 23.33
 3 | C | 3 | 23.33
 3 | D | 3 | 23.33
 3 | F | 2 | 23.33
 4 | C | 3 | 20
-ID | NAME | AVG(SCORE) | AVG(AGE)
+T_GROUP_BY.ID | T_GROUP_BY.NAME | AVG(T_GROUP_BY.SCORE) | AVG(T_GROUP_BY_2.AGE)
a920264845 commented 2 years ago

test coding01000 group-by

bbbearxyz commented 2 years ago

bbbearxyz: score:150, passed: basic,date,update,select-meta,select-tables,aggregation-func,drop-table,insert,join-tables,null,unique,multi-index,order-by, commit id=0c9e43b8808b08606c7104b3ef635fb0433743f4, date=2021-11-18 00:42:33

bbbearxyz commented 2 years ago

bbbearxyz:

group-by: result file difference(`-` is yours and `+` is base)
 5. MULTI TABLE
 SELECT T_GROUP_BY.ID, T_GROUP_BY.NAME, AVG(T_GROUP_BY.SCORE), AVG(T_GROUP_BY_2.AGE) FROM T_GROUP_BY, T_GROUP_BY_2 WHERE T_GROUP_BY.ID=T_GROUP_BY_2.ID GROUP BY T_GROUP_BY.ID, T_GROUP_BY.NAME;
 1 | B | 2 | 10
 3 | A | 1 | 23.33
 3 | C | 3 | 23.33
 3 | D | 3 | 23.33
 3 | F | 2 | 23.33
 4 | C | 3 | 20
-T_GROUP_BY.ID | T_GROUP_BY.NAME | T_GROUP_BY.AVG(SCORE) | T_GROUP_BY_2.AVG(AGE)
+T_GROUP_BY.ID | T_GROUP_BY.NAME | AVG(T_GROUP_BY.SCORE) | AVG(T_GROUP_BY_2.AGE)
Galaxy0106 commented 2 years ago

Galaxy0106: score:190, passed: basic,date,update,select-meta,select-tables,aggregation-func,drop-table,insert,join-tables,null,unique,multi-index,expression,order-by,group-by, commit id=87a5d88bc9de8b6105a565bd5699e8644bec40b9, date=2021-11-18 00:21:48

bbbearxyz commented 2 years ago

bbbearxyz: score:150, passed: basic,date,update,select-meta,select-tables,aggregation-func,drop-table,insert,join-tables,null,unique,multi-index,order-by, commit id=42934203ab514e2df86f99aba41b951c7f54970b, date=2021-11-18 00:53:19

bbbearxyz commented 2 years ago

bbbearxyz:

group-by: result file difference(`-` is yours and `+` is base)
 5. MULTI TABLE
 SELECT T_GROUP_BY.ID, T_GROUP_BY.NAME, AVG(T_GROUP_BY.SCORE), AVG(T_GROUP_BY_2.AGE) FROM T_GROUP_BY, T_GROUP_BY_2 WHERE T_GROUP_BY.ID=T_GROUP_BY_2.ID GROUP BY T_GROUP_BY.ID, T_GROUP_BY.NAME;
 1 | B | 2 | 10
 3 | A | 1 | 23.33
 3 | C | 3 | 23.33
 3 | D | 3 | 23.33
 3 | F | 2 | 23.33
 4 | C | 3 | 20
-ID | NAME | AVG(T_GROUP_BY.SCORE) | AVG(T_GROUP_BY_2.AGE)
+T_GROUP_BY.ID | T_GROUP_BY.NAME | AVG(T_GROUP_BY.SCORE) | AVG(T_GROUP_BY_2.AGE)
wangnengjie commented 2 years ago

Coding-Hammer: score:20, passed: multi-index, commit id=fe221da6f8a756283244c2e4d8a08660cb4689ad, date=2021-11-18 11:35:06

bbbearxyz commented 2 years ago

bbbearxyz: score:170, passed: basic,date,update,select-meta,select-tables,aggregation-func,drop-table,insert,join-tables,null,unique,multi-index,order-by,group-by, commit id=81d7f51fc5935d9ac9d691f824af442daa8f753c, date=2021-11-18 00:59:21

a920264845 commented 2 years ago

coding01000: score:20, passed: group-by, commit id=bc63b9b73c1bcc4d6ce47c234f1479a129c2ef6a, date=2021-11-18 02:34:42

a920264845 commented 2 years ago

coding01000:

group-by: result file difference(`-` is yours and `+` is base)
 5. MULTI TABLE
 SELECT T_GROUP_BY.ID, T_GROUP_BY.NAME, AVG(T_GROUP_BY.SCORE), AVG(T_GROUP_BY_2.AGE) FROM T_GROUP_BY, T_GROUP_BY_2 WHERE T_GROUP_BY.ID=T_GROUP_BY_2.ID GROUP BY T_GROUP_BY.ID, T_GROUP_BY.NAME;
-1 | 2 | B
-3 | 1 | A
-3 | 2 | C
-3 | 2 | F
-3 | 3 | D
-3 | 4 | C
-4 | 3 | C
-ID | SCORE | NAME
+1 | B | 2 | 10
+3 | A | 1 | 23.33
+3 | C | 3 | 23.33
+3 | D | 3 | 23.33
+3 | F | 2 | 23.33
+4 | C | 3 | 20
+T_GROUP_BY.ID | T_GROUP_BY.NAME | AVG(T_GROUP_BY.SCORE) | AVG(T_GROUP_BY_2.AGE)
TiffanyChou21 commented 2 years ago

rainays:

complex-sub-query: result file difference(`-` is yours and `+` is base)
 1. SELECT
 SELECT * FROM CSQ_1 WHERE ID IN (SELECT CSQ_2.ID FROM CSQ_2 WHERE CSQ_2.ID IN (SELECT CSQ_3.ID FROM CSQ_3));
-FAILURE
+1 | 4 | 11.2
+ID | COL1 | FEAT1
a920264845 commented 2 years ago

coding01000: score:140, passed: basic,date,update,select-meta,select-tables,aggregation-func,drop-table,join-tables,multi-index,order-by,group-by, commit id=d3500ddcb1d6554ce8a54c048cf96dc5d9e87388, date=2021-11-18 05:40:56

PaJir commented 2 years ago

PaJir:

multi-index: result file difference(`-` is yours and `+` is base)
 1 | 1 | 11.2 | A | 2021-01-02 | 1 | 1
 ID | COL1 | COL2 | COL3 | COL4 | COL5 | COL6
 SELECT * FROM MULTI_INDEX3 WHERE COL1 > 1 AND COL4 = '2021-01-02';
 ID | COL1 | COL2 | COL3 | COL4 | COL5 | COL6
 SELECT * FROM MULTI_INDEX3 WHERE COL1 <> 1 AND COL4 >= '2021-01-02';
 4 | 2 | 12.2 | E | 2022-01-04 | 13 | 10
 ID | COL1 | COL2 | COL3 | COL4 | COL5 | COL6
 SELECT * FROM MULTI_INDEX3 WHERE COL2 < 15.0 AND COL4 <> '2021-01-02';
 3 | 1 | 11.6 | H | 2023-01-02 | 10 | 17
 4 | 2 | 12.2 | E | 2022-01-04 | 13 | 10
+5 | 3 | 14.2 | D | 2020-04-02 | 12 | 2
 ID | COL1 | COL2 | COL3 | COL4 | COL5 | COL6