search

apache / pinot

Apache Pinot - A realtime distributed OLAP datastore
https://pinot.apache.org/
Apache License 2.0
5.5k stars 1.29k forks source link

[multistage] run TPC-H benchmark on multistage engine #10825

Open walterddr opened 1 year ago

walterddr commented 1 year ago

currently, we are not 100% supported for TPC-H syntax. we would like to track our progress towards TPC-H here

  1. run TPC-H data loading and TPC-H queries in integration test (See: #9559) - disable the ones that are not supported
    • [ ] add query dbgen dataset for TPC-H
    • [ ] add query with properly filled in parameters for TPC-H (we don't support parametric replacement at the moment)
  2. add features and TPC-H query supported
    • [ ] DateTime functions are not supported (e.g. orderdate < date '2000-01-01' + interval '3' month)
    • [ ] some JOIN filter parsing (e.g. (a=b AND c > 0) OR (a=b AND d < 0) doesn't get converted to a=b AND (c > 0 OR d < 0))
    • [ ] logical correlate
    • [ ] single-value sub query join (WHERE EXIST (SELECT ...), WHERE a > (SELECT COUNT(*) FROM ...))
    • [ ] table view not supported

CC @ankitsultana @kishoreg @xiangfu0

walterddr commented 1 year ago

list of features missing might not be exhausted. we can add more items as we finish step 1 to gather unsupported queries/patterns