Switch the default compilation stack to the new GOpt-based framework in GIE

alibaba / GraphScope

🔨 🍇 💻 🚀 GraphScope: A One-Stop Large-Scale Graph Computing System from Alibaba | 一站式图计算系统

https://graphscope.io

Apache License 2.0

3.18k stars 426 forks source link

Switch the default compilation stack to the new GOpt-based framework in GIE #3736

Open BingqingLyu opened 2 months ago

BingqingLyu commented 2 months ago

Is your feature request related to a problem? Please describe.

We have recently introduced a new GOpt-based compilation stack, which offers robust support for both Cypher and Gremlin query languages. This advanced stack enhances the query processing capabilities with both rule-based and cost-based optimization strategies, ensuring efficient execution across various graph query scenarios.

We are currently planning to switch the default compilation stack from the older, IRCore-based implementation to the new, GOpt-based framework.

BingqingLyu commented 2 months ago

To achieve this goal, there are several tasks that we need to undertake:

P1: bug fix

[ ] #3730
[ ] #3731
[ ] #3732
[ ] #3774
[ ] #3791
[ ] P2: #3792

P1: comprehensive tests

[x] Tests on ModernGraph, on MovieGraph and LdbcGraph, based on the new GOpt-based compilation.
[ ] P2: Tests on different storages.

P2: feature support

compiler:

[ ] P1: #3940
[ ] coin
[ ] sample
[ ] unfold

runtime (insight):

[x] P1: nested map
[x] case when
[ ] comparison of temporal types

e2e:

[ ] edge type defined in a triplet
[x] P1: path join (concat two sub-paths into one)

BingqingLyu commented 1 month ago

There's still some issue to be addressed.