caibirdme/yql - Githubissues

YQL(Yet another-Query-Language)

YQL is very similar with the where part of sql. You can see it as another sql which also support comparison between two sets. YQL have nearly no new concepts, so you can use it well short after reading the examples.Though it's designed for rule engine, it can be widely used in your code logic.

Install

go get github.com/caibirdme/yql

Exmaple

See more examples in the yql_test.go and godoc.

    rawYQL := `name='deen' and age>=23 and (hobby in ('soccer', 'swim') or score>90))`
    result, _ := yql.Match(rawYQL, map[string]interface{}{
        "name":  "deen",
        "age":   int64(23),
        "hobby": "basketball",
        "score": int64(100),
    })
    fmt.Println(result)
    rawYQL = `score ∩ (7,1,9,5,3)`
    result, _ = yql.Match(rawYQL, map[string]interface{}{
        "score": []int64{3, 100, 200},
    })
    fmt.Println(result)
    rawYQL = `score in (7,1,9,5,3)`
    result, _ = yql.Match(rawYQL, map[string]interface{}{
        "score": []int64{3, 5, 2},
    })
    fmt.Println(result)
    rawYQL = `score.sum() > 10`
    result, _ = yql.Match(rawYQL, map[string]interface{}{
        "score": []int{1, 2, 3, 4, 5},
    })
    fmt.Println(result)
    //Output:
    //true
    //true
    //false
    //true

And In most cases, you can use Rule to cache the AST and then use Match to get the result, which could avoid hundreds of thousands of repeated parsing process.

    rawYQL := `name='deen' and age>=23 and (hobby in ('soccer', 'swim') or score>90)`
    ruler,_ := yql.Rule(rawYQL)

    result, _ := ruler.Match(map[string]interface{}{
        "name":  "deen",
        "age":   23,
        "hobby": "basketball",
        "score": int64(100),
    })
    fmt.Println(result)
    result, _ = ruler.Match(map[string]interface{}{
        "name":  "deen",
        "age":   23,
        "hobby": "basketball",
        "score": int64(90),
    })
    fmt.Println(result)
    //Output:
    //true
    //false

Though the to be matched data is the type of map[string]interface{}, there're only 5 types supported:

int
int64
float64
string
bool

Helpers

In score.sum() > 10, sum is a helper function which adds up all the numbers in score, which also means the type of score must be one of the []int,[]int64 or []float64.

This repo is in the early stage, so now there are just a few helpers, feel free to create an issue about your needs. Supported helpers are listed below:

sum: ...
count: return the length of a slice or 1 if not a slice
avg: return the average number of a slice(float64(total)/float64(len(slice)))
max: return the maximum number in a slice
min: return the minimum number in a slice

Usage scenario

Obviously, it's easy to use in rule engine.

var handlers = map[int]func(map[string]interface{}){
    1: sendEmail,
    2: sendMessage,
    3: alertBoss,
}

data := resolvePostParamsFromRequest(request)
rules := getRulesFromDB(sql)

for _,rule := range rules {
    if success,_ := yql.Match(rule.YQL, data); success {
        handler := handlers[rule.ID]
        handler(data)
        break
    }
}

Also, it can be used in your daily work, which could significantly reduce the deeply embebbed if else statements:

func isVIP(user User) bool {
    rule := fmt.Sprintf("monthly_vip=true and now<%s or eternal_vip=1 or ab_test!=false", user.ExpireTime)
    ok,_ := yql.Match(rule, map[string]interface{}{
        "monthly_vip": user.IsMonthlyVIP,
        "now": time.Now().Unix(),
        "eternal_vip": user.EternalFlag,
        "ab_test": isABTestMatched(user),
    })
    return ok
}

Even, you can use json.Marshal to generate the map[string]interface{} if you don't want to write it manually. Make sure the structure tag should be same as the name in rawYQL.

Syntax

See grammar file

Compatibility promise

The API Matchis stable now. Its grammar won't change any more, and what I only will do next is to optimize, speed up and add more helpers if needed.

Further Trial

Though it's kinder difficult to create a robust new Go compiler, there're still some interesting things could do. For example, bringing lambda function in Go which maybe look like:

var scores = []int{1,2,3,4,5,6,7,8,9,10}
newSlice := yql.Filter(`(v) => v % 2 == 0`).Map(`(v) => v*v`).Call(scores).Interface()
//[]int{4,16,36,64,100}

If the lambda function won't change all time, it can be cached like opcode, which is as fast as the compiled code. And in most cases, who care?(pythoner?)

It's not easy but interesting, isn't it? Welcome to join me, open some issues and talk about your ideas with me. Maybe one day it can become a pre-compile tool like babel in javascript.

Attention

Lambda expression now is in its very early stage, DO NOT USE IT IN PRODUCTION.

You can take a quick preview in test case

type Student struct {
    Age  int
    Name string
}

var students = []Student{
    Student{
        Name: "deen",
        Age:  24,
    },
    Student{
        Name: "bob",
        Age:  22,
    },
    Student{
        Name: "alice",
        Age:  23,
    },
    Student{
        Name: "tom",
        Age:  25,
    },
    Student{
        Name: "jerry",
        Age:  20,
    },
}

t = yql.Filter(`(v) => v.Age > 23 || v.Name == "alice"`).Call(students).Interface()
res,_ := t.([]Student)
// res: Student{"deen",24} Student{"alice", 23} Student{"tom", 25}

Chainable

dst := []int{1, 2, 3, 4, 5, 6, 7}
r := Filter(`(v) => v > 3 && v <= 7`).Map(`(v) =>  v << 2`).Filter(`(v) => v % 8 == 0`).Call(dst)
s, err := r.Interface()
ass := assert.New(t)
ass.NoError(err)
ass.Equal([]int{16, 24}, s)

caibirdme / yql

readme