Support Local/Global Secondary Indexes

fogfish / dynamo

Generic Golang Key/Value trait for AWS storage services

MIT License

19 stars 5 forks source link

Support Local/Global Secondary Indexes #37

Closed fogfish closed 3 years ago

fogfish commented 3 years ago

https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/LSI.html https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/GSI.html

fogfish commented 3 years ago

[x] GSI support requires re-mapping KeyConditionExpression to another key name (prefix and suffix are primary key).

// old
q := &dynamodb.QueryInput{
        KeyConditionExpression:    aws.String(dynamo.pkPrefix + " = :prefix"),
        ExpressionAttributeValues: exprOf(gen),
        TableName:                 dynamo.table,
        IndexName:                 aws.String("test-b-c"),
    }

// new
q := &dynamodb.QueryInput{
        KeyConditionExpression:    aws.String(someKeyNameUsedGSI + " = :prefix"),
        ExpressionAttributeValues: exprOf(gen),
        TableName:                 dynamo.table,
        IndexName:                 aws.String("test-b-c"),
    }

fogfish commented 3 years ago

[x] ~~SeqConfig interface support index definition via config method~~

type SeqConfig interface {
   Index(name string) Seq
}

Index name is configurable via URL

fogfish commented 3 years ago

[x] LSI/GSI defines a new read-only projection on data structures, partial view on existing object. The library's concept is a client per "table" (aka struct projection). Essentially, KeyValPattern + Get(Thing) error shall be returned for LSI/GSI. Many aspects can be resolved at config phase, using config URL

dynamo.New("ddb:///table-name/index-name?prefix=prefix&suffix=suffix")

fogfish commented 3 years ago

[x] consider readonly api dynamo.ReadOnly(uri) KeyValReader

fogfish commented 3 years ago

[x] use url to config the client

fogfish commented 3 years ago

[x] support I/O context

fogfish commented 3 years ago

[x] support begins_with for partial suffix in LSI/GSI queries (composite key pattern)

fogfish commented 3 years ago

[x] ~~batch writes (sequence of items)~~