whosonfirst / go-whosonfirst-spatial

Go package defining interfaces for Who's On First specific spatial operations.
BSD 3-Clause "New" or "Revised" License
2 stars 0 forks source link
golang whosonfirst whosonfirst-spatial

go-whosonfirst-spatial

Go package defining interfaces for Who's On First specific spatial operations.

Documentation

Documentation, particularly proper Go documentation, is incomplete at this time.

Motivation

The goal of the go-whosonfirst-spatial package is to de-couple the various components that made up the now-deprecated go-whosonfirst-pip-v2 package – indexing, storage, querying and serving – in to separate packages in order to allow for more flexibility.

It (this) is the "base" package that defines provider-agnostic, but WOF-specific, interfaces for a limited set of spatial queries and reading properties.

These interfaces are then implemented in full or in part by provider-specific classes. For example, an in-memory RTree index (which is part of this package) or a SQLite database or even a Protomaps database:

You may have noticed the absence of an equivalent go-whosonfirst-spatial-postgis or even go-whosonfirst-spatial-mysql implementation. That's only because I've been focusing on implementations with fewer requirements, dependencies and less overhead to set up and maintain. There is no reason there couldn't be implementations for either database and some day I hope there will be.

Building on that there are equivalent base packages for "server" implementations, like:

The idea is that all of these pieces can be easily combined in to purpose-fit applications. As a practical matter it's mostly about trying to identify and package the common pieces in to as few lines of code as possible so that they might be combined with an application-specific import statement. For example:

import (
         _ "github.com/whosonfirst/go-whosonfirst-spatial-MY-SPECIFIC-REQUIREMENTS"
)

Here is a concrete example, implementing a point-in-polygon service over HTTP using a SQLite backend:

package main

import (
    "context"
    "log"

    _ "github.com/whosonfirst/go-whosonfirst-spatial-sqlite"
    "github.com/whosonfirst/go-whosonfirst-spatial-www/application/server"
)

func main() {

    ctx := context.Background()
    logger := log.Default()

    err := server.Run(ctx, logger)

    if err != nil {
        logger.Fatal(err)
    }
}

Where:

Here is a another example, implementing a point-in-polygon gRPC service using a SQLite backend:

package main

import (
    "context"
    "log"

    _ "github.com/whosonfirst/go-whosonfirst-spatial-sqlite"
    "github.com/whosonfirst/go-whosonfirst-spatial-grpc/application/server"
)

func main() {

    ctx := context.Background()
    logger := log.Default()

    err := server.Run(ctx, logger)

    if err != nil {
        logger.Fatal(err)
    }
}

The only change is that github.com/whosonfirst/go-whosonfirst-spatial-www/application/server is replaced by github.com/whosonfirst/go-whosonfirst-spatial-grpc/application/server.

The overall motivation for this approach is:

Importantly this package does not implement any actual spatial functionality. It defines the interfaces that are implemented by other packages which allows code to function without the need to consider the underlying mechanics of how spatial operations are being performed.

The layout of this package remains in flux and is likely to change. Things have almost settled but not quite yet.

Interfaces

SpatialIndex

type SpatialIndex interface {
    IndexFeature(context.Context, []byte) error
    RemoveFeature(context.Context, string) error
    PointInPolygon(context.Context, *orb.Point, ...Filter) (spr.StandardPlacesResults, error)
    PointInPolygonCandidates(context.Context, *orb.Point, ...Filter) ([]*PointInPolygonCandidate, error)
    PointInPolygonWithChannels(context.Context, chan spr.StandardPlacesResult, chan error, chan bool, *orb.Point, ...Filter)
    PointInPolygonCandidatesWithChannels(context.Context, chan *PointInPolygonCandidate, chan error, chan bool, *orb.Point, ...Filter)
    Disconnect(context.Context) error
}

Where orb.* and spr.* refer to the paulmach/orb and whosonfirst/go-whosonfirst-flags packages respectively.

SpatialDatabase

type SpatialDatabase interface {
    reader.Reader
    writer.Writer
    spatial.SpatialIndex
}

Where reader.Reader and writer.Writer are the whosonfirst/go-reader and whosonfirst/go-writer interfaces, respectively.

Filter

type Filter interface {
    HasPlacetypes(flags.PlacetypeFlag) bool
    MatchesInception(flags.DateFlag) bool
    MatchesCessation(flags.DateFlag) bool
    IsCurrent(flags.ExistentialFlag) bool
    IsDeprecated(flags.ExistentialFlag) bool
    IsCeased(flags.ExistentialFlag) bool
    IsSuperseded(flags.ExistentialFlag) bool
    IsSuperseding(flags.ExistentialFlag) bool
    IsAlternateGeometry(flags.AlternateGeometryFlag) bool
    HasAlternateGeometry(flags.AlternateGeometryFlag) bool
}

Where flags.* refers to the whosonfirst/go-whosonfirst-flags package.

Database Implementations

SQLite

PMTiles

Servers and clients

Web (HTTP)

Remember, this package implements the guts of a web application but does not support any particular database by default. It is meant to be imported by a database-specific implementation (see above) and exposed as a cmd/http-server application (for example) by that package.

gRPC

Remember, this package implements the guts of a web application but does not support any particular database by default. It is meant to be imported by a database-specific implementation (see above) and exposed as a cmd/grpc-server application (for example) by that package.

See also