search

openvenues / gopostal

Go (cgo) interface to libpostal for fast international address parsing/normalization
MIT License
160 stars 32 forks source link

Multicore parser.ParseAddress() #13

Open mzimmerman opened 5 years ago

mzimmerman commented 5 years ago

parser.ParseAddress() is not multicore. I'm trying to parse a large dataset and this is severely hurting my performance.

mzimmerman commented 5 years ago

After more reading, I found that the underlying libpostal isn't multi, so I wrote this hack: https://github.com/mzimmerman/gopostalmulti which essentially forks out. This is probably not a great solution but it's certainly helped my throughput!