search

18F / open-data-maker

make it easy to turn a lot of potentially large csv files into easily accessible open data
Other
200 stars 135 forks source link

ruby optimizations #298

Closed ultrasaurus closed 8 years ago

ultrasaurus commented 8 years ago

includes https://github.com/18F/open-data-maker/pull/297, but doesn't actually depend on it

cache expressions, dramatic improvement in small test case 45 ms -> 10 ms for 10 rows, 2 files comment out verbose id logging optional performance profiling for rake import: rake import[profile=true] remove encoding from rake import (planning for different approach) make reindex more resilient

ultrasaurus commented 8 years ago

I think this just needs some docs, then it will be ready to merge