See if there is a way to improve performance

philhanna / go-ncvoters

Downloads selected columns from the NC voter registration URL and creates an SQLite database from it

MIT License

0 stars 0 forks source link

Closed philhanna closed 1 year ago

philhanna commented 1 year ago

Write to an in-memory database, then attach the real one and copy the tables into it
Write data to a file in SQL format that is like what the SQLite CLI .dump creates, then import that
Use an INSERT statement with multiple VALUES clauses (like Python does)

philhanna commented 1 year ago

In-memory database yields about a 30% improvement. Not much, and I wonder if it is worth the memory usage.