Option: Cache crosscat_cc_colno and bayesdb_generator_column_stattype

probcomp / bayeslite

BayesDB on SQLite. A Bayesian database table for querying the probable implications of data as easily as SQL databases query the data itself.

http://probcomp.csail.mit.edu/software/bayesdb

Apache License 2.0

921 stars 63 forks source link

Option: Cache crosscat_cc_colno and bayesdb_generator_column_stattype #288

Open axch opened 8 years ago

axch commented 8 years ago

to avoid spamming the sqlite queries they always call. Don't know how big an issue this actually is.

riastradh-probcomp commented 8 years ago

Why performance? What makes these queries spam?

axch commented 8 years ago

The functions are just called a lot, and generate large numbers of small queries in the sql trace. I generally assume that sql queries are mildly expensive; I have no particular evidence that this is a problem. Feel free to close the issue if you don't think we should remember this explicitly.

gregory-marton commented 8 years ago

Good next step might be a quick profile to see what these calls cost? Perhaps sqlite already caches them, at some level?

riastradh-probcomp commented 8 years ago

Yes and could be.