search

ibis-project / ibis

the portable Python dataframe library
https://ibis-project.org
Apache License 2.0
5.02k stars 585 forks source link

Is there a way to run the cleanup tasks manually? #533

Closed mariusvniekerk closed 9 years ago

mariusvniekerk commented 9 years ago

For a longer running process is there a way in ibis to close and ibis client and have the required cleanup jobs (dropping non-persisting tables, views, etc) run?

Needing to run 

import gc
gc.collect()

feels rather scary.

And even then i seem to have hiveserver2 sessions sticking around in the Impala daemon i connect to.

Something like a

client.close()

would be very nice

wesm commented 9 years ago

Seems reasonable. I've been meaning to track all temporary database objects and have a cleanup API.