bsherin / tactic

5 stars 1 forks source link

Sending big things to export viewer #818

Open bsherin opened 4 years ago

bsherin commented 4 years ago

sending something too big to the export viewer, such as a giant list of noun phrases, can bring it to its knees

bsherin commented 4 years ago

Maybe can use sys.getsizeof? This isn't recursive though.

Can look here: https://stackoverflow.com/questions/449560/how-do-i-determine-the-size-of-an-object-in-python

here too: https://code.tutsplus.com/tutorials/understand-how-much-memory-your-python-objects-use--cms-25609

Look here: https://www.scrygroup.com/tutorial/2018-09-04/find-size-of-python-object/

The last one recommends the pympler library.

bsherin commented 3 years ago

Also see issue #1002