OutlierVentures / QTM-Interface

GNU General Public License v3.0
28 stars 18 forks source link

PerformanceWarning #29

Closed BlockBoy32 closed 1 year ago

BlockBoy32 commented 1 year ago

Getting this warning, I dont think its a huge deal but just a heads up.

QTM Interface/Model/post_processing.py:62: PerformanceWarning: DataFrame is highly fragmented. This is usually the result of calling frame.insert many times, which has poor performance. Consider joining all columns at once using pd.concat(axis=1) instead. To get a de-fragmented frame, use newframe = frame.copy() data[agent_ds[agent_ds.keys()[0]][key]['name']+'_agents'] = agent_ds.map(lambda s: sum([1 for agent in s.values() if agent['name'] == agent_ds[agent_ds.keys()[0]][key]['name']]))

achimstruve commented 1 year ago

Thanks for bringing this up.

I don't get that warning and it appears to be related to an older version of the post_processing.py file as the problem causing line is not in line 62 anymore.

Since when did you get this warning?

BTW, I fixed a path issue in your import_dummy_data function. It couldn't find the Quantitative_Token_Model_V1.88_radCad_integration - Data Tables.csv file when I initially run the code after pulling from your last commit.