pos_values are used in get_infer_dataframes() method in repair.py and it takes values using SQL query and not from DF. Since the size of pos_values is large, we can get rid of memory used by DF as DF is not at all used but kept in memory.
I can add patch and send pull request, if is fine with you.
Hi,
pos_values are used in get_infer_dataframes() method in repair.py and it takes values using SQL query and not from DF. Since the size of pos_values is large, we can get rid of memory used by DF as DF is not at all used but kept in memory.
I can add patch and send pull request, if is fine with you.