issues
search
ashwin153
/
autofeat
automated exploratory data analysis
0
stars
0
forks
source link
feat: rewrite feature extraction to improve performance
#74
Closed
ashwin153
closed
1 month ago
ashwin153
commented
1 month ago
One major source of performance issues was that
Dataset.tables
was not previously cached
Dataset.tables
is called once for each filter in feature extraction
This results in a huge amount of wasted memory and runtime
The solution is to decouple sourcing data from the actual dataset object
Dataset.tables
was not previously cachedDataset.tables
is called once for each filter in feature extraction