Closed rvashurin closed 5 months ago
np.array(list).tolist() is very memory-inefficient and causes OOMs when subsampling huge datasets (i.e. trainset of wmt14).
np.array(list).tolist() is very memory-inefficient and causes OOMs when subsampling huge datasets (i.e. trainset of wmt14).