Add a .map_batches method to lazy collections to allow filtering documents.
⚠️ We need to ensure that .map_batches is not called between two torch components that could share cache entries, otherwise
the cache keys would be different between before and after .map_batches
percevalw
commented
5 months ago
Feature type
Add a
.map_batchesmethod to lazy collections to allow filtering documents. ⚠️ We need to ensure that.map_batchesis not called between two torch components that could share cache entries, otherwise the cache keys would be different between before and after.map_batches