search

DiskFrame / disk.frame

Fast Disk-Based Parallelized Data Manipulation Framework for Larger-than-RAM Data
https://diskframe.com
Other
594 stars 40 forks source link

cannot use filter within pipe for zip_to_disk.frame #344

Closed lime-n closed 3 years ago

lime-n commented 3 years ago

I have been trying to use filter within the pipe for zip_to_disk.frame, though It cannot be applied to an object of class "list'.

Just to double check:

#flights.df was called using csv_to_disk.frame
> class(flights.df)
[1] "disk.frame"        "disk.frame.folder"
> class(zi.fl)
[1] "list"
lime-n commented 3 years ago

After searching for rbind.data.frame I found the right version already developed rbindlist.disk.frame which solved it and I could use filter within the pipe.

 zi.fl <- zip_to_disk.frame(zipfile = "flights.tsv.zip", outdir = data_dir)  %>% rbindlist.disk.frame() %>% filter(month == 1)