[x] Tests included or not required because: test_datasets.py already implemented
[x] Release notes not necessary because: This is a backend change
Pandas read_csv function is very memory intensive, and this makes loading data (especially large datasets from EBI Single Cell Expression Atlas) impossible on computers with 16gb of ram or less. The subsequent analysis of such datasets with scanpy, however, works well on such computers.
Loading the data into chunks, using the same pandas function, solves this problem.
Pandas
read_csv
function is very memory intensive, and this makes loading data (especially large datasets from EBI Single Cell Expression Atlas) impossible on computers with 16gb of ram or less. The subsequent analysis of such datasets with scanpy, however, works well on such computers.Loading the data into chunks, using the same pandas function, solves this problem.