fewer files with more indices will make the files more portable and will likely improve querying. For instance, if we combine all studies in one, and only separate on quantification method and chromosome, data retrieval should be far faster. The cost is then the time to index like this. It would be necessary to maintain study level files, so that when new studies are added, we can regenerate the file each time because appending will not an option.
fewer files with more indices will make the files more portable and will likely improve querying. For instance, if we combine all studies in one, and only separate on quantification method and chromosome, data retrieval should be far faster. The cost is then the time to index like this. It would be necessary to maintain study level files, so that when new studies are added, we can regenerate the file each time because appending will not an option.