@stolarczyk I completely forgot a small but important detail. If I recall correctly the bbconf search_bedfiles function is a wrapper of es.search() right? The problem is that this function defaults the number of returned hits to 10, regardless of how many files exist in a certain index. So as of now if we had hundreds of file in the bedfiles index, bedbuncher would only process 10.
@stolarczyk I completely forgot a small but important detail. If I recall correctly the
bbconf search_bedfiles
function is a wrapper ofes.search()
right? The problem is that this function defaults the number of returned hits to 10, regardless of how many files exist in a certain index. So as of now if we had hundreds of file in thebedfiles
index,bedbuncher
would only process 10.It might be a really easy fix,
es.search()
has the argumentsize
(default:10) which allows you to define the number of desired returned hits. https://elasticsearch-py.readthedocs.io/en/master/api.html