Scraper not returning complete results

Mahdisadjadi / arxivscraper

A python module to scrape arxiv.org for a date range and category

MIT License

282 stars 53 forks source link

Scraper not returning complete results #18

Open m-samland opened 2 years ago

m-samland commented 2 years ago

I noticed that when I try to scrape the last year of papers in any one category, I get incomplete results even though the overall query does not time out (default: 300s). The results definitely incomplete as I tried to find multiple papers that I know have been published this year and they were not in the list.

Mahdisadjadi commented 11 months ago

@m-samland Could you please share a small snippet so I can reproduce? Thanks!