search

tonyfujs / mdlibtoddh

Other
1 stars 0 forks source link

Querying Microdata API #112

Open cmachingauta opened 5 years ago

cmachingauta commented 5 years ago

Hi Alp and Tony, Is it possible to review the way we query the Microdata API? I was warned that fetching the database with one query is casing the API to crash, and it would be better to use a loop in the script to fetch smaller chunks at a time e.g. 100 rows.

alpaziz commented 5 years ago

Hey @cmachingauta ,

Thanks for bringing this up. I've spoken to Mehmood, he will put an upper limit on the search request on the Microdata API, once he implements this I'll make relevant changes to the harvester.