Tweaking and optimisation of crawler. - Githubissues

ipfs-search / ipfs-search-deployment

Ansible playbooks for the deployment of ipfs-search.com

Other

4 stars 2 forks source link

Tweaking and optimisation of crawler. #38

Closed dokterbob closed 2 years ago

dokterbob commented 2 years ago

Configurable flush timeout for bulk indexer.
Auto-discovery of nodes; distribute ES load better.
Tuning of bulk indexing and getting.