magda-io / magda

A federated, open-source data catalog for all your big data and small data
https://magda.io
Apache License 2.0
505 stars 92 forks source link

optimise indexer active crawling process #3447

Open t83714 opened 1 year ago

t83714 commented 1 year ago

optimise indexer active crawling process

The indexer's active crawling process can be improved in the following areas: