near / near-indexer-for-explorer

Watch NEAR network and store all the data from NEAR blockchain to PostgreSQL database
https://near-indexers.io/docs/projects/near-indexer-for-explorer
GNU General Public License v3.0
123 stars 56 forks source link

Is there a way to improve the analysis speed #183

Closed rayn316 closed 2 years ago

rayn316 commented 2 years ago

For a good machine, one cpu is used, there is a lot of spare memory, and the speed of nvme also has a lot of room for improvement. For this parameter --concurrency 200, Change to 1000 or 2000, the resource usage seems to be the same,No obvious improvement. I can use 2 archive nodes at the same time and analyze the data into one database. Can this method improve the analysis speed?