search

terra-money / fcd-classic

Terra ETL + RestFul API Server
https://fcd.terra.dev/swagger
MIT License
63 stars 42 forks source link

Cache/proposal #15

Closed maruf0011 closed 4 years ago

maruf0011 commented 4 years ago
  1. Caching proposal infos in db.
hanjukim commented 4 years ago

I was curious that why did you separate collector? collector, validator scrapper, and now gov scrapper. Wouldn't it be better just make them as each modules?

maruf0011 commented 4 years ago

Separated the collector to drop callback overhead on a single process as block explorer spawns many callbacks. Again making separate module for each module will be overkill. But as we are adding more caching module there, we can rename this module as scrapper. which will scrape and cache info.