CAFECA-IO / BAIFA-web-crawling

BAIFA conducts web crawling from iSunCloud in frequence
0 stars 0 forks source link

新增 iSunCoin 測試網 BOLT,部署爬蟲 #59

Closed gibbs-shih closed 2 months ago

gibbs-shih commented 2 months ago

info: chain id: 58017 chain name: BOLT symbol: BLT decimal: 18 rpc: https://bolt.baifa.io/

gibbs-shih commented 2 months ago
gibbs-shih commented 2 months ago

crawler.ts CleanShot 2024-07-04 at 11 23 22

parser.ts CleanShot 2024-07-04 at 11 36 02

parse_report_name_address CleanShot 2024-07-04 at 11 29 19

crawl_report.ts CleanShot 2024-07-04 at 11 32 39

parsers.ts CleanShot 2024-07-04 at 11 59 08

gibbs-shih commented 2 months ago

todo:
修改 readme #65 拉出相關設定檔 #64 db 調整欄位 加入 chain id: block_raw, public_tags , risk_records, review_datas, transaction_receipt_raw #60 程式碼加入儲存 chain id #61 新增程式碼用 chain id 篩選 #63 DB schema 需同步更新至 https://github.com/CAFECA-IO/BAIFA/ >> feature/change_crawler_logic

gibbs-shih commented 2 months ago

更新 baifastaging 資料庫

CleanShot 2024-07-05 at 10 33 03@2x
gibbs-shih commented 2 months ago

BAIFA-Crawler-003 (BOLT) 安裝 nvm, npm 及 pm2 套件, 更新 node 版本

CleanShot 2024-07-05 at 11 00 02@2x CleanShot 2024-07-05 at 11 02 41@2x
gibbs-shih commented 2 months ago

分別部署至遠端伺服器

CleanShot 2024-07-05 at 14 45 49@2x
gibbs-shih commented 2 months ago

take 3 hr