scrapinghub / hcf-backend

Crawl Frontier HCF backend
BSD 3-Clause "New" or "Revised" License
7 stars 5 forks source link

--project-id argument isn't considered by HCFPalScript #24

Closed curita closed 1 year ago

curita commented 1 year ago

Issue

HCFPalScript doesn't consider different project ids passed via --project-id.

This is probably happening because the HCFPal() instance created inside HCFPalScript.__init__() isn't instantiated with the project id collected from the arguments in HCFPalScript.

Reproduce

$ python bin/hcfpal.py --project-id <project-id> list               
SHUB_JOBKEY not set: not running on ScrapyCloud.
Listing frontiers in project <project-id>:
    [frontiers from the default project id in scrapinghub.yml, not from  <project-id>]
kalessin commented 1 year ago

Hi, Julia.

I released version 0.5.2.2 with the fix. Thanks for reporting!

curita commented 1 year ago

Thanks! 🙏