scrapinghub / portia

Visual scraping for Scrapy
BSD 3-Clause "New" or "Revised" License
9.31k stars 1.4k forks source link

scrapyd+portia & scrapinghub exported projects #100

Closed almeidaf closed 10 years ago

almeidaf commented 10 years ago

has always these are problably "dumb" issues from someone who only used scrapinghub.com and never used scrapy/scrapyd

i downloaded my project from scrapinghub and upload to data/projects however portia wont add the scrapyd files (scrapy.cfg, settings.py etc...)

it only adds the scrapyd files to new projects created on portia.

so i created a new project and it added the scrapyd files but i had to add

[deploy:scrapyd] url =http://localhost:6800/

to the scrapy.cfg

heres the output when running scrapyd-deploy

[root@v01 new_project]# scrapyd-deploy scrapyd -p new_project Packing version 1413402753 Deploying to project "new_project" in http://localhost:6800/addversion.json Server response (200): {"status": "error", "message": "IOError: [Errno 21] Is a directory: '/root/portia/slyd/data/projects/new_project'"}

tpeng commented 10 years ago

see the Deploy with scrapyd section in the README.md document