search

scrapinghub / scrapinghub-entrypoint-scrapy

Scrapy entrypoint for Scrapinghub job runner
BSD 3-Clause "New" or "Revised" License
25 stars 16 forks source link

RuntimeError: Pipe writer is misconfigured, named pipe path is not set #52

Closed villeristi closed 5 years ago

villeristi commented 5 years ago

Trying to build a custom docker-image with:

1. scrapy startproject test
2. scrapy genspider testSpider
3. shub image init
4. docker build . -t customnamehere

Dockerfile:

FROM scrapinghub/scrapinghub-stack-scrapy:1.5-py3
ENV TERM xterm
ENV SCRAPY_SETTINGS_MODULE test.settings
RUN mkdir -p /app
WORKDIR /app
COPY ./requirements.txt /app/requirements.txt
RUN pip install --no-cache-dir -r requirements.txt
COPY . /app
RUN python setup.py install

command docker run customnamehere shub-image-info works like it should but docker run customnamehere start-crawl

throws

RuntimeError: Pipe writer is misconfigured, named pipe path is not set

Is there some more steps to properly configure or...?

vshlapakov commented 5 years ago

Hey @villeristi An ability to run custom images locally is not implemented/tested yet, and as of now, there's no a proper recommended way. But the feature is important indeed, and it's already in my priority list. I'll try to allocate some time during next weeks to add a separate command to shub tool to address your demands.

villeristi commented 5 years ago

@vshlapakov, any news about this?

vshlapakov commented 5 years ago

@villeristi yes, it was implemented in shub and released in 2.9.0: