search

scrapinghub / portia

Visual scraping for Scrapy
BSD 3-Clause "New" or "Revised" License
9.28k stars 1.41k forks source link

When I use docker to start portia, how can I use portia to store data into multiple formats, such as json file or mysql? #806

Closed tingyunsay closed 7 years ago

tingyunsay commented 7 years ago

Hello dear author, I need to learn portia when the need to crawl the data stored on the website to json file or mysql, but after reading your document I found that only mentioned mysql storage, can you please tell me about the storage of other Database or stored in json / excel file method?

my computer environment like this： start portia with docker Ubuntu 16.04

thank you very much!

tingyunsay commented 7 years ago

I have found the solution as follows:

  1. Close the open portia configuration page (use the process to kill) 2.Run the following order docker run -i -t --rm -v ~ /portia_projects:/app/data/projects: rw -v /Your_output_floder:/mnt: rw -p 9001:9001 scrapinghub/portia portiacrawl /app/data/projects/Project_name Spider_name -o /mnt/Result_file