Closed Free16t closed 9 years ago
piet8stevens
commented
9 years ago Sorry to report I have the same issue under windows 8.1. Successfully did pip install -r requirements.txt but then get them as "Not found".
Any help would be much appreciated.
Thank you.
dreamflasher
commented
9 years ago On one of my computers I get this error, too. Windows 7.
dreamflasher
commented
9 years ago Okay looks like this package is stale, here is a fork which at least can be installed: https://github.com/kazeeki/pipe2py (but doesn't run either)
ggaughan
commented
9 years ago This is the latest version that I used, perhaps you'll have better luck installing from it if the later branches don't work: https://github.com/ggaughan/pipe2py/tree/6a5c31eb218904a17800387bc4cd4239ba1b0b34
piet8stevens
commented
9 years ago Thank you for your help. I have now used the version you have suggested on my ubuntu 14.04.
@ggaughan: I get past installation but now fail at testbasics.py with ImportError: No module named mezmorize in pipe2py/lib/utils.py line 26:
python testbasics.py
Traceback (most recent call last):
File "testbasics.py", line 10, in
piet8stevens
commented
9 years ago @DreamFlasher : I can install and testbasics.py runs but generates tons of errors, all linked to a missing data directory in /usr/local/lib/python2.7/dist-packages/pipe2py-0.20.0-py2.7.egg/pipe2py/data.
I manually added the data directory from the kazeeki download to the .egg file, but the testbasics.py is looking for the data in a directory and not in the egg archive. I am not familiar with egg files so stuck. When I extract the contents of the egg file into a subdirectory with the same name, the testbasics.py fails at the start.
piet8stevens
commented
9 years ago Some additional info on how it currently fails (with the branch from kazeeki): At the start of running testbasics.py, I get these messages:
Epipeline length > 0, but expected > 0. Modules used in pipe_5fabfc509a8e44342941060c7c7d0340: [u'pipedateinput', u'pipelocationinput', u'pipenumberinput', u'pipeoutput', u'pipeprivateinput', u'piperssitembuilder', u'pipetextinput', u'pipeurlinput'] .pipeline length > 0, but expected > 0. Modules used in pipe_5fabfc509a8e44342941060c7c7d0340: [u'pipedateinput', u'pipelocationinput', u'pipenumberinput', u'pipeoutput', u'pipeprivateinput', u'piperssitembuilder', u'pipetextinput', u'pipeurlinput'] .pipeline length > 0, but expected > 0. Modules used in pipe_5fabfc509a8e44342941060c7c7d0340: [u'pipedateinput', u'pipelocationinput', u'pipenumberinput', u'pipeoutput', u'pipeprivateinput', u'piperssitembuilder', u'pipetextinput', u'pipeurlinput'] .EEpipeline length == 0, but expected > 0. Modules used in pipe_HrX5bjkv3BGEp9eSy6ky6g: [u'pipefeedautodiscovery', u'pipefetch', u'pipeloop', u'pipeoutput', u'pipesort', u'pipetruncate'] FEEpipeline length == 0, but expected > 0. Modules used in pipe_551507461cbcb19a828165daad5fe007: [u'pipefetchsitefeed', u'pipeoutput', u'pipetruncate', u'pipeurlinput'] FEpipeline length > 0, but expected > 0. Modules used in pipe_1LNyRuNS3BGdkTKaAsqenA: [u'pipefetch', u'pipefilter', u'pipeoutput', u'pipetextinput', u'pipeurlbuilder'] .pipeline length == 2, but expected == 2. Modules used in pipe_b96287458de001ad62a637095df33ad5: [u'pipeitembuilder', u'pipeoutput', u'pipestrconcat', u'pipeunion'] .Epipeline length == 1, but expected == 1. Modules used in pipe_125e9fe8bb5f84526d21bebfec3ad116: [u'pipefetchdata', u'pipeitembuilder', u'pipeloop', u'pipeoutput', u'piperename', u'pipetextinput', u'pipeurlbuilder'] .EEpipeline length == 3, but expected == 3. Modules used in pipe_1166de33b0ea6936d96808717355beaa: [u'pipeitembuilder', u'pipeloop', u'pipeoutput', u'piperssitembuilder', u'pipeunion'] .EEEpipeline length == 2, but expected == 2. Modules used in pipe_975789b47f17690a21e89b10a702bcbd: [u'pipefilter', u'pipeitembuilder', u'pipeloop', u'pipeoutput', u'piperegex', u'piperename', u'pipestringtokenizer', u'pipetextinput'] .EEEpipeline length > 0, but expected > 0. Modules used in pipe_e519dd393f943315f7e4128d19db2eac: [u'pipefetch', u'pipeoutput', u'pipetextinput', u'pipeurlbuilder'] .
ERROR: test_union_just_other (main.TestBasics)
Traceback (most recent call last): File "tests/testbasics.py", line 429, in test_union_just_other pipeline = self._get_pipeline(pipe_name) File "tests/testbasics.py", line 41, in _get_pipeline return list(pipeline) File "/usr/local/lib/python2.7/dist-packages/pipe2py-0.20.0-py2.7.egg/pipe2py/compile.py", line 309, in build_pipeline for i in pipeline: File "/usr/local/lib/python2.7/dist-packages/pipe2py-0.20.0-py2.7.egg/pipe2py/modules/pipeoutput.py", line 17, in pipe_output for item in _INPUT: File "/usr/local/lib/python2.7/dist-packages/pipe2py-0.20.0-py2.7.egg/pipe2py/modules/pipesort.py", line 62, in pipe_sort for item in _multikeysort(_INPUT, order): File "/usr/local/lib/python2.7/dist-packages/pipe2py-0.20.0-py2.7.egg/pipe2py/modules/pipesort.py", line 35, in _multikeysort return sorted(items, cmp=comparer) File "/usr/local/lib/python2.7/dist-packages/pipe2py-0.20.0-py2.7.egg/pipe2py/modules/piperegex.py", line 89, in pipe_regex for item in _INPUT: File "/usr/local/lib/python2.7/dist-packages/pipe2py-0.20.0-py2.7.egg/pipe2py/modules/piperename.py", line 63, in pipe_rename for item in _INPUT: File "/usr/local/lib/python2.7/dist-packages/pipe2py-0.20.0-py2.7.egg/pipe2py/modules/pipefilter.py", line 124, in pipe_filter for item in _INPUT: File "/usr/local/lib/python2.7/dist-packages/pipe2py-0.20.0-py2.7.egg/pipe2py/modules/pipeuniq.py", line 24, in pipe_uniq for item in _INPUT: File "/usr/local/lib/python2.7/dist-packages/pipe2py-0.20.0-py2.7.egg/pipe2py/modules/pipeunion.py", line 31, in pipe_union for item in util.multiplex(sources): File "/usr/local/lib/python2.7/dist-packages/pipe2py-0.20.0-py2.7.egg/pipe2py/modules/pipefetch.py", line 45, in pipe_fetch parsed = feedparser.parse(urlopen(url).read()) File "/usr/lib/python2.7/urllib2.py", line 127, in urlopen return _opener.open(url, data, timeout) File "/usr/lib/python2.7/urllib2.py", line 404, in open response = self._open(req, data) File "/usr/lib/python2.7/urllib2.py", line 422, in _open '_open', req) File "/usr/lib/python2.7/urllib2.py", line 382, in _call_chain result = func(*args) File "/usr/lib/python2.7/urllib2.py", line 1317, in file_open return self.open_local_file(req) File "/usr/lib/python2.7/urllib2.py", line 1357, in open_local_file raise URLError(msg) URLError: <urlopen error [Errno 20] Not a directory: '/usr/local/lib/python2.7/dist-packages/pipe2py-0.20.0-py2.7.egg/pipe2py/data/rss.sueddeutsche.de_rss_Politik.xml'>
FAIL: test_feeddiscovery (main.TestBasics)
Traceback (most recent call last): File "tests/testbasics.py", line 119, in test_feeddiscovery self._load(pipeline, pipe_name) File "tests/testbasics.py", line 74, in _load return self.assertEqual(compared, check) AssertionError: 0 != 1
FAIL: test_fetchsitefeed (main.TestBasics)
Traceback (most recent call last): File "tests/testbasics.py", line 126, in test_fetchsitefeed self._load(pipeline, pipe_name) File "tests/testbasics.py", line 74, in _load return self.assertEqual(compared, check) AssertionError: 0 != 1
FAIL: test_urlbuilder (main.TestBasics)
Traceback (most recent call last): File "tests/testbasics.py", line 149, in test_urlbuilder self._load(pipeline, pipe_name) File "tests/testbasics.py", line 74, in _load return self.assertEqual(compared, check) AssertionError: 0 != 1
Ran 26 tests in 6.592s
FAILED (failures=3, errors=15)
piet8stevens
commented
9 years ago Note: sorry for my bad formatting - not familiar with how to do that better.
piet8stevens
commented
9 years ago And one more: on the optimistic assumption that testbasics.py does not run but maybe pipe2py does, I ran it on one of my pipes, with the following result:
python pipe2py/compile.py -p 0fcf87feefa52b946cbbb5254e8beb63
Traceback (most recent call last):
File "pipe2py/compile.py", line 405, in
dreamflasher
commented
9 years ago @piet8stevens I have seen TypeError: string indices must be integers several times before, too. I am right now installing Ubuntu 14.04.2 and then a fresh python. Together we'll manage to get it running! :)
piet8stevens
commented
9 years ago @DreamFlasher: great! Let's try. I also tried via json. I saved the pipes as json and then this happened (one of the saved pipes is called FTUniquePipe.json):
python pipe2py/compile.py FTUniquePipe.json
Traceback (most recent call last):
File "pipe2py/compile.py", line 405, in
piet8stevens
commented
9 years ago @DreamFlasher : it would seem we need to get the tests to run correctly first. I will also re-install python from scratch to see what happens.
dreamflasher
commented
9 years ago Alright. Fresh install of Ubuntu 14.04.2, Python 2.7.
After the first pip install -r requirements.txt I got this error: https://github.com/okfn/piati/issues/65 - tried to resolve with sudo apt-get install python-dev libxml2-dev libxslt-dev as proposed. This removes the first error, but now I get:
building 'lxml.etree' extension
creating build/temp.linux-x86_64-2.7
creating build/temp.linux-x86_64-2.7/src
creating build/temp.linux-x86_64-2.7/src/lxml
x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -I/usr/include/libxml2 -I/tmp/pip_build_root/lxml/src/lxml/includes -I/usr/include/python2.7 -c src/lxml/lxml.etree.c -o build/temp.linux-x86_64-2.7/src/lxml/lxml.etree.o -w
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/src/lxml/lxml.etree.o -lxslt -lexslt -lxml2 -lz -lm -o build/lib.linux-x86_64-2.7/lxml/etree.so
/usr/bin/ld: cannot find -lz
collect2: error: ld returned 1 exit status
error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
----------------------------------------
Can't roll back lxml; was not uninstalled
Cleaning up...
Command /usr/bin/python -c "import setuptools, tokenize;__file__='/tmp/pip_build_root/lxml/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-4gHM6i-record/install-record.txt --single-version-externally-managed --compile failed with error code 1 in /tmp/pip_build_root/lxml
Storing debug log for failure in /home/dreamflasher/.pip/pip.logAny ideas? :(
dreamflasher
commented
9 years ago Okay this was missing: sudo apt-get install zlib1g-dev (from http://stackoverflow.com/questions/3373995/usr-bin-ld-cannot-find-lz)
dreamflasher
commented
9 years ago I guess I can now reproduce @Free16t
Installing compile script to /usr/local/bin
Installed /usr/local/lib/python2.7/dist-packages/pipe2py-0.23.0-py2.7.egg
Not found: Jinja2==2.7.2
Not found: MarkupSafe==0.21
Not found: html5lib==0.999
Not found: lxml==3.3.5
Not found: mccabe==0.2.1
Not found: six==1.7.3
Not found: speedparser==0.1.8
Not found: feedparser==5.1.3
Not found: requests==2.4.3
Not found: Twisted==14.0.2
Not found: werkzeug==0.9.6
Not found: babel==1.3
Processing dependencies for pipe2py==0.23.0
Finished processing dependencies for pipe2py==0.23.0And now I get the same error as I got on Windows yay -.-
Traceback (most recent call last):
File "pipe2py/compile.py", line 44, in <module>
from pipe2py.modules.pipeforever import pipe_forever
File "/usr/local/lib/python2.7/dist-packages/pipe2py-0.23.0-py2.7.egg/pipe2py/modules/__init__.py", line 9, in <module>
verbose = debug printing during compilation and running
ImportError: No module named internet.deferSomehow, I got past that. Did you use the kazeeki zip file or the last ggaughan one?
On July 5, 2015 5:43:24 PM GMT+02:00, DreamFlasher notifications@github.com wrote:
I guess I can now reproduce @Free16t
Installing compile script to /usr/local/bin Installed /usr/local/lib/python2.7/dist-packages/pipe2py-0.23.0-py2.7.egg Not found: Jinja2==2.7.2 Not found: MarkupSafe==0.21 Not found: html5lib==0.999 Not found: lxml==3.3.5 Not found: mccabe==0.2.1 Not found: six==1.7.3 Not found: speedparser==0.1.8 Not found: feedparser==5.1.3 Not found: requests==2.4.3 Not found: Twisted==14.0.2 Not found: werkzeug==0.9.6 Not found: babel==1.3 Processing dependencies for pipe2py==0.23.0 Finished processing dependencies for pipe2py==0.23.0And now I get the same error as I got on Windows yay -.-
Traceback (most recent call last): File "pipe2py/compile.py", line 44, in <module> from pipe2py.modules.pipeforever import pipe_forever File "/usr/local/lib/python2.7/dist-packages/pipe2py-0.23.0-py2.7.egg/pipe2py/modules/__init__.py", line 9, in <module> verbose = debug printing during compilation and running ImportError: No module named internet.defer
Reply to this email directly or view it on GitHub: https://github.com/ggaughan/pipe2py/issues/31#issuecomment-118634560
Piet
dreamflasher
commented
9 years ago Latest @ggaughan, I'll now try this one as he suggested: https://github.com/ggaughan/pipe2py/tree/6a5c31eb218904a17800387bc4cd4239ba1b0b34
dreamflasher
commented
9 years ago Not working either. At least the installation runs through, but when running compile getting:
Traceback (most recent call last):
File "compile.py", line 38, in <module>
from pipe2py import util
ImportError: cannot import name utilSetting PYTHONPATH or sys.path.append("full/path/to/repo/dir") didn't help.
ggaughan
commented
9 years ago @DreamFlasher - did you follow the steps in the README from 6a5c31eb218904a17800387bc4cd4239ba1b0b34 (python setup.py install)? If so, what's the command you're using to run compile.py?
dreamflasher
commented
9 years ago Yes. What I did was to run python setup.py install and then
python compile.py -p ELOB36rp2xGCF8T_1vC6Jw
yields
Traceback (most recent call last):
File "compile.py", line 38, in <module>
from pipe2py import util
ImportError: cannot import name utilAnd python pipe2py/compile.py pipe_ELOB36rp2xGCF8T_1vC6Jw.json yields the same error.
ggaughan
commented
9 years ago These are the steps that work for me on Ubuntu 14.04:
mkdir test
cd test
git clone git@github.com:ggaughan/pipe2py.git
#switch to the earlier known-to-install version
cd pipe2py
git checkout 6a5c31eb218904a17800387bc4cd4239ba1b0b34
#install into a virtual environment
virtualenv env
source env/bin/activate
python setup.py install
#compile the pipe
python compile.py -p ELOB36rp2xGCF8T_1vC6Jw
#run the compiled pipe
python pipe_ELOB36rp2xGCF8T_1vC6Jw.py(running the pipe gives a string to float error in a simplemath node, but that should be easy to fix)
dreamflasher
commented
9 years ago I need to do git clone https://github.com/ggaughan/pipe2py.git, but that shouldn't make a difference. Previously I didn't set up the virtualenv. Anyways, thank you very very much! This works for me and I can go from here :) Awesome!
piet8stevens
commented
9 years ago @ggaughan and DreamFlasher: thank you to both of you. This also worked for me.
A bit of a late reaction but I have been busy lately so could not check earlier.
Hi,
I'm currently working to have pipe2py working on my servers (Ubuntu 14.04 and FreeBSD 10.1) but I don't understand why, I have an error during the
python setup.py installIndeed, I successfully installed Jinja2-2.7.2 MarkupSafe-0.21 Twisted-14.0.2 babel-1.3 feedparser-5.1.3 lxml-3.3.5 mccabe-0.2.1 mezmorize requests-2.4.3 six-1.7.3 speedparser-0.1.8 werkzeug-0.9.6 yet I have this message during the install:
I will see and try to develop a Django frontend for this pipe2py in order to have a drag and drop like Pipes.
Sincerely