datamade / usaddress

:us: a python library for parsing unstructured United States address strings into address components
https://parserator.datamade.us/usaddress
MIT License
1.52k stars 304 forks source link

Install error on Python 2.7.6 on Ubuntu 14.04 LTS #76

Closed John-Nagle closed 9 years ago

John-Nagle commented 9 years ago

Install crashes badly on Ubuntu. Some of the errors:

ERROR: /bin/sh: 1: xslt-config: not found
** make sure the development packages of libxml2 and libxslt are installed **

... Running setup.py install for parserator File "/usr/local/lib/python2.7/dist-packages/parserator/utils.py", line 69 def fit(self, X, y, **params, model_path): ^ SyntaxError: invalid syntax

There are hundreds of GCC warnings as an attempt is made to build "crfsuite", which isn't good enough code for the high warning levels enabled.

After removing the existing installation of "lxml", PIP crashes trying to restore it:

Cleaning up... Command /usr/bin/python -c "import setuptools, tokenize;file='/tmp/pip_build_root/lxml/setup.py';exec(compile(getattr(tokenize, 'open', open)(file).read().replace('\r\n', '\n'), file, 'exec'))" install --record /tmp/pip-MHzJKR-record/install-record.txt --single-version-externally-managed --compile failed with error code 1 in /tmp/pip_build_root/lxml Traceback (most recent call last): File "/usr/bin/pip", line 9, in load_entry_point('pip==1.5.4', 'console_scripts', 'pip')() File "/usr/lib/python2.7/dist-packages/pip/init.py", line 185, in main return command.main(cmd_args) File "/usr/lib/python2.7/dist-packages/pip/basecommand.py", line 161, in main text = '\n'.join(complete_log) UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 42: ordinal not in range(128)

The install may need the development library for libxslt, but it doesn't stop; it keeps plowing ahead and screwing up. It clearly wants one of the many lxml-related packages, but which one?

John-Nagle commented 9 years ago

Entire install log:

john@john-All-Series:~$ pip install usaddress Downloading/unpacking usaddress Downloading usaddress-0.3.1.tar.gz (52kB): 52kB downloaded Running setup.py (path:/tmp/pip_build_john/usaddress/setup.py) egg_info for package usaddress

Downloading/unpacking future>=0.14.3 (from usaddress) Downloading future-0.14.3.tar.gz (1.5MB): 1.5MB downloaded Running setup.py (path:/tmp/pip_build_john/future/setup.py) egg_info for package future

warning: no files found matching '*.au' under directory 'tests'
warning: no files found matching '*.gif' under directory 'tests'
warning: no files found matching '*.txt' under directory 'tests'

Downloading/unpacking parserator>=0.3 (from usaddress) Downloading parserator-0.3.tar.gz Running setup.py (path:/tmp/pip_build_john/parserator/setup.py) egg_info for package parserator

Downloading/unpacking python-crfsuite>=0.7 (from usaddress) Downloading python-crfsuite-0.8.2.tar.gz (383kB): 383kB downloaded Running setup.py (path:/tmp/pip_build_john/python-crfsuite/setup.py) egg_info for package python-crfsuite

Downloading/unpacking lxml==3.4.1 (from parserator>=0.3->usaddress) Downloading lxml-3.4.1.tar.gz (3.5MB): 3.5MB downloaded Running setup.py (path:/tmp/pip_build_john/lxml/setup.py) egg_info for package lxml /usr/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'bugtrack_url' warnings.warn(msg) Building lxml version 3.4.1. Building without Cython. ERROR: /bin/sh: 1: xslt-config: not found

** make sure the development packages of libxml2 and libxslt are installed **

Using build configuration of libxslt

warning: no previously-included files found matching '*.py'

Downloading/unpacking Unidecode==0.4.17 (from parserator>=0.3->usaddress) Downloading Unidecode-0.04.17.tar.gz (201kB): 201kB downloaded Running setup.py (path:/tmp/pip_build_john/Unidecode/setup.py) egg_info for package Unidecode

Installing collected packages: usaddress, future, parserator, python-crfsuite, lxml, Unidecode Running setup.py install for usaddress error: could not create '/usr/local/lib/python2.7/dist-packages/usaddress': Permission denied Complete output from command /usr/bin/python -c "import setuptools, tokenize;file='/tmp/pip_buildjohn/usaddress/setup.py';exec(compile(getattr(tokenize, 'open', open)(file).read().replace('\r\n', '\n'), file, 'exec'))" install --record /tmp/pip-zZpJ1-record/install-record.txt --single-version-externally-managed --compile: running install

running build

running build_py

creating build

creating build/lib.linux-x86_64-2.7

creating build/lib.linux-x86_64-2.7/usaddress

copying usaddress/init.py -> build/lib.linux-x86_64-2.7/usaddress

copying usaddress/usaddr.crfsuite -> build/lib.linux-x86_64-2.7/usaddress

running install_lib

creating /usr/local/lib/python2.7/dist-packages/usaddress

error: could not create '/usr/local/lib/python2.7/dist-packages/usaddress': Permission denied


Cleaning up... Command /usr/bin/python -c "import setuptools, tokenize;file='/tmp/pip_buildjohn/usaddress/setup.py';exec(compile(getattr(tokenize, 'open', open)(file).read().replace('\r\n', '\n'), file, 'exec'))" install --record /tmp/pip-zZpJ1-record/install-record.txt --single-version-externally-managed --compile failed with error code 1 in /tmp/pip_build_john/usaddress Storing debug log for failure in /home/john/.pip/pip.log

=====================RETRYING UNDER sudo TO ALLOW ACCESS TO PYTHON INSTALLATION===================

john@john-All-Series:~$ sudo pip install usaddress [sudo] password for john: no talloc stackframe at ../source3/param/loadparm.c:4864, leaking memory Downloading/unpacking usaddress Downloading usaddress-0.3.1.tar.gz (52kB): 52kB downloaded Running setup.py (path:/tmp/pip_build_root/usaddress/setup.py) egg_info for package usaddress

Downloading/unpacking future>=0.14.3 (from usaddress) Downloading future-0.14.3.tar.gz (1.5MB): 1.5MB downloaded Running setup.py (path:/tmp/pip_build_root/future/setup.py) egg_info for package future

warning: no files found matching '*.au' under directory 'tests'
warning: no files found matching '*.gif' under directory 'tests'
warning: no files found matching '*.txt' under directory 'tests'

Downloading/unpacking parserator>=0.3 (from usaddress) Downloading parserator-0.3.tar.gz Running setup.py (path:/tmp/pip_build_root/parserator/setup.py) egg_info for package parserator

Downloading/unpacking python-crfsuite>=0.7 (from usaddress) Downloading python-crfsuite-0.8.2.tar.gz (383kB): 383kB downloaded Running setup.py (path:/tmp/pip_build_root/python-crfsuite/setup.py) egg_info for package python-crfsuite

Downloading/unpacking lxml==3.4.1 (from parserator>=0.3->usaddress) Downloading lxml-3.4.1.tar.gz (3.5MB): 3.5MB downloaded Running setup.py (path:/tmp/pip_build_root/lxml/setup.py) egg_info for package lxml /usr/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'bugtrack_url' warnings.warn(msg) Building lxml version 3.4.1. Building without Cython. ERROR: /bin/sh: 1: xslt-config: not found

** make sure the development packages of libxml2 and libxslt are installed **

Using build configuration of libxslt

warning: no previously-included files found matching '*.py'

Downloading/unpacking Unidecode==0.4.17 (from parserator>=0.3->usaddress) Downloading Unidecode-0.04.17.tar.gz (201kB): 201kB downloaded Running setup.py (path:/tmp/pip_build_root/Unidecode/setup.py) egg_info for package Unidecode

Installing collected packages: usaddress, future, parserator, python-crfsuite, lxml, Unidecode Running setup.py install for usaddress

Running setup.py install for future

warning: no files found matching '*.au' under directory 'tests'
warning: no files found matching '*.gif' under directory 'tests'
warning: no files found matching '*.txt' under directory 'tests'
Installing pasteurize script to /usr/local/bin
Installing futurize script to /usr/local/bin

Running setup.py install for parserator File "/usr/local/lib/python2.7/dist-packages/parserator/utils.py", line 69 def fit(self, X, y, **params, model_path): ^ SyntaxError: invalid syntax

Installing parserator script to /usr/local/bin

Running setup.py install for python-crfsuite building 'pycrfsuite._pycrfsuite' extension x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/include/python2.7 -c pycrfsuite/_pycrfsuite.cpp -o build/temp.linux-x86_64-2.7/pycrfsuite/_pycrfsuite.o cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++ [enabled by default] pycrfsuite/_pycrfsuite.cpp: In function ‘int pyx_pf_10pycrfsuite_11_pycrfsuite_11BaseTrainer_2cinit(*pyx_obj_10pycrfsuite_11_pycrfsuiteBaseTrainer)’: pycrfsuite/_pycrfsuite.cpp:2963:7: warning: variable ‘pyx_t_3’ set but not used [-Wunused-but-set-variable] int pyx_t_3; ^ x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/include/python2.7 -c pycrfsuite/trainer_wrapper.cpp -o build/temp.linux-x86_64-2.7/pycrfsuite/trainer_wrapper.o cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++ [enabled by default] x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/include/python2.7 -c crfsuite/lib/crf/src/holdout.c -o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/holdout.o In file included from crfsuite/lib/crf/src/holdout.c:41:0: crfsuite/lib/crf/src/crfsuite_internal.h:168:1: warning: function declaration isn’t a prototype [-Wstrict-prototypes] encoder_t crf1d_create_encoder(); ^ x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/include/python2.7 -c crfsuite/lib/crf/src/train_averaged_perceptron.c -o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/train_averaged_perceptron.o In file included from crfsuite/lib/crf/src/train_averaged_perceptron.c:44:0: crfsuite/lib/crf/src/crfsuite_internal.h:168:1: warning: function declaration isn’t a prototype [-Wstrict-prototypes] encoder_t *crf1d_create_encoder(); ^ In file included from crfsuite/lib/crf/src/train_averaged_perceptron.c:46:0: crfsuite/lib/crf/src/params.h:36:1: warning: function declaration isn’t a prototype [-Wstrict-prototypes] crfsuite_paramst params_create_instance(); ^ crfsuite/lib/crf/src/train_averaged_perceptron.c: In function ‘exchange_options’: crfsuite/lib/crf/src/params.h:49:13: warning: variable ‘ret’ set but not used [-Wunused-but-set-variable] int ret = 0; \ ^ crfsuite/lib/crf/src/train_averaged_perceptron.c:87:5: note: in expansion of macro ‘BEGIN_PARAM_MAP’ BEGIN_PARAM_MAP(params, mode) ^ crfsuite/lib/crf/src/train_averaged_perceptron.c: In function ‘crfsuite_train_averaged_perceptron’: crfsuite/lib/crf/src/train_averaged_perceptron.c:155:20: warning: unused variable ‘norm’ [-Wunused-variable] floatval_t norm = 0., loss = 0.; ^ x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/include/python2.7 -c crfsuite/lib/crf/src/train_l2sgd.c -o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/train_l2sgd.o In file included from crfsuite/lib/crf/src/train_l2sgd.c:104:0: crfsuite/lib/crf/src/crfsuite_internal.h:168:1: warning: function declaration isn’t a prototype [-Wstrict-prototypes] encoder_t _crf1d_create_encoder(); ^ In file included from crfsuite/lib/crf/src/train_l2sgd.c:107:0: crfsuite/lib/crf/src/params.h:36:1: warning: function declaration isn’t a prototype [-Wstrict-prototypes] crfsuite_paramst params_create_instance(); ^ crfsuite/lib/crf/src/train_l2sgd.c: In function ‘l2sgd’: crfsuite/lib/crf/src/train_l2sgd.c:152:23: warning: unused variable ‘clk_begin’ [-Wunused-variable] clock_t clk_prev, clk_begin = clock(); ^ In file included from crfsuite/lib/crf/src/train_l2sgd.c:107:0: crfsuite/lib/crf/src/train_l2sgd.c: In function ‘exchange_options’: crfsuite/lib/crf/src/params.h:49:13: warning: variable ‘ret’ set but not used [-Wunused-but-set-variable] int ret = 0; \ ^ crfsuite/lib/crf/src/train_l2sgd.c:390:5: note: in expansion of macro ‘BEGIN_PARAM_MAP’ BEGIN_PARAM_MAP(params, mode) ^ crfsuite/lib/crf/src/train_l2sgd.c: In function ‘crfsuite_train_l2sgd’: crfsuite/lib/crf/src/train_l2sgd.c:454:15: warning: unused variable ‘T’ [-Wunused-variable] const int T = gm->cap_items; ^ crfsuite/lib/crf/src/train_l2sgd.c: In function ‘l2sgd’: crfsuite/lib/crf/src/train_l2sgd.c:237:20: warning: ‘eta’ may be used uninitialized in this function [-Wmaybe-uninitialized] logging(lg, "Learning rate (eta): %f\n", eta); ^ x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/include/python2.7 -c crfsuite/lib/crf/src/logging.c -o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/logging.o x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/include/python2.7 -c crfsuite/lib/crf/src/crfsuite_train.c -o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/crfsuite_train.o In file included from crfsuite/lib/crf/src/crfsuite_train.c:43:0: crfsuite/lib/crf/src/crfsuite_internal.h:168:1: warning: function declaration isn’t a prototype [-Wstrict-prototypes] encoder_t _crf1d_create_encoder(); ^ In file included from crfsuite/lib/crf/src/crfsuite_train.c:44:0: crfsuite/lib/crf/src/params.h:36:1: warning: function declaration isn’t a prototype [-Wstrict-prototypes] crfsuite_paramst params_create_instance(); ^ crfsuite/lib/crf/src/crfsuite_train.c: In function ‘crfsuite_train_train’: crfsuite/lib/crf/src/crfsuite_train.c:131:11: warning: unused variable ‘algorithm’ [-Wunused-variable] char _algorithm = NULL; ^ x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/include/python2.7 -c crfsuite/lib/crf/src/dataset.c -o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/dataset.o In file included from crfsuite/lib/crf/src/dataset.c:41:0: crfsuite/lib/crf/src/crfsuite_internal.h:168:1: warning: function declaration isn’t a prototype [-Wstrict-prototypes] encoder_t crf1d_create_encoder(); ^ x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/include/python2.7 -c crfsuite/lib/crf/src/params.c -o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/params.o In file included from crfsuite/lib/crf/src/params.c:39:0: crfsuite/lib/crf/src/quark.h:39:1: warning: function declaration isn’t a prototype [-Wstrict-prototypes] quarkt quark_new(); ^ crfsuite/lib/crf/src/params.c:250:20: warning: function declaration isn’t a prototype [-Wstrict-prototypes] crfsuite_params_t\ params_create_instance() ^ x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/include/python2.7 -c crfsuite/lib/crf/src/train_lbfgs.c -o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/train_lbfgs.o In file included from crfsuite/lib/crf/src/train_lbfgs.c:46:0: crfsuite/lib/crf/src/crfsuite_internal.h:168:1: warning: function declaration isn’t a prototype [-Wstrict-prototypes] encoder_t _crf1d_create_encoder(); ^ In file included from crfsuite/lib/crf/src/train_lbfgs.c:49:0: crfsuite/lib/crf/src/params.h:36:1: warning: function declaration isn’t a prototype [-Wstrict-prototypes] crfsuite_paramst params_create_instance(); ^ crfsuite/lib/crf/src/train_lbfgs.c: In function ‘exchange_options’: crfsuite/lib/crf/src/params.h:49:13: warning: variable ‘ret’ set but not used [-Wunused-but-set-variable] int ret = 0; \ ^ crfsuite/lib/crf/src/train_lbfgs.c:163:5: note: in expansion of macro ‘BEGIN_PARAM_MAP’ BEGIN_PARAM_MAP(params, mode) ^ crfsuite/lib/crf/src/train_lbfgs.c: In function ‘crfsuite_train_lbfgs’: crfsuite/lib/crf/src/train_lbfgs.c:231:15: warning: unused variable ‘A’ [-Wunused-variable] const int A = trainset->data->attrs->num(trainset->data->attrs); ^ crfsuite/lib/crf/src/train_lbfgs.c:230:15: warning: unused variable ‘L’ [-Wunused-variable] const int L = trainset->data->labels->num(trainset->data->labels); ^ crfsuite/lib/crf/src/train_lbfgs.c:229:15: warning: unused variable ‘N’ [-Wunused-variable] const int N = trainset->num_instances; ^ x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/include/python2.7 -c crfsuite/lib/crf/src/train_arow.c -o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/train_arow.o In file included from crfsuite/lib/crf/src/train_arow.c:44:0: crfsuite/lib/crf/src/crfsuite_internal.h:168:1: warning: function declaration isn’t a prototype [-Wstrict-prototypes] encoder_t _crf1d_create_encoder(); ^ In file included from crfsuite/lib/crf/src/train_arow.c:46:0: crfsuite/lib/crf/src/params.h:36:1: warning: function declaration isn’t a prototype [-Wstrict-prototypes] crfsuite_paramst params_create_instance(); ^ crfsuite/lib/crf/src/train_arow.c: In function ‘exchange_options’: crfsuite/lib/crf/src/params.h:49:13: warning: variable ‘ret’ set but not used [-Wunused-but-set-variable] int ret = 0; \ ^ crfsuite/lib/crf/src/train_arow.c:207:5: note: in expansion of macro ‘BEGIN_PARAM_MAP’ BEGIN_PARAM_MAP(params, mode) ^ crfsuite/lib/crf/src/train_arow.c: In function ‘crfsuite_train_arow’: crfsuite/lib/crf/src/train_arow.c:288:20: warning: unused variable ‘norm’ [-Wunused-variable] floatval_t norm = 0., sum_loss = 0.; ^ crfsuite/lib/crf/src/train_arow.c:245:16: warning: variable ‘beta’ set but not used [-Wunused-but-set-variable] floatval_t beta; ^ crfsuite/lib/crf/src/train_arow.c: At top level: crfsuite/lib/crf/src/train_arow.c:145:19: warning: ‘delta_norm2’ defined but not used [-Wunused-function] static floatval_t delta_norm2(delta_t dc) ^ crfsuite/lib/crf/src/train_arow.c:157:13: warning: ‘delta_add’ defined but not used [-Wunused-function] static void delta_add(delta_t dc, floatval_t w, floatval_t ws, const floatval_t tau, const floatval_t u) ^ crfsuite/lib/crf/src/train_arow.c:180:19: warning: ‘cost_insensitive’ defined but not used [-Wunused-function] static floatval_t cost_insensitive(floatval_t err, floatval_t d) ^ crfsuite/lib/crf/src/train_arow.c:185:19: warning: ‘cost_sensitive’ defined but not used [-Wunused-function] static floatval_t cost_sensitive(floatval_t err, floatval_t d) ^ crfsuite/lib/crf/src/train_arow.c:190:19: warning: ‘tau0’ defined but not used [-Wunused-function] static floatval_t tau0(floatval_t cost, floatval_t norm, floatval_t c) ^ crfsuite/lib/crf/src/train_arow.c:195:19: warning: ‘tau1’ defined but not used [-Wunused-function] static floatval_t tau1(floatval_t cost, floatval_t norm, floatval_t c) ^ crfsuite/lib/crf/src/train_arow.c:200:19: warning: ‘tau2’ defined but not used [-Wunused-function] static floatval_t tau2(floatval_t cost, floatval_t norm, floatval_t c) ^ x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/include/python2.7 -c crfsuite/lib/crf/src/crf1d_model.c -o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/crf1d_model.o In file included from crfsuite/lib/crf/src/crf1d.h:37:0, from crfsuite/lib/crf/src/crf1d_model.c:42: crfsuite/lib/crf/src/crfsuite_internal.h:168:1: warning: function declaration isn’t a prototype [-Wstrict-prototypes] encoder_t crf1d_create_encoder(); ^ crfsuite/lib/crf/src/crf1d_model.c: In function ‘crf1mmw’: crfsuite/lib/crf/src/crf1d_model.c:231:5: warning: pointer targets in passing argument 1 of ‘strncpy’ differ in signedness [-Wpointer-sign] strncpy(header->magic, FILEMAGIC, 4); ^ In file included from /usr/include/features.h:374:0, from /usr/include/stdio.h:27, from crfsuite/lib/crf/src/crf1d_model.c:35: /usr/include/x86_64-linux-gnu/bits/string3.h:117:1: note: expected ‘char * __restrict’ but argument is of type ‘uint8t NTH (strncpy (char restrict dest, const char restrict src, ^ crfsuite/lib/crf/src/crf1d_model.c:232:5: warning: pointer targets in passing argument 1 of ‘strncpy’ differ in signedness [-Wpointer-sign] strncpy(header->type, MODELTYPE, 4); ^ In file included from /usr/include/features.h:374:0, from /usr/include/stdio.h:27, from crfsuite/lib/crf/src/crf1d_model.c:35: /usr/include/x86_64-linux-gnu/bits/string3.h:117:1: note: expected ‘char \ restrict’ but argument is of type ‘uint8_t *’ *NTH (strncpy (char restrict dest, const char restrict src, ^ crfsuite/lib/crf/src/crf1d_model.c: In function ‘crf1dmw_open_labelrefs’: crfsuite/lib/crf/src/crf1d_model.c:438:5: warning: pointer targets in passing argument 1 of ‘strncpy’ differ in signedness [-Wpointer-sign] strncpy(href->chunk, CHUNK_LABELREF, 4); ^ In file included from /usr/include/features.h:374:0, from /usr/include/stdio.h:27, from crfsuite/lib/crf/src/crf1d_model.c:35: /usr/include/x86_64-linux-gnu/bits/string3.h:117:1: note: expected ‘char \ __restrict’ but argument is of type ‘uint8_t *’ NTH (strncpy (char restrict dest, const char restrict src, ^ crfsuite/lib/crf/src/crf1d_model.c: In function ‘crf1dmw_put_labelref’: crfsuite/lib/crf/src/crf1d_model.c:487:21: warning: unused variable ‘offset’ [-Wunused-variable] uint32_t n = 0, offset = 0; ^ crfsuite/lib/crf/src/crf1d_model.c: In function ‘crf1dmw_open_attrrefs’: crfsuite/lib/crf/src/crf1d_model.c:545:5: warning: pointer targets in passing argument 1 of ‘strncpy’ differ in signedness [-Wpointer-sign] strncpy(href->chunk, CHUNK_ATTRREF, 4); ^ In file included from /usr/include/features.h:374:0, from /usr/include/stdio.h:27, from crfsuite/lib/crf/src/crf1d_model.c:35: /usr/include/x86_64-linux-gnu/bits/string3.h:117:1: note: expected ‘char * __restrict’ but argument is of type ‘uint8_t *’ NTH (strncpy (char restrict dest, const char restrict src, ^ crfsuite/lib/crf/src/crf1d_model.c: In function ‘crf1dmw_put_attrref’: crfsuite/lib/crf/src/crf1d_model.c:594:21: warning: unused variable ‘offset’ [-Wunused-variable] uint32_t n = 0, offset = 0; ^ crfsuite/lib/crf/src/crf1d_model.c: In function ‘crf1dmw_open_features’: crfsuite/lib/crf/src/crf1d_model.c:640:5: warning: pointer targets in passing argument 1 of ‘strncpy’ differ in signedness [-Wpointer-sign] strncpy(hfeat->chunk, CHUNK_FEATURE, 4); ^ In file included from /usr/include/features.h:374:0, from /usr/include/stdio.h:27, from crfsuite/lib/crf/src/crf1d_model.c:35: /usr/include/x86_64-linux-gnu/bits/string3.h:117:1: note: expected ‘char * __restrict’ but argument is of type ‘uint8_t ’ __NTH (strncpy (char restrict dest, const char restrict src, ^ crfsuite/lib/crf/src/crf1d_model.c: In function ‘crf1dm_get_labelref’: crfsuite/lib/crf/src/crf1d_model.c:851:5: warning: pointer targets in passing argument 2 of ‘read_uint32’ differ in signedness [-Wpointer-sign] p += read_uint32(p, &ref->num_features); ^ crfsuite/lib/crf/src/crf1d_model.c:141:12: note: expected ‘uint32_t ’ but argument is of type ‘int ’ static int read_uint32(uint8t buffer, uint32_t* value) ^ crfsuite/lib/crf/src/crf1d_model.c: In function ‘crf1dm_get_attrref’: crfsuite/lib/crf/src/crf1d_model.c:867:5: warning: pointer targets in passing argument 2 of ‘read_uint32’ differ in signedness [-Wpointer-sign] p += read_uint32(p, &ref->num_features); ^ crfsuite/lib/crf/src/crf1d_model.c:141:12: note: expected ‘uint32t ’ but argument is of type ‘int ’ static int read_uint32(uint8t buffer, uint32_t* value) ^ x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/include/python2.7 -c crfsuite/lib/crf/src/crf1d_tag.c -o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/crf1d_tag.o In file included from crfsuite/lib/crf/src/crf1d.h:37:0, from crfsuite/lib/crf/src/crf1d_tag.c:46: crfsuite/lib/crf/src/crfsuite_internal.h:168:1: warning: function declaration isn’t a prototype [-Wstrict-prototypes] encoder_t _crf1d_create_encoder(); ^ crfsuite/lib/crf/src/crf1d_tag.c: In function ‘crf1dt_state_score’: crfsuite/lib/crf/src/crf1d_tag.c:72:15: warning: unused variable ‘L’ [-Wunused-variable] const int L = crf1dt->num_labels; ^ x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/include/python2.7 -c crfsuite/lib/crf/src/crfsuite.c -o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/crfsuite.o crfsuite/lib/crf/src/crfsuite.c:316:14: warning: ‘safe_strncpy’ defined but not used [-Wunused-function] static char safe_strncpy(char dst, const char src, size_t n) ^ x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/include/python2.7 -c crfsuite/lib/crf/src/dictionary.c -o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/dictionary.o In file included from crfsuite/lib/crf/src/dictionary.c:39:0: crfsuite/lib/crf/src/quark.h:39:1: warning: function declaration isn’t a prototype [-Wstrict-prototypes] quarkt quark_new(); ^ x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/include/python2.7 -c crfsuite/lib/crf/src/rumavl.c -o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/rumavl.o x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/include/python2.7 -c crfsuite/lib/crf/src/train_passive_aggressive.c -o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/train_passive_aggressive.o In file included from crfsuite/lib/crf/src/train_passive_aggressive.c:44:0: crfsuite/lib/crf/src/crfsuite_internal.h:168:1: warning: function declaration isn’t a prototype [-Wstrict-prototypes] encoder_t _crf1d_create_encoder(); ^ In file included from crfsuite/lib/crf/src/train_passive_aggressive.c:46:0: crfsuite/lib/crf/src/params.h:36:1: warning: function declaration isn’t a prototype [-Wstrict-prototypes] crfsuite_paramst params_create_instance(); ^ crfsuite/lib/crf/src/train_passive_aggressive.c: In function ‘exchange_options’: crfsuite/lib/crf/src/params.h:49:13: warning: variable ‘ret’ set but not used [-Wunused-but-set-variable] int ret = 0; \ ^ crfsuite/lib/crf/src/train_passive_aggressive.c:209:5: note: in expansion of macro ‘BEGIN_PARAM_MAP’ BEGIN_PARAM_MAP(params, mode) ^ crfsuite/lib/crf/src/train_passive_aggressive.c: In function ‘crfsuite_train_passive_aggressive’: crfsuite/lib/crf/src/train_passive_aggressive.c:318:20: warning: unused variable ‘norm’ [-Wunused-variable] floatval_t norm = 0., sum_loss = 0.; ^ x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/include/python2.7 -c crfsuite/lib/crf/src/crf1d_context.c -o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/crf1d_context.o In file included from crfsuite/lib/crf/src/crf1d.h:37:0, from crfsuite/lib/crf/src/crf1d_context.c:46: crfsuite/lib/crf/src/crfsuite_internal.h:168:1: warning: function declaration isn’t a prototype [-Wstrict-prototypes] encoder_t _crf1d_create_encoder(); ^ crfsuite/lib/crf/src/crf1d_context.c: In function ‘crf1dc_new’: crfsuite/lib/crf/src/crf1d_context.c:71:9: warning: suggest parentheses around assignment used as truth value [-Wparentheses] if (ret = crf1dc_set_num_items(ctx, T)) { ^ crfsuite/lib/crf/src/crf1d_context.c: In function ‘crf1dc_score’: crfsuite/lib/crf/src/crf1d_context.c:440:15: warning: unused variable ‘L’ [-Wunused-variable] const int L = ctx->num_labels; ^ crfsuite/lib/crf/src/crf1d_context.c:438:38: warning: unused variable ‘cur’ [-Wunused-variable] const floatval_t state = NULL, cur = NULL, trans = NULL; ^ x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/include/python2.7 -c crfsuite/lib/crf/src/crf1d_encode.c -o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/crf1d_encode.o In file included from crfsuite/lib/crf/src/crf1d_encode.c:45:0: crfsuite/lib/crf/src/crfsuite_internal.h:168:1: warning: function declaration isn’t a prototype [-Wstrict-prototypes] encoder_t crf1d_create_encoder(); ^ In file included from crfsuite/lib/crf/src/crf1d_encode.c:47:0: crfsuite/lib/crf/src/params.h:36:1: warning: function declaration isn’t a prototype [-Wstrict-prototypes] crfsuite_paramst params_create_instance(); ^ crfsuite/lib/crf/src/crf1d_encode.c: In function ‘crf1de_state_score’: crfsuite/lib/crf/src/crf1d_encode.c:128:15: warning: unused variable ‘L’ [-Wunused-variable] const int L = crf1de->num_labels; ^ crfsuite/lib/crf/src/crf1d_encode.c: In function ‘crf1de_state_score_scaled’: crfsuite/lib/crf/src/crf1d_encode.c:164:15: warning: unused variable ‘L’ [-Wunused-variable] const int L = crf1de->num_labels; ^ crfsuite/lib/crf/src/crf1d_encode.c: In function ‘crf1de_features_on_path’: crfsuite/lib/crf/src/crf1d_encode.c:260:15: warning: unused variable ‘L’ [-Wunused-variable] const int L = crf1de->num_labels; ^ crfsuite/lib/crf/src/crf1d_encode.c:258:22: warning: unused variable ‘ctx’ [-Wunused-variable] crf1d_context_t* ctx = crf1de->ctx; ^ crfsuite/lib/crf/src/crf1d_encode.c: In function ‘crf1de_observation_expectation’: crfsuite/lib/crf/src/crf1d_encode.c:313:15: warning: unused variable ‘L’ [-Wunused-variable] const int L = crf1de->num_labels; ^ crfsuite/lib/crf/src/crf1d_encode.c:311:22: warning: unused variable ‘ctx’ [-Wunused-variable] crf1d_context_t* ctx = crf1de->ctx; ^ crfsuite/lib/crf/src/crf1d_encode.c: In function ‘crf1de_model_expectation’: crfsuite/lib/crf/src/crf1d_encode.c:364:41: warning: unused variable ‘trans’ [-Wunused-variable] const feature_refs_t _attr = NULL, trans = NULL; ^ crfsuite/lib/crf/src/crf1d_encode.c: In function ‘crf1de_save_model’: crfsuite/lib/crf/src/crf1d_encode.c:543:5: warning: suggest parentheses around assignment used as truth value [-Wparentheses] if (ret = crf1dmw_open_features(writer)) { ^ crfsuite/lib/crf/src/crf1d_encode.c:577:13: warning: suggest parentheses around assignment used as truth value [-Wparentheses] if (ret = crf1dmw_put_feature(writer, fmap[k], &feat)) { ^ crfsuite/lib/crf/src/crf1d_encode.c:584:5: warning: suggest parentheses around assignment used as truth value [-Wparentheses] if (ret = crf1dmw_close_features(writer)) { ^ crfsuite/lib/crf/src/crf1d_encode.c:594:5: warning: suggest parentheses around assignment used as truth value [-Wparentheses] if (ret = crf1dmw_open_labels(writer, L)) { ^ crfsuite/lib/crf/src/crf1d_encode.c:601:13: warning: suggest parentheses around assignment used as truth value [-Wparentheses] if (ret = crf1dmw_put_label(writer, l, str)) { ^ crfsuite/lib/crf/src/crf1d_encode.c:607:5: warning: suggest parentheses around assignment used as truth value [-Wparentheses] if (ret = crf1dmw_close_labels(writer)) { ^ crfsuite/lib/crf/src/crf1d_encode.c:613:5: warning: suggest parentheses around assignment used as truth value [-Wparentheses] if (ret = crf1dmw_open_attrs(writer, B)) { ^ crfsuite/lib/crf/src/crf1d_encode.c:621:17: warning: suggest parentheses around assignment used as truth value [-Wparentheses] if (ret = crf1dmw_put_attr(writer, amap[a], str)) { ^ crfsuite/lib/crf/src/crf1d_encode.c:628:5: warning: suggest parentheses around assignment used as truth value [-Wparentheses] if (ret = crf1dmw_close_attrs(writer)) { ^ crfsuite/lib/crf/src/crf1d_encode.c:634:5: warning: suggest parentheses around assignment used as truth value [-Wparentheses] if (ret = crf1dmw_open_labelrefs(writer, L+2)) { ^ crfsuite/lib/crf/src/crf1d_encode.c:639:9: warning: suggest parentheses around assignment used as truth value [-Wparentheses] if (ret = crf1dmw_put_labelref(writer, l, edge, fmap)) { ^ crfsuite/lib/crf/src/crf1d_encode.c:643:5: warning: suggest parentheses around assignment used as truth value [-Wparentheses] if (ret = crf1dmw_close_labelrefs(writer)) { ^ crfsuite/lib/crf/src/crf1d_encode.c:649:5: warning: suggest parentheses around assignment used as truth value [-Wparentheses] if (ret = crf1dmw_open_attrrefs(writer, B)) { ^ crfsuite/lib/crf/src/crf1d_encode.c:655:13: warning: suggest parentheses around assignment used as truth value [-Wparentheses] if (ret = crf1dmw_put_attrref(writer, amap[a], attr, fmap)) { ^ crfsuite/lib/crf/src/crf1d_encode.c:660:5: warning: suggest parentheses around assignment used as truth value [-Wparentheses] if (ret = crf1dmw_close_attrrefs(writer)) { ^ crfsuite/lib/crf/src/crf1d_encode.c:500:22: warning: unused variable ‘threshold’ [-Wunused-variable] const floatval_t threshold = 0.01; ^ In file included from crfsuite/lib/crf/src/crf1d_encode.c:47:0: crfsuite/lib/crf/src/crf1d_encode.c: In function ‘crf1de_exchange_options’: crfsuite/lib/crf/src/params.h:49:13: warning: variable ‘ret’ set but not used [-Wunused-but-set-variable] int ret = 0; \ ^ crfsuite/lib/crf/src/crf1d_encode.c:688:5: note: in expansion of macro ‘BEGIN_PARAM_MAP’ BEGIN_PARAM_MAP(params, mode) ^ crfsuite/lib/crf/src/crf1d_encode.c: In function ‘encoder_viterbi’: crfsuite/lib/crf/src/crf1d_encode.c:889:9: warning: unused variable ‘i’ [-Wunused-variable] int i; ^ crfsuite/lib/crf/src/crf1d_encode.c: At top level: crfsuite/lib/crf/src/crf1d_encode.c:920:12: warning: function declaration isn’t a prototype [-Wstrict-prototypes] encoder_t crf1d_create_encoder() ^ crfsuite/lib/crf/src/crf1d_encode.c: In function ‘encoder_save_model’: crfsuite/lib/crf/src/crf1d_encode.c:856:5: warning: ‘ret’ may be used uninitialized in this function [-Wmaybe-uninitialized] return crf1de_save_model(crf1de, filename, w, self->ds->data->attrs, self->ds->data->labels, lg); ^ x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/include/python2.7 -c crfsuite/lib/crf/src/quark.c -o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/quark.o In file included from crfsuite/lib/crf/src/quark.c:37:0: crfsuite/lib/crf/src/quark.h:39:1: warning: function declaration isn’t a prototype [-Wstrict-prototypes] quarkt quark_new(); ^ crfsuite/lib/crf/src/quark.c:72:10: warning: function declaration isn’t a prototype [-Wstrict-prototypes] quark_t\ quark_new() ^ x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/include/python2.7 -c crfsuite/lib/crf/src/crf1d_feature.c -o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/crf1d_feature.o In file included from crfsuite/lib/crf/src/crf1d.h:37:0, from crfsuite/lib/crf/src/crf1d_feature.c:47: crfsuite/lib/crf/src/crfsuite_internal.h:168:1: warning: function declaration isn’t a prototype [-Wstrict-prototypes] encoder_t _crf1d_create_encoder(); ^ crfsuite/lib/crf/src/crf1d_feature.c:77:22: warning: function declaration isn’t a prototype [-Wstrict-prototypes] static featuresett featureset_new() ^ x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/include/python2.7 -c crfsuite/swig/crfsuite.cpp -o build/temp.linux-x86_64-2.7/crfsuite/swig/crfsuite.o cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++ [enabled by default] x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/include/python2.7 -c crfsuite/lib/cqdb/src/cqdb.c -o build/temp.linux-x86_64-2.7/crfsuite/lib/cqdb/src/cqdb.o crfsuite/lib/cqdb/src/cqdb.c: In function ‘cqdb_to_id’: crfsuite/lib/cqdb/src/cqdb.c:551:26: warning: variable ‘ksize’ set but not used [-Wunused-but-set-variable] uint32_t ksize; ^ x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/include/python2.7 -c crfsuite/lib/cqdb/src/lookup3.c -o build/temp.linux-x86_64-2.7/crfsuite/lib/cqdb/src/lookup3.o x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/include/python2.7 -c liblbfgs/lib/lbfgs.c -o build/temp.linux-x86_64-2.7/liblbfgs/lib/lbfgs.o c++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/pycrfsuite/_pycrfsuite.o build/temp.linux-x86_64-2.7/pycrfsuite/trainer_wrapper.o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/holdout.o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/train_averaged_perceptron.o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/train_l2sgd.o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/logging.o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/crfsuite_train.o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/dataset.o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/params.o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/train_lbfgs.o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/train_arow.o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/crf1d_model.o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/crf1d_tag.o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/crfsuite.o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/dictionary.o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/rumavl.o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/train_passive_aggressive.o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/crf1d_context.o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/crf1d_encode.o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/quark.o build/temp.linux-x86_64-2.7/crfsuite/lib/crf/src/crf1d_feature.o build/temp.linux-x86_64-2.7/crfsuite/swig/crfsuite.o build/temp.linux-x86_64-2.7/crfsuite/lib/cqdb/src/cqdb.o build/temp.linux-x86_64-2.7/crfsuite/lib/cqdb/src/lookup3.o build/temp.linux-x86_64-2.7/liblbfgs/lib/lbfgs.o -o build/lib.linux-x86_64-2.7/pycrfsuite/_pycrfsuite.so

Found existing installation: lxml 3.3.3 Uninstalling lxml: Successfully uninstalled lxml Running setup.py install for lxml /usr/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'bugtrack_url' warnings.warn(msg) Building lxml version 3.4.1. Building without Cython. ERROR: /bin/sh: 1: xslt-config: not found

** make sure the development packages of libxml2 and libxslt are installed **

Using build configuration of libxslt
building 'lxml.etree' extension
x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -I/tmp/pip_build_root/lxml/src/lxml/includes -I/usr/include/python2.7 -c src/lxml/lxml.etree.c -o build/temp.linux-x86_64-2.7/src/lxml/lxml.etree.o -w
In file included from src/lxml/lxml.etree.c:239:0:
/tmp/pip_build_root/lxml/src/lxml/includes/etree_defs.h:14:31: fatal error: libxml/xmlversion.h: No such file or directory
 #include "libxml/xmlversion.h"
                               ^
compilation terminated.
error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
Complete output from command /usr/bin/python -c "import setuptools, tokenize;__file__='/tmp/pip_build_root/lxml/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-MHzJKR-record/install-record.txt --single-version-externally-managed --compile:
/usr/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'bugtrack_url'

warnings.warn(msg)

Building lxml version 3.4.1.

Building without Cython.

ERROR: /bin/sh: 1: xslt-config: not found

\ make sure the development packages of libxml2 and libxslt are installed **

Using build configuration of libxslt

running install

running build

running build_py

creating build

creating build/lib.linux-x86_64-2.7

creating build/lib.linux-x86_64-2.7/lxml

copying src/lxml/usedoctest.py -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/ElementInclude.py -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/pyclasslookup.py -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/_elementpath.py -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/cssselect.py -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/builder.py -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/init.py -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/doctestcompare.py -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/sax.py -> build/lib.linux-x86_64-2.7/lxml

creating build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/init.py -> build/lib.linux-x86_64-2.7/lxml/includes

creating build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/_diffcommand.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/usedoctest.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/_html5builder.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/ElementSoup.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/defs.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/_setmixin.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/diff.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/builder.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/init.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/formfill.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/clean.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/soupparser.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/html5parser.py -> build/lib.linux-x86_64-2.7/lxml/html

creating build/lib.linux-x86_64-2.7/lxml/isoschematron

copying src/lxml/isoschematron/init.py -> build/lib.linux-x86_64-2.7/lxml/isoschematron

copying src/lxml/lxml.etree.h -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/lxml.etree_api.h -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/includes/xpath.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/htmlparser.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/tree.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/c14n.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/dtdvalid.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/schematron.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/xmlschema.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/relaxng.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/uri.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/xmlparser.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/xslt.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/xinclude.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/etreepublic.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/config.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/xmlerror.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/etree_defs.h -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/lxml-version.h -> build/lib.linux-x86_64-2.7/lxml/includes

creating build/lib.linux-x86_64-2.7/lxml/isoschematron/resources

creating build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/rng

copying src/lxml/isoschematron/resources/rng/iso-schematron.rng -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/rng

creating build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl

copying src/lxml/isoschematron/resources/xsl/RNG2Schtrn.xsl -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl

copying src/lxml/isoschematron/resources/xsl/XSD2Schtrn.xsl -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl

creating build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl/iso-schematron-xslt1

copying src/lxml/isoschematron/resources/xsl/iso-schematron-xslt1/iso_svrl_for_xslt1.xsl -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl/iso-schematron-xslt1

copying src/lxml/isoschematron/resources/xsl/iso-schematron-xslt1/iso_schematron_skeleton_for_xslt1.xsl -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl/iso-schematron-xslt1

copying src/lxml/isoschematron/resources/xsl/iso-schematron-xslt1/iso_abstract_expand.xsl -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl/iso-schematron-xslt1

copying src/lxml/isoschematron/resources/xsl/iso-schematron-xslt1/iso_dsdl_include.xsl -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl/iso-schematron-xslt1

copying src/lxml/isoschematron/resources/xsl/iso-schematron-xslt1/iso_schematron_message.xsl -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl/iso-schematron-xslt1

copying src/lxml/isoschematron/resources/xsl/iso-schematron-xslt1/readme.txt -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl/iso-schematron-xslt1

running build_ext

building 'lxml.etree' extension

creating build/temp.linux-x86_64-2.7

creating build/temp.linux-x86_64-2.7/src

creating build/temp.linux-x86_64-2.7/src/lxml

x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -I/tmp/pip_build_root/lxml/src/lxml/includes -I/usr/include/python2.7 -c src/lxml/lxml.etree.c -o build/temp.linux-x86_64-2.7/src/lxml/lxml.etree.o -w

In file included from src/lxml/lxml.etree.c:239:0:

/tmp/pip_build_root/lxml/src/lxml/includes/etree_defs.h:14:31: fatal error: libxml/xmlversion.h: No such file or directory

include "libxml/xmlversion.h"

                           ^

compilation terminated.

error: command 'x86_64-linux-gnu-gcc' failed with exit status 1


Rolling back uninstall of lxml Cleaning up... Command /usr/bin/python -c "import setuptools, tokenize;file='/tmp/pip_build_root/lxml/setup.py';exec(compile(getattr(tokenize, 'open', open)(file).read().replace('\r\n', '\n'), file, 'exec'))" install --record /tmp/pip-MHzJKR-record/install-record.txt --single-version-externally-managed --compile failed with error code 1 in /tmp/pip_build_root/lxml Traceback (most recent call last): File "/usr/bin/pip", line 9, in load_entry_point('pip==1.5.4', 'console_scripts', 'pip')() File "/usr/lib/python2.7/dist-packages/pip/init.py", line 185, in main return command.main(cmd_args) File "/usr/lib/python2.7/dist-packages/pip/basecommand.py", line 161, in main text = '\n'.join(complete_log) UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 42: ordinal not in range(128) john@john-All-Series:~$

fgregg commented 9 years ago

Sorry about this. We have already fixed this on master. We'll push this to pypi tomorrow.

fgregg commented 9 years ago

@John-Nagle Try to install from pypi now.

John-Nagle commented 9 years ago

That works fine. All the C++ parts of lxml now compile properly, and usaddress can run:

>>> import usaddress
>>> usaddress.parse('123 Main St. Suite 100 Chicago, IL')
[('123', 'AddressNumber'), ('Main', 'StreetName'), ('St.', 'StreetNamePostType'), ('Suite', 'OccupancyType'), ('100', 'OccupancyIdentifier'), ('Chicago,', 'PlaceName'), ('IL', 'StateName')]

Thanks.

fgregg commented 9 years ago

Good.

But this is still a little confusing. libxml is only a dependency of parserator, and to simply install usaddress you don't need parserator. How are you installing?

John-Nagle commented 9 years ago
sudo pip install usaddress

which brings in parserator, which brings in LXML. See the long install log above.

Ubuntu 14.04 LTS

fgregg commented 9 years ago

Oh, you have an older version of usaddress locally, okay.