kpu / kenlm

KenLM: Faster and Smaller Language Model Queries
http://kheafield.com/code/kenlm/
Other
2.5k stars 513 forks source link

Errors when compiling KenLM with Anaconda #348

Open christina-tzogka opened 3 years ago

christina-tzogka commented 3 years ago

Hi all. I am trying to compile KenLM using an anaconda environment but compilation fails for target "bin/probing_hash_table_benchmark due to undefined reference to memcpy@GLIBC_2.14"error. I am trying to compile both git KenLM and the KenLM from the official documentation. When I run cmake .. and make -j 4 commands a get the following outputs, respectively:

CMake Warning at /usr/local/lib/cmake/boost_program_options-1.72.0/libboost_program_options-variant-x64-shared.cmake:64 (message):
  Target Boost::program_options already has an imported location
  '/usr/local/lib/libboost_program_options-mt-x64.so.1.72.0', which will be
  overwritten with '/usr/local/lib/libboost_program_options-x64.so.1.72.0'
Call Stack (most recent call first):
  /usr/local/lib/cmake/boost_program_options-1.72.0/boost_program_options-config.cmake:57 (include)
  /usr/local/lib/cmake/Boost-1.72.0/BoostConfig.cmake:120 (find_package)
  /usr/local/lib/cmake/Boost-1.72.0/BoostConfig.cmake:185 (boost_find_component)
  /usr/local/share/cmake-3.10/Modules/FindBoost.cmake:242 (find_package)
  CMakeLists.txt:85 (find_package)

CMake Warning at /usr/local/lib/cmake/boost_system-1.72.0/libboost_system-variant-x64-shared.cmake:64 (message):
  Target Boost::system already has an imported location
  '/usr/local/lib/libboost_system-mt-x64.so.1.72.0', which will be
  overwritten with '/usr/local/lib/libboost_system-x64.so.1.72.0'
Call Stack (most recent call first):
  /usr/local/lib/cmake/boost_system-1.72.0/boost_system-config.cmake:57 (include)
  /usr/local/lib/cmake/Boost-1.72.0/BoostConfig.cmake:120 (find_package)
  /usr/local/lib/cmake/Boost-1.72.0/BoostConfig.cmake:185 (boost_find_component)
  /usr/local/share/cmake-3.10/Modules/FindBoost.cmake:242 (find_package)
  CMakeLists.txt:85 (find_package)

CMake Warning at /usr/local/lib/cmake/boost_unit_test_framework-1.72.0/libboost_unit_test_framework-variant-x64-shared.cmake:64 (message):
  Target Boost::unit_test_framework already has an imported location
  '/usr/local/lib/libboost_unit_test_framework-mt-x64.so.1.72.0', which will
  be overwritten with
  '/usr/local/lib/libboost_unit_test_framework-x64.so.1.72.0'
Call Stack (most recent call first):
  /usr/local/lib/cmake/boost_unit_test_framework-1.72.0/boost_unit_test_framework-config.cmake:57 (include)
  /usr/local/lib/cmake/Boost-1.72.0/BoostConfig.cmake:120 (find_package)
  /usr/local/lib/cmake/Boost-1.72.0/BoostConfig.cmake:185 (boost_find_component)
  /usr/local/share/cmake-3.10/Modules/FindBoost.cmake:242 (find_package)
  CMakeLists.txt:85 (find_package)

-- Boost 1.41.0 found.
-- Found Boost components:
   program_options;system;thread;unit_test_framework
-- Configuring done
-- Generating done
-- Build files have been written to: /home/christina/Downloads/kenlm/build
 32%] Built target kenlm_util
[ 33%] Linking CXX executable ../bin/probing_hash_table_benchmark
[ 37%] Built target kenlm_filter
[ 58%] Built target kenlm
[ 60%] Built target fragment
[ 62%] Built target query
[ 64%] Built target build_binary
/home/christina/anaconda3/bin/../lib/gcc/x86_64-conda_cos6-linux-gnu/7.3.0/../../../../x86_64-conda_cos6-linux-gnu/bin/ld: /usr/local/lib/libboost_thread-mt-x64.so.1.72.0: undefined reference to `memcpy@GLIBC_2.14'
collect2: error: ld returned 1 exit status
util/CMakeFiles/probing_hash_table_benchmark.dir/build.make:102: recipe for target 'bin/probing_hash_table_benchmark' failed
make[2]: *** [bin/probing_hash_table_benchmark] Error 1
CMakeFiles/Makefile2:129: recipe for target 'util/CMakeFiles/probing_hash_table_benchmark.dir/all' failed
make[1]: *** [util/CMakeFiles/probing_hash_table_benchmark.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs....
[ 65%] Linking CXX executable ../../bin/filter
[ 66%] Linking CXX executable ../bin/kenlm_benchmark
[ 73%] Built target kenlm_builder
/home/christina/anaconda3/bin/../lib/gcc/x86_64-conda_cos6-linux-gnu/7.3.0/../../../../x86_64-conda_cos6-linux-gnu/bin/ld: /usr/local/lib/libboost_thread-mt-x64.so.1.72.0: undefined reference to `memcpy@GLIBC_2.14'
collect2: error: ld returned 1 exit status
lm/filter/CMakeFiles/filter.dir/build.make:104: recipe for target 'bin/filter' failed
make[2]: *** [bin/filter] Error 1
CMakeFiles/Makefile2:608: recipe for target 'lm/filter/CMakeFiles/filter.dir/all' failed
make[1]: *** [lm/filter/CMakeFiles/filter.dir/all] Error 2
/home/christina/anaconda3/bin/../lib/gcc/x86_64-conda_cos6-linux-gnu/7.3.0/../../../../x86_64-conda_cos6-linux-gnu/bin/ld: /usr/local/lib/libboost_program_options-x64.so.1.72.0: undefined reference to `memcpy@GLIBC_2.14'
collect2: error: ld returned 1 exit status
lm/CMakeFiles/kenlm_benchmark.dir/build.make:103: recipe for target 'bin/kenlm_benchmark' failed
make[2]: *** [bin/kenlm_benchmark] Error 1
CMakeFiles/Makefile2:391: recipe for target 'lm/CMakeFiles/kenlm_benchmark.dir/all' failed
make[1]: *** [lm/CMakeFiles/kenlm_benchmark.dir/all] Error 2
Makefile:129: recipe for target 'all' failed
make: *** [all] Error 2

My anaconda install is as follows:

# packages in environment at /home/christina/anaconda3:
#
# Name                    Version                   Build  Channel
_ipyw_jlab_nb_ext_conf    0.1.0                    py36_0  
_libgcc_mutex             0.1                 conda_forge    conda-forge
_openmp_mutex             4.5                       0_gnu    conda-forge
absl-py                   0.9.0                    py36_0    conda-forge
aiohttp                   3.6.2                    pypi_0    pypi
alabaster                 0.7.12                     py_0    conda-forge
anaconda-client           1.7.2                    py36_0  
anaconda-navigator        1.8.4                    py36_0  
anaconda-project          0.8.3                      py_0    conda-forge
antlr4-python3-runtime    4.8                      pypi_0    pypi
appdirs                   1.4.4                    pypi_0    pypi
asn1crypto                0.24.0                   py36_0  
astor                     0.7.1                      py_0    conda-forge
astroid                   2.2.5                    py36_0  
astropy                   3.1.2            py37h7b6447c_0  
astunparse                1.6.3                    pypi_0    pypi
async-timeout             3.0.1                    pypi_0    pypi
atomicwrites              1.3.0                      py_0    conda-forge
attrs                     19.1.0                     py_0    conda-forge
babel                     2.6.0                      py_1    conda-forge
backcall                  0.1.0                      py_0    conda-forge
backports                 1.0                        py_2    conda-forge
backports.functools_lru_cache 1.5                        py_1    conda-forge
backports.os              0.1.1                    py36_0  
backports.shutil_get_terminal_size 1.0.0                      py_3    conda-forge
backports_abc             0.5                        py_1    conda-forge
beautifulsoup4            4.7.1                    py36_1  
bing-image-downloader     1.0.4                    pypi_0    pypi
binutils_impl_linux-64    2.33.1               he1b5a44_7    conda-forge
binutils_linux-64         2.33.1              h9595d00_16    conda-forge
bitarray                  0.9.0            py36h7b6447c_0  
bkcharts                  0.2                      py37_0  
black                     19.10b0                  pypi_0    pypi
blas                      1.0                         mkl  
bleach                    3.1.0                      py_0    conda-forge
blosc                     1.15.0               hd408876_0  
bokeh                     1.0.4                    py37_0  
boto                      2.49.0                     py_0    conda-forge
boto3                     1.17.110                 pypi_0    pypi
botocore                  1.20.110                 pypi_0    pypi
bottleneck                1.2.1            py37h035aef0_1  
braceexpand               0.1.7                    pypi_0    pypi
bzip2                     1.0.6                h14c3975_5  
c-ares                    1.15.0            h516909a_1001    conda-forge
ca-certificates           2020.4.5.1           hecc5488_0    conda-forge
cachetools                4.1.1                    pypi_0    pypi
cairo                     1.12.18                       6    https://repo.anaconda.com/pkgs/free
certifi                   2020.4.5.1       py36h9f0ad1d_0    conda-forge
cffi                      1.12.3           py36h2e261b9_0  
chardet                   3.0.4                    py36_1  
click                     7.0                        py_0    conda-forge
cloudpickle               0.8.1                      py_0    conda-forge
clyent                    1.2.2                      py_1    conda-forge
colorama                  0.4.4                    pypi_0    pypi
conda                     4.8.3            py36h9f0ad1d_1    conda-forge
conda-build               3.17.8                   py36_0  
conda-env                 2.6.0                         1  
conda-package-handling    1.6.0            py36h8c4c3a4_2    conda-forge
conda-verify              3.1.1                    py36_0  
configparser              5.0.2                    pypi_0    pypi
contextlib2               0.5.5                      py_2    conda-forge
cryptography              2.3.1            py36hc365091_0  
cudatoolkit               10.1.243             h6bb024c_0  
cudnn                     7.6.5                cuda10.1_0  
curl                      7.61.0               h84994c4_0  
cycler                    0.10.0                     py_1    conda-forge
cython                    0.29.7           py36he6710b0_0  
cytoolz                   0.9.0.1          py36h14c3975_1  
dask                      1.1.4                    py37_1  
dask-core                 1.2.1                      py_0    conda-forge
dataclasses               0.7                      pypi_0    pypi
dbus                      1.13.6               h746ee38_0  
declxml                   1.1.3                    pypi_0    pypi
decorator                 4.4.0                      py_0    conda-forge
defusedxml                0.5.0                      py_1    conda-forge
distance                  0.1.3                    pypi_0    pypi
distributed               1.27.1                   py36_0  
dlib                      19.21.0                  pypi_0    pypi
docker-pycreds            0.4.0                    pypi_0    pypi
docutils                  0.14                     py36_0  
editdistance              0.5.3                    pypi_0    pypi
entrypoints               0.3                      py36_0  
et_xmlfile                1.0.1            py36hd6bccc3_0  
expat                     2.2.6                he6710b0_0  
fastcache                 1.0.2            py36h14c3975_2  
filelock                  3.0.10                     py_0    conda-forge
flask                     1.0.2                      py_2    conda-forge
fontconfig                2.11.1                        6    https://repo.anaconda.com/pkgs/free
freetype                  2.5.5                         2    https://repo.anaconda.com/pkgs/free
fribidi                   1.0.5                h7b6447c_0  
frozendict                2.0.3                    pypi_0    pypi
fsspec                    2021.6.1                 pypi_0    pypi
funcsigs                  1.0.2                      py_3    conda-forge
future                    0.17.1                   py36_0  
g2p-en                    2.1.0                    pypi_0    pypi
gast                      0.3.3                    pypi_0    pypi
gcc_impl_linux-64         7.3.0                hd420e75_4    conda-forge
gcc_linux-64              7.3.0               h553295d_16    conda-forge
gdown                     3.13.0                   pypi_0    pypi
geos                      3.8.1                he1b5a44_0    conda-forge
get_terminal_size         1.0.0                haa9412d_0  
gevent                    1.4.0            py36h7b6447c_0  
gitdb                     4.0.7                    pypi_0    pypi
gitpython                 3.1.18                   pypi_0    pypi
glib                      2.56.2               hd408876_0  
glob2                     0.6                        py_0    conda-forge
gmp                       6.1.2                h6c8ec71_1  
gmpy2                     2.0.8            py36h10f8cd9_2  
google-auth               1.22.0                   pypi_0    pypi
google-auth-oauthlib      0.4.1                    pypi_0    pypi
google-pasta              0.2.0                    pypi_0    pypi
googledrivedownloader     0.3                      pypi_0    pypi
graphite2                 1.3.13               h23475e2_0  
greenlet                  0.4.15           py36h7b6447c_0  
grpcio                    1.38.1                   pypi_0    pypi
gst-plugins-base          1.14.0               hbbd80ab_1  
gstreamer                 1.14.0               hb453b48_1  
gxx_impl_linux-64         7.3.0                hdf63c60_4    conda-forge
gxx_linux-64              7.3.0               h553295d_16    conda-forge
h5py                      2.10.0          nompi_py36h513d04c_101    conda-forge
harfbuzz                  0.9.39                        1    https://repo.anaconda.com/pkgs/free
hdf5                      1.10.5          nompi_h3c11f04_1104    conda-forge
heapdict                  1.0.0                    py36_2  
html5lib                  1.0.1                      py_0    conda-forge
huggingface-hub           0.0.12                   pypi_0    pypi
hydra-core                1.1.0                    pypi_0    pypi
icu                       54.1                          0    https://repo.anaconda.com/pkgs/free
idna                      2.8                      py36_0  
idna-ssl                  1.1.0                    pypi_0    pypi
imageio                   2.9.0                    pypi_0    pypi
imageio-ffmpeg            0.4.2                    pypi_0    pypi
imagesize                 1.1.0                      py_0    conda-forge
importlib-resources       5.2.0                    pypi_0    pypi
importlib_metadata        0.9                      py36_0  
imutils                   0.5.3                    pypi_0    pypi
inflect                   5.3.0                    pypi_0    pypi
intel-openmp              2019.3                      199  
ipykernel                 5.1.0            py36h39e3cac_0  
ipython                   7.5.0            py36h39e3cac_0  
ipython_genutils          0.2.0                      py_1    conda-forge
ipywidgets                7.4.2                      py_0    conda-forge
isort                     4.3.17                   py36_0  
itsdangerous              1.1.0                      py_0    conda-forge
jbig                      2.1                  hdba287a_0  
jdcal                     1.4.1                      py_0    conda-forge
jedi                      0.13.3                   py36_0  
jeepney                   0.4                      py36_0  
jieba                     0.42.1                   pypi_0    pypi
jinja2                    2.10.1                     py_0    conda-forge
jmespath                  0.10.0                   pypi_0    pypi
joblib                    0.11                     pypi_0    pypi
jpeg                      9c                h14c3975_1001    conda-forge
jsonschema                3.0.1                    py36_0  
jupyter                   1.0.0                      py_2    conda-forge
jupyter_client            5.2.4                      py_3    conda-forge
jupyter_console           6.0.0                    py36_0  
jupyter_core              4.4.0                      py_0    conda-forge
jupyterlab                0.35.5           py36hf63ae98_0  
jupyterlab_launcher       0.11.2                     py_0    conda-forge
jupyterlab_server         0.2.0                    py36_0  
kaldi-io                  0.9.4                    pypi_0    pypi
kaldi-python-io           1.2.2                    pypi_0    pypi
kaldiio                   2.17.2                   pypi_0    pypi
kenlm                     0.0.0                    pypi_0    pypi
keras                     2.3.1                    py36_0    conda-forge
keras-applications        1.0.8                      py_1    conda-forge
keras-preprocessing       1.1.2                    pypi_0    pypi
keyring                   18.0.0                   py36_0  
kiwisolver                1.1.0            py36he6710b0_0  
krb5                      1.14.2               h56d4222_4  
latexcodec                2.0.1                    pypi_0    pypi
lazy-object-proxy         1.3.1            py36h14c3975_2  
ld_impl_linux-64          2.33.1               h53a641e_7    conda-forge
libarchive                3.3.2                hbf4e9fd_1  
libcurl                   7.61.0               h1ad7b7a_0  
libedit                   3.1.20181209         hc058e9b_0  
libffi                    3.2.1                hd88cf55_4  
libgcc                    7.2.0                h69d50b8_2  
libgcc-ng                 9.2.0                h24d8f2e_2    conda-forge
libgfortran-ng            7.3.0                hdf63c60_0  
libgomp                   9.2.0                h24d8f2e_2    conda-forge
libgpuarray               0.7.6             h14c3975_1003    conda-forge
libiconv                  1.15                 h63c8f33_5  
liblief                   0.9.0                h7725739_2  
libpng                    1.6.36               hbc83047_0  
libprotobuf               3.11.2               h8b12597_0    conda-forge
libsodium                 1.0.16               h1bed415_0  
libssh2                   1.8.0                h9cfc8f7_4  
libstdcxx-ng              8.2.0                hdf63c60_1  
libtiff                   4.0.9             h648cc4a_1002    conda-forge
libtool                   2.4.6                h7b6447c_5  
libuuid                   1.0.3                h1bed415_2  
libxcb                    1.13                 h1bed415_1  
libxml2                   2.9.4                         0    https://repo.anaconda.com/pkgs/free
libxslt                   1.1.29                        0    https://repo.anaconda.com/pkgs/free
llvmlite                  0.28.0           py36hd408876_0  
locket                    0.2.0                      py_2    conda-forge
lxml                      4.1.1            py36h4d89739_0  
lz4-c                     1.8.1.2              h14c3975_0  
lzo                       2.10                 h49e0be7_2  
mako                      1.1.0                      py_0    conda-forge
markdown                  3.1.1                      py_0    conda-forge
markupsafe                1.1.1            py36h516909a_0    conda-forge
marshmallow               3.12.2                   pypi_0    pypi
matplotlib                3.3.4                    pypi_0    pypi
mccabe                    0.6.1                      py_1    conda-forge
megatron-lm               2.2.0                    pypi_0    pypi
mistune                   0.8.4            py36h7b6447c_0  
mkl                       2019.3                      199  
mkl-service               1.1.2            py36he904b0f_5  
mkl_fft                   1.0.13           py36h516909a_1    conda-forge
mkl_random                1.0.4            py36hf2d7682_0    conda-forge
more-itertools            7.0.0                    py36_0  
moviepy                   1.0.3                    pypi_0    pypi
mpc                       1.1.0                h10f8cd9_1  
mpfr                      4.0.1                hdf1c602_3  
mpi4py                    3.0.1                    pypi_0    pypi
mpmath                    1.1.0                      py_0    conda-forge
msgpack-python            0.6.1            py36hfd86e86_1  
mss                       3.3.1                    pypi_0    pypi
multidict                 4.7.6                    pypi_0    pypi
multipledispatch          0.6.0                      py_0    conda-forge
navigator-updater         0.2.0                    py36_0  
nbconvert                 5.5.0                      py_0    conda-forge
nbformat                  4.4.0                      py_1    conda-forge
ncurses                   5.9                          10    conda-forge
networkx                  2.2                        py_1    conda-forge
ninja                     1.10.0               hc9558a2_0    conda-forge
nltk                      3.2.5                    pypi_0    pypi
nose                      1.3.7                    py36_2  
notebook                  5.7.8                    py36_0  
numba                     0.43.1           py37h962f231_0  
numexpr                   2.6.9            py37h9e4a6bb_0  
numpy                     1.15.4                   pypi_0    pypi
numpy-base                1.16.4           py36hde5b4d6_0  
numpydoc                  0.9.1                      py_0    conda-forge
oauthlib                  3.1.0                    pypi_0    pypi
olefile                   0.46                       py_0    conda-forge
omegaconf                 2.1.0                    pypi_0    pypi
onnx                      1.9.0                    pypi_0    pypi
opencc                    1.1.2                    pypi_0    pypi
opencv-contrib-python     4.1.2.30                 pypi_0    pypi
opencv-python             4.4.0.44                 pypi_0    pypi
openpyxl                  2.6.1                      py_0    conda-forge
openssl                   1.0.2u               h516909a_0    conda-forge
opt-einsum                3.3.0                    pypi_0    pypi
packaging                 19.0                       py_0    conda-forge
pandas                    0.23.0                   pypi_0    pypi
pandoc                    2.2.3.2                       0  
pandocfilters             1.4.2                      py_1    conda-forge
pango                     1.39.0                        0    https://repo.anaconda.com/pkgs/free
pangu                     4.0.6.1                  pypi_0    pypi
parameterized             0.8.1                    pypi_0    pypi
parso                     0.4.0                      py_0    conda-forge
partd                     0.3.9                      py_0    conda-forge
patchelf                  0.9                  he6710b0_3  
path.py                   11.5.2                     py_0    conda-forge
pathlib2                  2.3.3                    py36_0  
pathspec                  0.8.1                    pypi_0    pypi
pathtools                 0.1.2                    pypi_0    pypi
pcre                      8.43                 he6710b0_0  
pep8                      1.7.1                      py_0    conda-forge
pexpect                   4.7.0                    py36_0  
pickleshare               0.7.5                    py36_0  
pillow                    4.2.1                    py36_0    https://repo.anaconda.com/pkgs/free
pip                       20.2.3                   pypi_0    pypi
pipenv                    2018.11.26               pypi_0    pypi
pixman                    0.32.6                        0    https://repo.anaconda.com/pkgs/free
pkginfo                   1.5.0.1                    py_0    conda-forge
pluggy                    0.9.0                      py_0    conda-forge
ply                       3.11                       py_1    conda-forge
proglog                   0.1.9                    pypi_0    pypi
prometheus_client         0.6.0                      py_0    conda-forge
promise                   2.3                      pypi_0    pypi
prompt_toolkit            2.0.9                      py_0    conda-forge
protobuf                  3.13.0                   pypi_0    pypi
psutil                    5.6.2            py36h7b6447c_0  
ptyprocess                0.6.0                   py_1001    conda-forge
py                        1.8.0                      py_0    conda-forge
py-lief                   0.9.0            py36h7725739_2  
pyamg                     4.1.0                    pypi_0    pypi
pyannote-core             4.1                      pypi_0    pypi
pyannote-database         4.1                      pypi_0    pypi
pyannote-metrics          3.0.1                    pypi_0    pypi
pyasn1                    0.4.8                    pypi_0    pypi
pyasn1-modules            0.2.8                    pypi_0    pypi
pybind11                  2.6.2                    pypi_0    pypi
pybtex                    0.24.0                   pypi_0    pypi
pybtex-docutils           1.0.0                    pypi_0    pypi
pycodestyle               2.5.0                      py_0    conda-forge
pycosat                   0.6.3            py36h14c3975_0  
pycparser                 2.19                     py36_0  
pycrypto                  2.6.1            py36h14c3975_9  
pycurl                    7.43.0.2         py36hb7f436b_0  
pydeprecate               0.3.0                    pypi_0    pypi
pydot                     1.4.1                    pypi_0    pypi
pydub                     0.25.1                   pypi_0    pypi
pyflakes                  2.1.1                      py_0    conda-forge
pygments                  2.3.1                      py_0    conda-forge
pygpu                     0.7.6           py36hc1659b7_1000    conda-forge
pylint                    2.3.1                    py36_0  
pyodbc                    4.0.26           py36he6710b0_0  
pyopenssl                 19.0.0                   py36_0  
pyparsing                 2.4.0                      py_0    conda-forge
pypinyin                  0.42.0                   pypi_0    pypi
pyqt                      4.11.4                   py36_3    conda-forge
pyqt5                     5.15.1                   pypi_0    pypi
pyqt5-sip                 12.8.1                   pypi_0    pypi
pyrsistent                0.14.11          py36h7b6447c_0  
pysocks                   1.6.8                    py36_0  
pystoi                    0.3.3                    pypi_0    pypi
pytables                  3.5.1            py37h71ec239_0  
pytesseract               0.3.1                    pypi_0    pypi
pytest                    4.4.1                    py36_0  
pytest-arraydiff          0.3              py37h39e3cac_0  
pytest-astropy            0.5.0                    py37_0  
pytest-doctestplus        0.3.0                    py37_0  
pytest-openfiles          0.3.1                      py_0    conda-forge
pytest-remotedata         0.3.1                      py_0    conda-forge
pytest-runner             5.3.1                    pypi_0    pypi
python                    3.6.0                         2    conda-forge
python-dateutil           2.8.0                      py_0    conda-forge
python-libarchive-c       2.8                      py36_6  
python-speech-features    0.6                      pypi_0    pypi
python-xlib               0.28                     pypi_0    pypi
python_abi                3.6                     1_cp36m    conda-forge
pytorch                   1.5.0           py3.6_cuda10.1.243_cudnn7.6.3_0    pytorch
pytorch-lightning         1.3.7.post0              pypi_0    pypi
pytube3                   9.6.4                    pypi_0    pypi
pytz                      2019.1                     py_0    conda-forge
pywavelets                1.1.1                    pypi_0    pypi
pyyaml                    5.3              py36h516909a_0    conda-forge
pyzmq                     18.0.0           py36he6710b0_0  
qt                        4.8.7                         4    https://repo.anaconda.com/pkgs/free
qtawesome                 0.5.7              pyh8a2030e_0    conda-forge
qtconsole                 4.4.3                      py_0    conda-forge
qtpy                      1.7.1              pyhde82777_0    conda-forge
rapidfuzz                 1.4.1                    pypi_0    pypi
readline                  6.2                           2    https://repo.anaconda.com/pkgs/free
regex                     2021.7.6                 pypi_0    pypi
requests                  2.21.0                   py36_0  
requests-oauthlib         1.3.0                    pypi_0    pypi
rope                      0.14.0                     py_0    conda-forge
rsa                       4.6                      pypi_0    pypi
ruamel_yaml               0.15.80         py36h8c4c3a4_1001    conda-forge
s3transfer                0.4.2                    pypi_0    pypi
sacrebleu                 1.3.2                    pypi_0    pypi
sacremoses                0.0.45                   pypi_0    pypi
scandir                   1.5                      py36_0    https://repo.anaconda.com/pkgs/free
scikit-image              0.17.2                   pypi_0    pypi
scipy                     1.2.1            py36h7c811a0_0  
scp                       0.13.2                   pypi_0    pypi
secretstorage             3.1.1                    py36_0  
send2trash                1.5.0                      py_0    conda-forge
sentencepiece             0.1.82                   pypi_0    pypi
sentry-sdk                1.3.0                    pypi_0    pypi
setuptools                45.0.0                   py36_0    conda-forge
shapely                   1.7.0            py36h3d6ee9d_3    conda-forge
shellingham               1.4.0                    pypi_0    pypi
shortuuid                 1.0.1                    pypi_0    pypi
simplegeneric             0.8.1                      py_1    conda-forge
simplejson                3.17.3                   pypi_0    pypi
singledispatch            3.4.0.3                  py36_0  
sip                       4.18                     py36_1    conda-forge
six                       1.13.0                   py36_0    conda-forge
smmap                     4.0.0                    pypi_0    pypi
snap                      0.5                      pypi_0    pypi
snappy                    1.1.7                hbae5bb6_3  
snowballstemmer           1.2.1                      py_1    conda-forge
sortedcollections         1.1.2                      py_0    conda-forge
sortedcontainers          2.1.0                      py_0    conda-forge
soupsieve                 1.8                      py36_0  
sphinx                    2.0.1                      py_0  
sphinxcontrib             1.0                      py36_1  
sphinxcontrib-applehelp   1.0.1                      py_0  
sphinxcontrib-bibtex      2.3.0                    pypi_0    pypi
sphinxcontrib-devhelp     1.0.1                      py_0  
sphinxcontrib-htmlhelp    1.0.2                      py_0  
sphinxcontrib-jsmath      1.0.1                      py_0  
sphinxcontrib-qthelp      1.0.2                      py_0  
sphinxcontrib-serializinghtml 1.1.3                      py_0  
sphinxcontrib-websupport  1.1.0                      py_1    conda-forge
spyder                    3.3.0                    py36_0    conda-forge
spyder-kernels            0.4.4                    py36_0  
sqlalchemy                1.3.3            py36h7b6447c_0  
sqlite                    3.13.0                        0    https://repo.anaconda.com/pkgs/free
subprocess32              3.5.4                    pypi_0    pypi
sympy                     1.4                      py36_0  
tabulate                  0.8.9                    pypi_0    pypi
tblib                     1.3.2                      py_1    conda-forge
tensorboard               2.4.1                    pypi_0    pypi
tensorboard-plugin-wit    1.7.0                    pypi_0    pypi
tensorflow                1.10.0                   py36_0    conda-forge
tensorflow-estimator      1.13.0                   pypi_0    pypi
tensorflow-gpu            1.13.1                   pypi_0    pypi
termcolor                 1.1.0                      py_2    conda-forge
terminado                 0.8.2                    py36_0  
testpath                  0.4.2                   py_1001    conda-forge
theano                    1.0.4           py36hf484d3e_1000    conda-forge
tifffile                  2020.8.25                pypi_0    pypi
tk                        8.5.18                        0    https://repo.anaconda.com/pkgs/free
tokenizers                0.10.3                   pypi_0    pypi
toml                      0.10.2                   pypi_0    pypi
toolz                     0.9.0                      py_1    conda-forge
torch                     1.1.0a0+a0e5240          pypi_0    pypi
torch-stft                0.1.4                    pypi_0    pypi
torchmetrics              0.3.2                    pypi_0    pypi
torchvision               0.6.0                py36_cu101    pytorch
tornado                   6.0.2            py36h7b6447c_0  
tqdm                      4.61.2                   pypi_0    pypi
traitlets                 4.3.2            py36h674d592_0  
transformers              4.8.2                    pypi_0    pypi
typed-ast                 1.4.3                    pypi_0    pypi
typer                     0.3.2                    pypi_0    pypi
typing                    3.6.4                    py36_0  
typing-extensions         3.7.4.3                  pypi_0    pypi
unicodecsv                0.14.1                     py_1    conda-forge
unixodbc                  2.3.7                h14c3975_0  
urllib3                   1.24.2                   py36_0  
virtualenv                16.7.5                   pypi_0    pypi
virtualenv-clone          0.5.3                    pypi_0    pypi
wandb                     0.10.33                  pypi_0    pypi
warpctc-pytorch           0.1                      pypi_0    pypi
wcwidth                   0.1.7                      py_1    conda-forge
webdataset                0.1.62                   pypi_0    pypi
webencodings              0.5.1                      py_1    conda-forge
werkzeug                  0.16.0                     py_0    conda-forge
wget                      3.2                      pypi_0    pypi
wheel                     0.33.6                   py36_0    conda-forge
widgetsnbextension        3.4.2                    py36_0  
wrapt                     1.11.1           py36h7b6447c_0  
wurlitzer                 1.0.2                    py36_0  
xlrd                      1.2.0                      py_0    conda-forge
xlsxwriter                1.1.8                      py_0    conda-forge
xlwt                      1.3.0                      py_1    conda-forge
xz                        5.2.4             h14c3975_1001    conda-forge
yaml                      0.2.2                h516909a_1    conda-forge
yarl                      1.6.0                    pypi_0    pypi
youtokentome              1.0.6                    pypi_0    pypi
zeromq                    4.3.1                he6710b0_3  
zict                      0.1.4                      py_0    conda-forge
zipp                      3.5.0                    pypi_0    pypi
zlib                      1.2.11            h516909a_1006    conda-forge
zstd                      1.3.7                h0b5b093_0  

Originally posted by @christina-tzogka in https://github.com/kpu/kenlm/issues/218#issuecomment-880671775