sotetsuk / docker-py3-machine-learning

Docker image for reproducible machine learning in Python3

MIT License

3 stars 1 forks source link

ImageHash 3.1 altair 1.2.0 tqdm 4.10.0 mlxtend 0.5.1.dev0 TPOT 0.6.7 traitlets 4.3.1 funcy 1.7.2 pandas-profiling 1.3.0 recommonmark 0.4.0 plotly 1.12.11 nbsphinx 0.2.11 tflearn 0.2.2 pyLDAvis 2.1.0 Delorean 0.6.0 PyWavelets 0.5.1 pymc3 3.0rc4 vega 0.4.4 SexMachine 0.1.1 Geohash 1.0 pymongo 3.4.0 hyperopt 0.1 sacred 0.6.10 mpld3 0.3 CommonMark 0.5.4 bayesian-optimization 0.3.0 pystan 2.12.0.0 gpxpy 1.1.2 matplotlib-venn 0.11.4 haversine 0.4.5 fitter 1.0.8 dora 0.1 update-checker 0.15 vida 0.3 s2sphere 0.2.4 missingno 0.3.2 humanize 0.5.1 heamy 0.0.6 arrow 0.10.0 langid 1.1.6 trueskill 0.4.4 deap 1.0.2 numpydoc 0.6.0 mplleaflet 0.0.5 tzlocal 1.3 urwid 1.3.1 datashader 0.4.0 xarray 0.8.2 docopt 0.6.2 thriftpy 0.3.9 line-profiler 2.0 conda 4.2.13 psycopg2 2.6.2 basemap 1.0.8 smhasher 0.150.1 orderedmultidict 0.7.11 h2o 3.10.1.1 future 0.16.0 pyproj 1.9.5.1 impyla 0.14.0 pudb 2016.2 hdfs 2.0.13 scikit-learn 0.19.dev0 packaging 16.8 biopython 1.68 ibis-framework 0.9.0 wordcloud 1.2.1 textblob 0.11.1 stop-words 2015.2.23.1 hep-ml 0.4.0 chainer 1.18.0 Theano 0.9.0.dev4 python-igraph 0.7.1.post6 pytagcloud 0.3.5 gensim 0.13.3 protobuf 3.1.0 bz2file 0.98 ml-metrics 0.1.4 ggplot 0.11.5 mne 0.13.1 vowpalwabbit 8.2.1 husl 4.0.3 smart-open 1.3.5 seaborn 0.7.1 pyshp 1.2.10 brewer2mpl 1.4.1 joblib 0.10.3 tensorflow 0.12.0rc0 geopy 1.11.0 jupyter-client 4.4.0 QtPy 1.1.2 anaconda-navigator 1.3.1 boto 2.42.0 anaconda-clean 1.0 xlwt 1.1.2 jupyter-core 4.2.0 simplegeneric 0.8.1 pyflakes 1.3.0 llvmlite 0.13.0 nb-anacondacloud 1.2.0 decorator 4.0.10 conda-build 2.0.2 fastcache 1.0.2 scikit-image 0.12.3 rope-py3k 0.9.4.post1 terminado 0.6 mistune 0.7.3 patsy 0.4.1 partd 0.3.6 pyparsing 2.1.4 pyzmq 15.4.0 ipython-genutils 0.1.0 configobj 5.0.6 matplotlib 1.5.3 datashape 0.5.2 widgetsnbextension 1.2.6 Flask 0.11.1 jdcal 1.2 Werkzeug 0.11.11 locket 0.2.0 spyder 3.0.0 nbpresent 3.0.2 argcomplete 1.0.0 wheel 0.29.0 XlsxWriter 0.9.3 numpy 1.11.1 chest 0.2.3 nb-conda-kernels 2.0.0 py 1.4.31 colorama 0.3.7 backports.shutil-get-terminal-size 1.0.0 pexpect 4.0.1 Bottleneck 1.1.0 path.py 0.0.0 beautifulsoup4 4.5.1 wrapt 1.10.6 anaconda-client 1.5.1 itsdangerous 0.24 pycurl 7.43.0 numba 0.28.1 cloudpickle 0.2.1 singledispatch 3.4.0.3 nose 1.3.7 h5py 2.6.0 Pygments 2.1.3 pycosat 0.6.1 ipython 5.1.0 statsmodels 0.6.1 unicodecsv 0.14.1 dynd 0.7.3.dev1 dill 0.2.5 pylint 1.5.4 jupyter 1.0.0 networkx 1.11 xlrd 1.0.0 openpyxl 2.3.2 pathlib2 2.1.0 idna 2.1 nbformat 4.1.0 contextlib2 0.5.3 psutil 4.3.1 nltk 3.2.1 six 1.10.0 pip 8.1.2 lxml 3.6.4 SQLAlchemy 1.0.13 Cython 0.24.1 nbconvert 4.2.0 wcwidth 0.1.7 jupyter-console 5.0.0 click 6.6 tornado 4.4.1 MarkupSafe 0.23 docutils 0.12 odo 0.5.0 pycrypto 2.6.1 imagesize 0.7.1 lazy-object-proxy 1.2.1 pandas 0.18.1 pkginfo 1.3.2 requests 2.11.1 sockjs-tornado 1.0.3 Flask-Cors 2.1.2 toolz 0.8.0 qtconsole 4.2.1 pyasn1 0.1.9 Pillow 3.3.1 ipykernel 4.5.0 nb-conda 2.0.0 filelock 2.0.6 pytz 2016.6.1 blaze 0.10.1 pyOpenSSL 16.0.0 cryptography 1.5 pycparser 2.14 astropy 1.2.1 multipledispatch 0.4.8 QtAwesome 0.3.3 scipy 0.18.1 sympy 1.0 pep8 1.7.0 gevent 1.1.2 HeapDict 1.0.0 clyent 1.2.2 pytest 2.9.2 notebook 4.2.3 ruamel-yaml -VERSION mpmath 0.19 bitarray 0.8.1 redis 2.10.5 ipywidgets 5.2.2 pickleshare 0.7.4 bokeh 0.12.2 tables 3.2.3.1 numexpr 2.6.1 cytoolz 0.8.0 Jinja2 2.8 snowballstemmer 1.2.1 jedi 0.9.0 PyYAML 3.12 alabaster 0.7.9 Babel 2.3.4 ptyprocess 0.5.1 et-xmlfile 1.0.1 astroid 1.4.7 cffi 1.7.0 cycler 0.10.0 greenlet 0.4.10 python-dateutil 2.5.3 ply 3.9 jsonschema 2.5.1 prompt-toolkit 1.0.3 dask 0.11.0 Sphinx 1.4.6 xgboost 0.6 Lasagne 0.2.dev1 Keras 1.1.2 keras-rl 0.2.0rc1 nolearn 0.6.1.dev0 tabulate 0.7.7 gdbn 0.1 gnumpy 0.2 PyBrain 0.3.3 tsne 0+untagged.1.g92497f4 python-Levenshtein 0.12.0 setuptools 27.2.0 Shapely 1.6.dev0 Cartopy 0.14.0 mxnet 0.7.0 rgf-sklearn 0.0.1 imbalanced-learn 0.2.0.dev0 Boruta 0.1.1

now

old.txt

protobuf 3.1.0.post1 chainer 1.18.0 pip 9.0.1 odo 0.5.0 pyOpenSSL 16.0.0 chest 0.2.3 toolz 0.8.0 conda-build 2.0.2 decorator 4.0.10 spyder 3.0.0 PyYAML 3.12 tornado 4.4.1 cryptography 1.5 terminado 0.6 fastcache 1.0.2 Pillow 3.3.1 path.py 0.0.0 et-xmlfile 1.0.1 pyasn1 0.1.9 networkx 1.11 anaconda-navigator 1.3.1 Babel 2.3.4 jupyter-console 5.0.0 pycosat 0.6.1 Flask-Cors 2.1.2 scikit-learn 0.17.1 pyparsing 2.1.4 pycrypto 2.6.1 dask 0.11.0 multipledispatch 0.4.8 statsmodels 0.6.1 Cython 0.24.1 wheel 0.29.0 argcomplete 1.0.0 contextlib2 0.5.3 py 1.4.31 cloudpickle 0.2.1 pathlib2 2.1.0 clyent 1.2.2 ipython-genutils 0.1.0 ipykernel 4.5.0 ply 3.9 notebook 4.2.3 snowballstemmer 1.2.1 scikit-image 0.12.3 nbconvert 4.2.0 jdcal 1.2 lazy-object-proxy 1.2.1 blaze 0.10.1 jupyter 1.0.0 patsy 0.4.1 anaconda-clean 1.0 docutils 0.12 scipy 0.18.1 unicodecsv 0.14.1 qtconsole 4.2.1 matplotlib 1.5.3 python-dateutil 2.5.3 singledispatch 3.4.0.3 ipywidgets 5.2.2 configobj 5.0.6 pickleshare 0.7.4 pycparser 2.14 pytz 2016.6.1 ptyprocess 0.5.1 six 1.10.0 pexpect 4.0.1 xlwt 1.1.2 traitlets 4.3.0 numpy 1.11.1 idna 2.1 pep8 1.7.0 pyflakes 1.3.0 Werkzeug 0.11.11 nltk 3.2.1 cffi 1.7.0 Pygments 2.1.3 itsdangerous 0.24 tables 3.2.3.1 mpmath 0.19 openpyxl 2.3.2 QtAwesome 0.3.3 widgetsnbextension 1.2.6 pycurl 7.43.0 nbpresent 3.0.2 imagesize 0.7.1 cytoolz 0.8.0 bitarray 0.8.1 astropy 1.2.1 cycler 0.10.0 jsonschema 2.5.1 nb-conda 2.0.0 xlrd 1.0.0 datashape 0.5.2 jupyter-core 4.2.0 MarkupSafe 0.23 lxml 3.6.4 jupyter-client 4.4.0 backports.shutil-get-terminal-size 1.0.0 bokeh 0.12.2 wcwidth 0.1.7 partd 0.3.6 numba 0.28.1 pandas 0.18.1 nb-conda-kernels 2.0.0 Bottleneck 1.1.0 dill 0.2.5 Jinja2 2.8 conda 4.2.9 gevent 1.1.2 greenlet 0.4.10 jedi 0.9.0 requests 2.11.1 anaconda-client 1.5.1 XlsxWriter 0.9.3 pylint 1.5.4 pkginfo 1.3.2 dynd 0.7.3.dev1 psutil 4.3.1 sympy 1.0 beautifulsoup4 4.5.1 astroid 1.4.7 filelock 2.0.6 llvmlite 0.13.0 pyzmq 15.4.0 rope-py3k 0.9.4.post1 click 6.6 locket 0.2.0 ipython 5.1.0 nbformat 4.1.0 wrapt 1.10.6 Flask 0.11.1 mistune 0.7.3 simplegeneric 0.8.1 colorama 0.3.7 prompt-toolkit 1.0.3 nose 1.3.7 SQLAlchemy 1.0.13 ruamel-yaml -VERSION sockjs-tornado 1.0.3 numexpr 2.6.1 boto 2.42.0 h5py 2.6.0 QtPy 1.1.2 nb-anacondacloud 1.2.0 alabaster 0.7.9 redis 2.10.5 pytest 2.9.2 HeapDict 1.0.0 Sphinx 1.4.6 setuptools 27.2.0

Check the diff

import codecs

old_packages = 'old.txt'
new_packages = 'new.txt'

old_packages_dict = {line.split()[0]:line.split()[1] for line in codecs.open(old_packages, 'r', 'utf-8')}
new_packages_dict = {line.split()[0]:line.split()[1] for line in codecs.open(new_packages, 'r', 'utf-8')}

old_packages_set = set(old_packages_dict.keys())
new_packages_set = set(new_packages_dict.keys())

print("="*100)
print("Old packages")
print("="*100)
for pkg, version in old_packages_dict.items():
    print("{}=={}".format(pkg, version))

print("="*100)
print("New packages")
print("="*100)
brand_new_packages = new_packages_set.difference(old_packages_set)
for pkg in brand_new_packages:
    print("{}=={}".format(pkg, new_packages_dict[pkg]))

print("="*100)
print("Different version packages ")
print("="*100)
for key in new_packages_set.intersection(old_packages_set):
    old_version = old_packages_dict[key]
    new_version = new_packages_dict[key]

    if new_version != old_version:
        print(key, new_version, old_version)

Results

b01d6a5fdf52:python3 -u /opt/project/show_diff.py
====================================================================================================
Old packages
====================================================================================================
pathlib2==2.1.0
protobuf==3.1.0.post1
backports.shutil-get-terminal-size==1.0.0
Flask-Cors==2.1.2
Flask==0.11.1
widgetsnbextension==1.2.6
Jinja2==2.8
nose==1.3.7
mpmath==0.19
chainer==1.18.0
ipython==5.1.0
decorator==4.0.10
numpy==1.11.1
multipledispatch==0.4.8
beautifulsoup4==4.5.1
nb-anacondacloud==1.2.0
rope-py3k==0.9.4.post1
wheel==0.29.0
singledispatch==3.4.0.3
scipy==0.18.1
matplotlib==1.5.3
bitarray==0.8.1
lxml==3.6.4
cycler==0.10.0
py==1.4.31
jedi==0.9.0
Babel==2.3.4
conda==4.2.9
QtPy==1.1.2
toolz==0.8.0
blaze==0.10.1
PyYAML==3.12
dill==0.2.5
QtAwesome==0.3.3
cryptography==1.5
pycosat==0.6.1
tables==3.2.3.1
jupyter-console==5.0.0
pylint==1.5.4
terminado==0.6
nltk==3.2.1
pexpect==4.0.1
pycurl==7.43.0
pyparsing==2.1.4
lazy-object-proxy==1.2.1
contextlib2==0.5.3
pyflakes==1.3.0
XlsxWriter==0.9.3
jsonschema==2.5.1
xlrd==1.0.0
pkginfo==1.3.2
mistune==0.7.3
cffi==1.7.0
click==6.6
simplegeneric==0.8.1
chest==0.2.3
itsdangerous==0.24
prompt-toolkit==1.0.3
sockjs-tornado==1.0.3
nbpresent==3.0.2
nb-conda-kernels==2.0.0
ipykernel==4.5.0
jupyter-client==4.4.0
openpyxl==2.3.2
pytz==2016.6.1
scikit-image==0.12.3
partd==0.3.6
numba==0.28.1
Sphinx==1.4.6
tornado==4.4.1
gevent==1.1.2
conda-build==2.0.2
Bottleneck==1.1.0
ruamel-yaml==-VERSION
HeapDict==1.0.0
locket==0.2.0
colorama==0.3.7
dask==0.11.0
configobj==5.0.6
numexpr==2.6.1
patsy==0.4.1
spyder==3.0.0
astropy==1.2.1
jupyter-core==4.2.0
pyasn1==0.1.9
ptyprocess==0.5.1
qtconsole==4.2.1
snowballstemmer==1.2.1
llvmlite==0.13.0
networkx==1.11
et-xmlfile==1.0.1
cytoolz==0.8.0
setuptools==27.2.0
python-dateutil==2.5.3
imagesize==0.7.1
Pillow==3.3.1
SQLAlchemy==1.0.13
anaconda-clean==1.0
idna==2.1
ipywidgets==5.2.2
pycparser==2.14
Cython==0.24.1
astroid==1.4.7
wcwidth==0.1.7
anaconda-client==1.5.1
traitlets==4.3.0
bokeh==0.12.2
wrapt==1.10.6
scikit-learn==0.17.1
alabaster==0.7.9
notebook==4.2.3
pycrypto==2.6.1
odo==0.5.0
ipython-genutils==0.1.0
nb-conda==2.0.0
docutils==0.12
MarkupSafe==0.23
greenlet==0.4.10
pickleshare==0.7.4
pep8==1.7.0
jupyter==1.0.0
h5py==2.6.0
redis==2.10.5
psutil==4.3.1
pytest==2.9.2
datashape==0.5.2
dynd==0.7.3.dev1
statsmodels==0.6.1
Pygments==2.1.3
fastcache==1.0.2
anaconda-navigator==1.3.1
path.py==0.0.0
xlwt==1.1.2
requests==2.11.1
sympy==1.0
unicodecsv==0.14.1
nbconvert==4.2.0
six==1.10.0
cloudpickle==0.2.1
filelock==2.0.6
pyzmq==15.4.0
pandas==0.18.1
clyent==1.2.2
ply==3.9
argcomplete==1.0.0
Werkzeug==0.11.11
pip==9.0.1
nbformat==4.1.0
jdcal==1.2
pyOpenSSL==16.0.0
boto==2.42.0
====================================================================================================
New packages
====================================================================================================
datashader==0.4.0
missingno==0.3.2
pymc3==3.0rc4
pytagcloud==0.3.5
Cartopy==0.14.0
tsne==0+untagged.1.g92497f4
tabulate==0.7.7
pymongo==3.4.0
orderedmultidict==0.7.11
matplotlib-venn==0.11.4
textblob==0.11.1
packaging==16.8
nbsphinx==0.2.11
s2sphere==0.2.4
PyWavelets==0.5.1
PyBrain==0.3.3
mpld3==0.3
hyperopt==0.1
psycopg2==2.6.2
pyshp==1.2.10
bayesian-optimization==0.3.0
brewer2mpl==1.4.1
vowpalwabbit==8.2.1
joblib==0.10.3
future==0.16.0
pandas-profiling==1.3.0
funcy==1.7.2
CommonMark==0.5.4
ImageHash==3.1
urwid==1.3.1
pyLDAvis==2.1.0
mlxtend==0.5.1.dev0
seaborn==0.7.1
Shapely==1.6.dev0
basemap==1.0.8
gdbn==0.1
vida==0.3
mne==0.13.1
vega==0.4.4
Theano==0.9.0.dev4
Keras==1.1.2
wordcloud==1.2.1
geopy==1.11.0
gensim==0.13.3
numpydoc==0.6.0
stop-words==2015.2.23.1
gnumpy==0.2
pyproj==1.9.5.1
python-igraph==0.7.1.post6
python-Levenshtein==0.12.0
Boruta==0.1.1
SexMachine==0.1.1
hdfs==2.0.13
ml-metrics==0.1.4
humanize==0.5.1
plotly==1.12.11
dora==0.1
haversine==0.4.5
tzlocal==1.3
TPOT==0.6.7
altair==1.2.0
keras-rl==0.2.0rc1
rgf-sklearn==0.0.1
thriftpy==0.3.9
Geohash==1.0
deap==1.0.2
heamy==0.0.6
sacred==0.6.10
mxnet==0.7.0
trueskill==0.4.4
line-profiler==2.0
update-checker==0.15
mplleaflet==0.0.5
smart-open==1.3.5
xarray==0.8.2
tflearn==0.2.2
fitter==1.0.8
tensorflow==0.12.0rc0
biopython==1.68
ggplot==0.11.5
Delorean==0.6.0
docopt==0.6.2
tqdm==4.10.0
pystan==2.12.0.0
hep-ml==0.4.0
smhasher==0.150.1
langid==1.1.6
Lasagne==0.2.dev1
impyla==0.14.0
recommonmark==0.4.0
pudb==2016.2
arrow==0.10.0
xgboost==0.6
h2o==3.10.1.1
ibis-framework==0.9.0
nolearn==0.6.1.dev0
gpxpy==1.1.2
husl==4.0.3
bz2file==0.98
imbalanced-learn==0.2.0.dev0
====================================================================================================
Different version packages 
====================================================================================================
conda 4.2.13 4.2.9
protobuf 3.1.0 3.1.0.post1
traitlets 4.3.1 4.3.0
scikit-learn 0.19.dev0 0.17.1
pip 8.1.2 9.0.1

Process finished with exit code 0

sotetsuk / docker-py3-machine-learning

Adding packages in Kaggle Kernel #4

now

Check the diff

Results