Add a generic and useful library to the official Jupyter image

masamallow commented 1 month ago

Description

Even with the official Jupyter scipy-based image (jupyter/scipy-notebook), there seems to be a lack of a generic and useful library for analyzing data.
Consider the following...
- Libraries included in the Google Colaboratory (Colab) environment ( pip list )
- VS CodeでJupyterLabのノートブック拡張子を編集するための準備
  
  Preparing to edit JupyterLab notebook extensions in VS Code

Prerequisites

―

Completion Criteria

Tasks

―

References

―

masamallow commented 1 month ago

jupyter/scipy-notebook: pip list

```shell pip list ``` Package name only ``` Babel Bottleneck Brotli Cython GitPython Jinja2 Mako MarkupSafe PyJWT PySocks PyWavelets PyYAML Pygments SQLAlchemy Send2Trash alembic altair annotated-types anyio archspec argon2-cffi argon2-cffi-bindings arrow asttokens async-lru async_generator attrs beautifulsoup4 bleach blinker bokeh boltons cached-property certifi certipy cffi charset-normalizer click cloudpickle colorama comm conda conda-libmamba-solver conda-package-handling conda_package_streaming contourpy cryptography cycler cytoolz dask dask-expr debugpy decorator defusedxml dill distributed distro entrypoints et-xmlfile exceptiongroup executing fastjsonschema fonttools fqdn frozendict fsspec gitdb gmpy2 greenlet h11 h2 h5py hpack httpcore httpx hyperframe idna imagecodecs imageio importlib_metadata importlib_resources ipykernel ipympl ipython ipython_genutils ipywidgets isoduration jedi joblib json5 jsonpatch jsonpointer jsonschema jsonschema-specifications jupyter-events jupyter-lsp jupyter-server-mathjax jupyter_client jupyter_core jupyter_server jupyter_server_terminals jupyterhub jupyterlab jupyterlab_git jupyterlab_pygments jupyterlab_server jupyterlab_widgets kiwisolver lazy_loader libmambapy llvmlite locket lz4 mamba matplotlib matplotlib-fontja matplotlib-inline menuinst mistune mpmath msgpack munkres nbclassic nbclient nbconvert nbdime nbformat nest_asyncio networkx notebook notebook_shim numba numexpr numpy oauthlib openpyxl overrides packaging pamela pandas pandocfilters parso partd patsy pexpect pickleshare pillow pip pkgutil_resolve_name platformdirs pluggy prometheus_client prompt_toolkit protobuf psutil ptyprocess pure_eval py-cpuinfo pyOpenSSL pyarrow pyarrow-hotfix pycosat pycparser pycurl pydantic pydantic_core pyparsing python-dateutil python-json-logger pytz pyzmq referencing requests rfc3339-validator rfc3986-validator rpds-py ruamel.yaml ruamel.yaml.clib scikit-image scikit-learn scipy seaborn setuptools six smmap sniffio sortedcontainers soupsieve stack-data statsmodels sympy tables tblib terminado threadpoolctl tifffile tinycss2 tomli toolz tornado tqdm traitlets truststore types-python-dateutil typing-utils typing_extensions tzdata uri-template urllib3 wcwidth webcolors webencodings websocket-client wheel widgetsnbextension xlrd xyzservices zict zipp zstandard ```

masamallow commented 1 month ago

jupyter/scipy-notebook: conda list

```shell conda list ``` packages in environment at /opt/conda: ``` _openmp_mutex alembic altair annotated-types anyio aom archspec argon2-cffi argon2-cffi-bindings arrow asttokens async-lru async_generator attrs aws-c-auth aws-c-cal aws-c-common aws-c-compression aws-c-event-stream aws-c-http aws-c-io aws-c-mqtt aws-c-s3 aws-c-sdkutils aws-checksums aws-crt-cpp aws-sdk-cpp azure-core-cpp azure-identity-cpp azure-storage-blobs-cpp azure-storage-common-cpp azure-storage-files-datalake-cpp babel beautifulsoup4 blas blas-devel bleach blinker blosc bokeh boltons bottleneck brotli brotli-bin brotli-python brunsli bzip2 c-ares c-blosc2 ca-certificates cached-property cached_property certifi certipy cffi charls charset-normalizer click cloudpickle colorama comm conda conda-libmamba-solver conda-package-handling conda-package-streaming configurable-http-proxy contourpy cryptography cycler cython cytoolz dask dask-core dask-expr dav1d debugpy decorator defusedxml dill distributed distro entrypoints et_xmlfile exceptiongroup executing fmt fonttools fqdn freetype frozendict fsspec gflags giflib gitdb gitpython glog gmp gmpy2 greenlet h11 h2 h5py hdf5 hpack httpcore httpx hyperframe icu idna imagecodecs imageio importlib-metadata importlib_metadata importlib_resources ipykernel ipympl ipython ipython_genutils ipywidgets isoduration jedi jinja2 joblib json5 jsonpatch jsonpointer jsonschema jsonschema-specifications jsonschema-with-format-nongpl jupyter-lsp jupyter-server-mathjax jupyter_client jupyter_core jupyter_events jupyter_server jupyter_server_terminals jupyterhub jupyterhub-base jupyterlab jupyterlab-git jupyterlab_pygments jupyterlab_server jupyterlab_widgets jxrlib keyutils kiwisolver krb5 lazy_loader lcms2 ld_impl_linux-aarch64 lerc libabseil libaec libarchive libarrow libarrow-acero libarrow-dataset libarrow-substrait libavif16 libblas libbrotlicommon libbrotlidec libbrotlienc libcblas libcrc32c libcurl libdeflate libedit libev libevent libexpat libffi libgcc-ng libgfortran-ng libgfortran5 libgomp libgoogle-cloud libgoogle-cloud-storage libgrpc libhwy libiconv libjpeg-turbo libjxl liblapack liblapacke libllvm14 libmamba libmambapy libnghttp2 libnsl libopenblas libparquet libpng libprotobuf libre2-11 libsodium libsolv libsqlite libssh2 libstdcxx-ng libthrift libtiff libutf8proc libuuid libuv libwebp-base libxcb libxcrypt libxml2 libzlib libzopfli llvm-openmp llvmlite locket lz4 lz4-c lzo mako mamba markupsafe matplotlib-base matplotlib-fontja matplotlib-inline menuinst mistune mpc mpfr mpmath msgpack-python munkres nbclassic nbclient nbconvert-core nbdime nbformat ncurses nest-asyncio networkx nodejs notebook notebook-shim numba numexpr numpy oauthlib openblas openjpeg openpyxl openssl orc overrides packaging pamela pandas pandocfilters parso partd patsy pexpect pickleshare pillow pip pkgutil-resolve-name platformdirs pluggy prometheus_client prompt-toolkit protobuf psutil pthread-stubs ptyprocess pure_eval py-cpuinfo pyarrow pyarrow-core pyarrow-hotfix pybind11-abi pycosat pycparser pycurl pydantic pydantic-core pygments pyjwt pyopenssl pyparsing pysocks pytables python python-dateutil python-fastjsonschema python-json-logger python-tzdata python_abi pytz pywavelets pyyaml pyzmq qhull rav1e re2 readline referencing reproc reproc-cpp requests rfc3339-validator rfc3986-validator rpds-py ruamel.yaml ruamel.yaml.clib s2n scikit-image scikit-learn scipy seaborn seaborn-base send2trash setuptools six smmap snappy sniffio sortedcontainers soupsieve sqlalchemy stack_data statsmodels svt-av1 sympy tblib terminado threadpoolctl tifffile tinycss2 tk tomli toolz tornado tqdm traitlets truststore types-python-dateutil typing-extensions typing_extensions typing_utils tzdata uri-template urllib3 wcwidth webcolors webencodings websocket-client wheel widgetsnbextension xlrd xorg-libxau xorg-libxdmcp xyzservices xz yaml yaml-cpp zeromq zfp zict zipp zlib zlib-ng zstandard ```

masamallow commented 1 month ago

Colab: pip list

``` Babel CacheControl Cython Flask GDAL Jinja2 Markdown MarkupSafe Pillow PyDrive PyDrive2 PyGObject PyJWT PyOpenGL PySocks PyYAML Pygments SQLAlchemy SecretStorage Send2Trash Sphinx StrEnum Werkzeug absl-py accelerate aiohttp aiosignal alabaster albucore albumentations altair annotated-types anyio argon2-cffi argon2-cffi-bindings array_record arviz asn1crypto astropy astropy-iers-data astunparse async-timeout atpublic attrs audioread autograd backcall beautifulsoup4 bidict bigframes bleach blinker blis blosc2 bokeh bqplot branca build cachetools catalogue certifi cffi chardet charset-normalizer chex clarabel click click-plugins cligj cloudpathlib cloudpickle cmake cmdstanpy colorcet colorlover colour community confection cons contextlib2 contourpy cryptography cuda-python cudf-cu12 cufflinks cupy-cuda12x cvxopt cvxpy cycler cymem dask datascience db-dtypes dbus-python debugpy decorator defusedxml distributed distro dlib dm-tree docstring_parser docutils dopamine_rl duckdb earthengine-api easydict ecos editdistance eerepr en-core-web-sm entrypoints et-xmlfile etils etuples eval_type_backport exceptiongroup fastai fastcore fastdownload fastjsonschema fastprogress fastrlock filelock fiona firebase-admin flatbuffers flax folium fonttools frozendict frozenlist fsspec future gast gcsfs gdown geemap gensim geocoder geographiclib geopandas geopy gin-config glob2 google google-ai-generativelanguage google-api-core google-api-python-client google-auth google-auth-httplib2 google-auth-oauthlib google-cloud-aiplatform google-cloud-bigquery google-cloud-bigquery-connection google-cloud-bigquery-storage google-cloud-bigtable google-cloud-core google-cloud-datastore google-cloud-firestore google-cloud-functions google-cloud-iam google-cloud-language google-cloud-pubsub google-cloud-resource-manager google-cloud-storage google-cloud-translate google-colab google-crc32c google-generativeai google-pasta google-resumable-media googleapis-common-protos googledrivedownloader graphviz greenlet grpc-google-iam-v1 grpcio grpcio-status gspread gspread-dataframe gym gym-notices h5netcdf h5py holidays holoviews html5lib httpimport httplib2 huggingface-hub humanize hyperopt ibis-framework idna imageio imageio-ffmpeg imagesize imbalanced-learn imgaug immutabledict importlib_metadata importlib_resources imutils inflect iniconfig intel-cmplr-lib-ur intel-openmp ipyevents ipyfilechooser ipykernel ipyleaflet ipyparallel ipython ipython-genutils ipython-sql ipytree ipywidgets itsdangerous jax jaxlib jeepney jellyfish jieba joblib jsonpickle jsonschema jsonschema-specifications jupyter-client jupyter-console jupyter-server jupyter_core jupyterlab_pygments jupyterlab_widgets kaggle kagglehub keras keyring kiwisolver langcodes language_data launchpadlib lazr.restfulclient lazr.uri lazy_loader libclang librosa lightgbm linkify-it-py llvmlite locket logical-unification lxml malloy marisa-trie markdown-it-py matplotlib matplotlib-inline matplotlib-venn mdit-py-plugins mdurl miniKanren missingno mistune mizani mkl ml-dtypes mlxtend more-itertools moviepy mpmath msgpack multidict multipledispatch multitasking murmurhash music21 namex natsort nbclassic nbclient nbconvert nbformat nest-asyncio networkx nibabel nltk notebook notebook_shim numba numexpr numpy nvtx oauth2client oauthlib opencv-contrib-python opencv-python opencv-python-headless openpyxl opt-einsum optax optree orbax-checkpoint osqp packaging pandas pandas-datareader pandas-gbq pandas-stubs pandocfilters panel param parso parsy partd pathlib patsy peewee pexpect pickleshare pip pip-tools platformdirs plotly plotnine pluggy polars pooch portpicker prefetch_generator preshed prettytable proglog progressbar2 prometheus_client promise prompt_toolkit prophet proto-plus protobuf psutil psycopg2 ptyprocess py-cpuinfo py4j pyOpenSSL pyarrow pyarrow-hotfix pyasn1 pyasn1_modules pycocotools pycparser pydantic pydantic_core pydata-google-auth pydot pydot-ng pydotplus pyerfa pygame pymc pymystem3 pynvjitlink-cu12 pyparsing pyperclip pyproj pyproject_hooks pyshp pytensor pytest python-apt python-box python-dateutil python-louvain python-slugify python-utils pytz pyviz_comms pyzmq qdldl ratelim referencing regex requests requests-oauthlib requirements-parser rich rmm-cu12 rpds-py rpy2 rsa safetensors scikit-image scikit-learn scipy scooby scs seaborn sentencepiece setuptools shapely shellingham simple_parsing six sklearn-pandas smart-open sniffio snowballstemmer snowflake-connector-python sortedcontainers soundfile soupsieve soxr spacy spacy-legacy spacy-loggers sphinxcontrib-applehelp sphinxcontrib-devhelp sphinxcontrib-htmlhelp sphinxcontrib-jsmath sphinxcontrib-qthelp sphinxcontrib-serializinghtml sqlglot sqlparse srsly stanio statsmodels sympy tables tabulate tbb tblib tenacity tensorboard tensorboard-data-server tensorflow tensorflow-datasets tensorflow-hub tensorflow-io-gcs-filesystem tensorflow-metadata tensorflow-probability tensorstore termcolor terminado text-unidecode textblob tf-slim tf_keras thinc threadpoolctl tifffile tinycss2 tokenizers toml tomli tomlkit toolz torch torchaudio torchsummary torchtext torchvision tornado tqdm traitlets traittypes transformers triton tweepy typeguard typer types-pytz types-setuptools typing_extensions tzdata tzlocal uc-micro-py uritemplate urllib3 vega-datasets wadllib wasabi wcwidth weasel webcolors webencodings websocket-client wheel widgetsnbextension wordcloud wrapt xarray xarray-einstats xgboost xlrd xyzservices yarl yellowbrick yfinance zict zipp ```

masamallow commented 1 month ago

Packages included in Colab: pip list but not in either jupyter/scipy-notebook: pip list or jupyter/scipy-notebook: conda list

CacheControl
Flask
GDAL
Markdown
Pillow
PyDrive
PyDrive2
PyGObject
PyOpenGL
SecretStorage
Sphinx
StrEnum
Werkzeug
absl-py
accelerate
aiohttp
aiosignal
alabaster
albucore
albumentations
array_record
arviz
asn1crypto
astropy
astropy-iers-data
astunparse
async-timeout
atpublic
audioread
autograd
backcall
bidict
bigframes
blis
blosc2
bqplot
branca
build
cachetools
catalogue
chardet
chex
clarabel
click-plugins
cligj
cloudpathlib
cmake
cmdstanpy
colorcet
colorlover
colour
community
confection
cons
contextlib2
cuda-python
cudf-cu12
cufflinks
cupy-cuda12x
cvxopt
cvxpy
cymem
datascience
db-dtypes
dbus-python
dlib
dm-tree
docstring_parser
docutils
dopamine_rl
duckdb
earthengine-api
easydict
ecos
editdistance
eerepr
en-core-web-sm
etils
etuples
eval_type_backport
fastai
fastcore
fastdownload
fastprogress
fastrlock
filelock
fiona
firebase-admin
flatbuffers
flax
folium
frozenlist
future
gast
gcsfs
gdown
geemap
gensim
geocoder
geographiclib
geopandas
geopy
gin-config
glob2
google
google-ai-generativelanguage
google-api-core
google-api-python-client
google-auth
google-auth-httplib2
google-auth-oauthlib
google-cloud-aiplatform
google-cloud-bigquery
google-cloud-bigquery-connection
google-cloud-bigquery-storage
google-cloud-bigtable
google-cloud-core
google-cloud-datastore
google-cloud-firestore
google-cloud-functions
google-cloud-iam
google-cloud-language
google-cloud-pubsub
google-cloud-resource-manager
google-cloud-storage
google-cloud-translate
google-colab
google-crc32c
google-generativeai
google-pasta
google-resumable-media
googleapis-common-protos
googledrivedownloader
graphviz
grpc-google-iam-v1
grpcio
grpcio-status
gspread
gspread-dataframe
gym
gym-notices
h5netcdf
holidays
holoviews
html5lib
httpimport
httplib2
huggingface-hub
humanize
hyperopt
ibis-framework
imageio-ffmpeg
imagesize
imbalanced-learn
imgaug
immutabledict
imutils
inflect
iniconfig
intel-cmplr-lib-ur
intel-openmp
ipyevents
ipyfilechooser
ipyleaflet
ipyparallel
ipython-genutils
ipython-sql
ipytree
itsdangerous
jax
jaxlib
jeepney
jellyfish
jieba
jsonpickle
jupyter-client
jupyter-console
jupyter-server
kaggle
kagglehub
keras
keyring
langcodes
language_data
launchpadlib
lazr.restfulclient
lazr.uri
libclang
librosa
lightgbm
linkify-it-py
logical-unification
lxml
malloy
marisa-trie
markdown-it-py
matplotlib-venn
mdit-py-plugins
mdurl
miniKanren
missingno
mizani
mkl
ml-dtypes
mlxtend
more-itertools
moviepy
multidict
multipledispatch
multitasking
murmurhash
music21
namex
natsort
nibabel
nltk
nvtx
oauth2client
opencv-contrib-python
opencv-python
opencv-python-headless
opt-einsum
optax
optree
orbax-checkpoint
osqp
pandas-datareader
pandas-gbq
pandas-stubs
panel
param
parsy
pathlib
peewee
pip-tools
plotly
plotnine
polars
pooch
portpicker
prefetch_generator
preshed
prettytable
proglog
progressbar2
promise
prophet
proto-plus
psycopg2
py4j
pyasn1
pyasn1_modules
pycocotools
pydata-google-auth
pydot
pydot-ng
pydotplus
pyerfa
pygame
pymc
pymystem3
pynvjitlink-cu12
pyperclip
pyproj
pyproject_hooks
pyshp
pytensor
pytest
python-apt
python-box
python-louvain
python-slugify
python-utils
pyviz_comms
qdldl
ratelim
regex
requests-oauthlib
requirements-parser
rich
rmm-cu12
rpy2
rsa
safetensors
scooby
scs
sentencepiece
shapely
shellingham
simple_parsing
sklearn-pandas
smart-open
snowballstemmer
snowflake-connector-python
soundfile
soxr
spacy
spacy-legacy
spacy-loggers
sphinxcontrib-applehelp
sphinxcontrib-devhelp
sphinxcontrib-htmlhelp
sphinxcontrib-jsmath
sphinxcontrib-qthelp
sphinxcontrib-serializinghtml
sqlglot
sqlparse
srsly
stanio
tabulate
tbb
tenacity
tensorboard
tensorboard-data-server
tensorflow
tensorflow-datasets
tensorflow-hub
tensorflow-io-gcs-filesystem
tensorflow-metadata
tensorflow-probability
tensorstore
termcolor
text-unidecode
textblob
tf-slim
tf_keras
thinc
tokenizers
toml
tomlkit
torch
torchaudio
torchsummary
torchtext
torchvision
traittypes
transformers
triton
tweepy
typeguard
typer
types-pytz
types-setuptools
tzlocal
uc-micro-py
uritemplate
vega-datasets
wadllib
wasabi
weasel
wordcloud
wrapt
xarray
xarray-einstats
xgboost
yarl
yellowbrick
yfinance

masamallow / jupyterlab-my-local