understanding-search / maze-transformer

This repo is built to facilitate the training and analysis of autoregressive transformers on maze-solving tasks.
24 stars 6 forks source link

Fix Pytest Warnings #111

Open rusheb opened 1 year ago

rusheb commented 1 year ago

A few warnings have crept into the test output.

We should resolve them and consider converting warnings into errors

Any warnings that we don't want to or cant resolve should be explicitly filtered out in the pytest section of pyproject.toml

luciaquirke commented 1 year ago

One warning appears to be coming from setuptools, keen to suppress it: https://github.com/AISC-understanding-search/maze-transformer/pull/120/files

Can't seem to replicate the other ones locally, even with pytest --cache-clear although I can see them in CI 🤔

Also let me know if you have any pointers for resolving these, they don't seem to include the callstacks that triggered them

rusheb commented 1 year ago

@luciaquirke just looked into this and I also had difficulty replicating the issues. I cloned a fresh copy of the repo and then they showed up:

g clone git@github.com:aisc-understanding-search/maze-transformer ./mt2
cd ./mt2
poetry install
make unit
rusheb commented 1 year ago

Oh, In my original copy I deleted the project .venv then re-ran poetry install and that made them show up too.

Maybe you could also do poetry install --sync and see if that gets them to show up

Output of `poetry show` in case it's useful ``` ❯ poetry show aiohttp 3.8.4 Async http client/server framework (asyncio) aiosignal 1.3.1 aiosignal: a list of registered asynchronous callbacks anyio 3.6.2 High level compatibility layer for multiple asynchronous event loop imp... appdirs 1.4.4 A small Python module for determining appropriate platform-specific dir... appnope 0.1.3 Disable App Nap on macOS >= 10.9 argon2-cffi 21.3.0 The secure Argon2 password hashing algorithm. argon2-cffi-bindings 21.2.0 Low-level CFFI bindings for Argon2 arrow 1.2.3 Better dates & times for Python asttokens 2.2.1 Annotate AST trees with source code positions async-timeout 4.0.2 Timeout context manager for asyncio programs attrs 22.2.0 Classes Without Boilerplate backcall 0.2.0 Specifications for callback functions passed in to an API beautifulsoup4 4.11.2 Screen-scraping library black 23.1.0 The uncompromising code formatter. bleach 6.0.0 An easy safelist-based HTML-sanitizing tool. certifi 2022.12.7 Python package for providing Mozilla's CA Bundle. cffi 1.15.1 Foreign Function Interface for Python calling C code. charset-normalizer 3.1.0 The Real First Universal Charset Detector. Open, modern and actively ma... circuitsvis 1.39.1 Mechanistic Interpretability Visualizations click 8.1.3 Composable command line interface toolkit comm 0.1.2 Jupyter Python Comm implementation, for usage in ipykernel, xeus-python... commonmark 0.9.1 Python parser for the CommonMark Markdown spec contourpy 1.0.7 Python library for calculating contours of 2D quadrilateral grids cycler 0.11.0 Composable style cycles datasets 2.10.1 HuggingFace community-driven open-source library of datasets debugpy 1.6.6 An implementation of the Debug Adapter Protocol for Python decorator 5.1.1 Decorators for Humans defusedxml 0.7.1 XML bomb protection for Python stdlib modules dill 0.3.6 serialize all of python docker-pycreds 0.4.0 Python bindings for the docker credentials store API einops 0.6.0 A new flavour of deep learning operations exceptiongroup 1.1.1 Backport of PEP 654 (exception groups) executing 1.2.0 Get the currently executing AST node of a frame, and other information fancy-einsum 0.0.3 Drop-in replacement for torch/numpy einsum, with descriptive variable n... fastjsonschema 2.16.3 Fastest Python implementation of JSON schema filelock 3.9.1 A platform independent file lock. fire 0.5.0 A library for automatically generating command line interfaces. fonttools 4.39.0 Tools to manipulate font files fqdn 1.5.1 Validates fully-qualified domain names against RFC 1123, so that they a... frozenlist 1.3.3 A list-like structure which implements collections.abc.MutableSequence fsspec 2023.3.0 File-system specification gitdb 4.0.10 Git Object Database gitpython 3.1.31 GitPython is a Python library used to interact with Git repositories huggingface-hub 0.13.2 Client library to download and publish models, datasets and other repos... idna 3.4 Internationalized Domain Names in Applications (IDNA) importlib-metadata 5.2.0 Read metadata from Python packages iniconfig 2.0.0 brain-dead simple config-ini parsing ipykernel 6.21.3 IPython Kernel for Jupyter ipython 8.11.0 IPython: Productive Interactive Computing ipython-genutils 0.2.0 Vestigial utilities from IPython ipywidgets 8.0.4 Jupyter interactive widgets isoduration 20.11.0 Operations with ISO 8601 durations isort 5.12.0 A Python utility / library to sort Python imports. jaxtyping 0.2.14 Type annotations and runtime checking for shape and dtype of JAX arrays... jedi 0.18.2 An autocompletion tool for Python that can be used for text editors. jinja2 3.1.2 A very fast and expressive template engine. jsonpointer 2.3 Identify specific nodes in a JSON document (RFC 6901) jsonschema 4.17.3 An implementation of JSON Schema validation for Python jupyter 1.0.0 Jupyter metapackage. Install all the Jupyter components in one go. jupyter-client 8.0.3 Jupyter protocol implementation and client libraries jupyter-console 6.6.3 Jupyter terminal console jupyter-core 5.2.0 Jupyter core package. A base package on which Jupyter projects rely. jupyter-events 0.6.3 Jupyter Event System library jupyter-server 2.4.0 The backend—i.e. core services, APIs, and REST endpoints—to Jupyter web... jupyter-server-terminals 0.4.4 A Jupyter Server Extension Providing Terminals. jupyterlab-pygments 0.2.2 Pygments theme using JupyterLab CSS variables jupyterlab-widgets 3.0.5 Jupyter interactive widgets for JupyterLab kiwisolver 1.4.4 A fast implementation of the Cassowary constraint solver libcst 0.4.9 A concrete syntax tree with AST-like properties for Python 3.5, 3.6, 3.... markupsafe 2.1.2 Safely add untrusted strings to HTML/XML markup. matplotlib 3.7.1 Python plotting package matplotlib-inline 0.1.6 Inline Matplotlib backend for Jupyter mistune 2.0.5 A sane Markdown parser with useful plugins and renderers multidict 6.0.4 multidict implementation multiprocess 0.70.14 better multiprocessing and multithreading in python muutils 0.2.2 A collection of miscellaneous python utilities mypy-extensions 1.0.0 Type system extensions for programs checked with the mypy type checker. nbclassic 0.5.3 Jupyter Notebook as a Jupyter Server extension. nbclient 0.7.2 A client library for executing notebooks. Formerly nbconvert's ExecuteP... nbconvert 7.2.10 Converting Jupyter Notebooks nbformat 5.7.3 The Jupyter Notebook format nest-asyncio 1.5.6 Patch asyncio to allow nested event loops notebook 6.5.3 A web-based notebook environment for interactive computing notebook-shim 0.2.2 A shim layer for notebook traits and config numpy 1.24.2 Fundamental package for array computing in Python packaging 23.0 Core utilities for Python packages pandas 1.5.3 Powerful data structures for data analysis, time series, and statistics pandocfilters 1.5.0 Utilities for writing pandoc filters in python parso 0.8.3 A Python Parser pathspec 0.10.3 Utility library for gitignore style pattern matching of file paths. pathtools 0.1.2 File system general utilities pexpect 4.8.0 Pexpect allows easy control of interactive console applications. pickleshare 0.7.5 Tiny 'shelve'-like database with concurrency support pillow 9.4.0 Python Imaging Library (Fork) platformdirs 3.1.1 A small Python package for determining appropriate platform-specific di... plotly 5.13.1 An open-source, interactive data visualization library for Python pluggy 1.0.0 plugin and hook calling mechanisms for python prometheus-client 0.16.0 Python client for the Prometheus monitoring system. prompt-toolkit 3.0.38 Library for building powerful interactive command lines in Python protobuf 4.22.1 psutil 5.9.4 Cross-platform lib for process and system monitoring in Python. ptyprocess 0.7.0 Run a subprocess in a pseudo terminal pure-eval 0.2.2 Safely evaluate AST nodes without side effects pyarrow 11.0.0 Python library for Apache Arrow pycln 2.1.3 A formatter for finding and removing unused import statements. pycparser 2.21 C parser in Python pygments 2.14.0 Pygments is a syntax highlighting package written in Python. pyparsing 3.0.9 pyparsing module - Classes and methods to define and execute parsing gr... pyrsistent 0.19.3 Persistent/Functional/Immutable data structures pytest 7.2.2 pytest: simple powerful testing with Python python-dateutil 2.8.2 Extensions to the standard Python datetime module python-json-logger 2.0.7 A python library adding a json log formatter pytz 2022.7.1 World timezone definitions, modern and historical pyyaml 6.0 YAML parser and emitter for Python pyzmq 25.0.1 Python bindings for 0MQ qtconsole 5.4.1 Jupyter Qt console qtpy 2.3.0 Provides an abstraction layer on top of the various Qt bindings (PyQt5/... regex 2022.10.31 Alternative regular expression module, to replace re. requests 2.28.2 Python HTTP for Humans. responses 0.18.0 A utility library for mocking out the `requests` Python library. rfc3339-validator 0.1.4 A pure python RFC3339 validator rfc3986-validator 0.1.1 Pure python rfc3986 validator rich 12.6.0 Render rich text, tables, progress bars, syntax highlighting, markdown ... send2trash 1.8.0 Send file to trash natively under Mac OS X, Windows and Linux. sentry-sdk 1.16.0 Python client for Sentry (https://sentry.io) setproctitle 1.3.2 A Python module to customize the process title setuptools 67.6.0 Easily download, build, install, upgrade, and uninstall Python packages six 1.16.0 Python 2 and 3 compatibility utilities smmap 5.0.0 A pure Python implementation of a sliding window memory map manager sniffio 1.3.0 Sniff out which async library your code is running under soupsieve 2.4 A modern CSS selector implementation for Beautiful Soup. stack-data 0.6.2 Extract data from python stack frames and tracebacks for informative di... tenacity 8.2.2 Retry code until it succeeds termcolor 2.2.0 ANSI color formatting for output in terminal terminado 0.17.1 Tornado websocket backend for the Xterm.js Javascript terminal emulator... tinycss2 1.2.1 A tiny CSS parser tokenizers 0.13.2 Fast and Customizable Tokenizers tomli 2.0.1 A lil' TOML parser tomlkit 0.11.6 Style preserving TOML library torch 1.13.1 Tensors and Dynamic neural networks in Python with strong GPU acceleration tornado 6.2 Tornado is a Python web framework and asynchronous networking library, ... tqdm 4.65.0 Fast, Extensible Progress Meter traitlets 5.9.0 Traitlets Python configuration system transformer-lens 0.0.0 1f65f4b An implementation of transformers tailored for mechanistic interpretabi... transformers 4.26.1 State-of-the-art Machine Learning for JAX, PyTorch and TensorFlow typeguard 3.0.0 Run-time type checker for Python typer 0.7.0 Typer, build great CLIs. Easy to code. Based on Python type hints. typing-extensions 4.5.0 Backported and Experimental Type Hints for Python 3.7+ typing-inspect 0.8.0 Runtime inspection utilities for typing module. uri-template 1.2.0 RFC 6570 URI Template Processor urllib3 1.26.15 HTTP library with thread-safe connection pooling, file post, and more. wandb 0.13.11 A CLI and library for interacting with the Weights and Biases API. wcwidth 0.2.6 Measures the displayed width of unicode strings in a terminal webcolors 1.12 A library for working with color names and color values formats defined... webencodings 0.5.1 Character encoding aliases for legacy web content websocket-client 1.5.1 WebSocket client for Python with low level API options widgetsnbextension 4.0.5 Jupyter interactive widgets for Jupyter Notebook xxhash 3.2.0 Python binding for xxHash yarl 1.8.2 Yet another URL library zipp 3.15.0 Backport of pathlib-compatible object wrapper for zip files ```