search

cpllab / syntaxgym-core

DEPRECATED: Command-line tool and Python API for targeted syntactic evaluation of language models
MIT License
10 stars 1 forks source link

readme

DEPRECATED: This project is no longer supported.

SyntaxGym Core

MIT License

syntaxgym is a Python package for easy targeted syntactic evaluation of language models. It replicates the core behavior of the SyntaxGym website, providing standardized and reproducible processes for targeted syntactic evaluation.

Installation

syntaxgym requires a working Docker installation.

Next, install and update the package using pip:

$ pip install -U syntaxgym

Links