Connecting the Dots: LLMs can Infer and Verbalize Latent Structure from Disparate Training Data

This repository contains the code accompanying our paper: Connecting the Dots: LLMs can Infer and Verbalize Latent Structure from Disparate Training Data

Repository Structure

The codebase is organized into subdirectories for each task (the functions directory contains code for both Functions and Mixture of Functions). Please refer to the individual subdirectories for specific instructions on running the code for each task.

We provide evaluation results and a Jupyter notebook with code for plotting and generating baselines for the Parity Learning task in the parity directory.

Citation

@article{treutlein2024connecting,
  title={Connecting the Dots: LLMs can Infer and Verbalize Latent Structure from Disparate Training Data},
  author={Johannes Treutlein and Dami Choi and Jan Betley and Samuel Marks and Cem Anil and Roger Grosse and Owain Evans},
  journal={arXiv preprint arXiv:2406.14546},
  year={2024}
}