search

epfl-dlab / llm-latent-language

Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
41 stars 9 forks source link

load_in_8bit=True #2

Open kargaranamir opened 3 days ago

kargaranamir commented 3 days ago

How much do you think changing load_in_8bit=True will affect your results?

wendlerc commented 3 days ago

Based on my experience not much. In the google colab I actually used 8bit most of the time.