declare-lab / instruct-eval

This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.
https://declare-lab.github.io/instruct-eval/
Apache License 2.0
528 stars 42 forks source link

Colab notebook #31

Open Bachstelze opened 9 months ago

Bachstelze commented 9 months ago

How can we use the scripts in a colab notebook? There are installation problems with or without conda and also after a restart.

WARNING: The following packages were previously imported in this runtime: [chardet,dateutil,google,pytz,six] You must restart the runtime in order to use newly installed versions.

So bitsandbytes throws this error: RuntimeError: CUDA Setup failed despite GPU being available. Inspect the CUDA SETUP outputs above to fix your environment!