Basic usage of the Mistral-7B LLM

[907Resident]

Context:

Since the Mistral-7B was released in September, there has been a lot of discussion on how well this model is performing against other open source models and even closed source models.

Objective:

Demonstrate the ability to download and utilize the Mistral-7B instruct model on a reasonably sized compute set up.

Path to completion:

The following tasks will need to be completed to close this issue:

• [x] Successfully download the model in a Google Colab Pro GPU environment
• [x] Generate a basic output through a simple instruction
• [x] Report findings within notebook

Related Tasks:

• 18

[907Resident]

See commit 38259d7 for more guidance on future work

[mcnewcp]

How did you add tasks? I like that.. Nvm, found it.

[907Resident]

A new branch called exploring-mistral-for-rag has been made and will be merged into this issue's branch when exploration is complete

[907Resident]

Converted "Bonus Tasks" to "Related Tasks" to close this issue