search

igor-sosnowicz / knowledge_verificator

A tool for self-learning. Enabled by Deep Learning.
GNU General Public License v3.0
1 stars 0 forks source link

Find better default learning materials #29

Open igor-sosnowicz opened 1 week ago

igor-sosnowicz commented 1 week ago

Compile the database of learning materials that contains longer and more reasonable materials.

igor-sosnowicz commented 1 week ago

Additionally, new examples could be used to measure create tests items measuring performance of the QG models.

igor-sosnowicz commented 1 week ago

The TinyLlama 2.1 1.1B was tested. Unfortunately, both quality of answers based on the human evaluation and performance are terrible.

igor-sosnowicz commented 1 week ago

The Phi 1.5 1.3B fails with the torch.OutOfMemoryError error on Nvidia GTX1660 Super.

igor-sosnowicz commented 6 days ago

Original Gemma 2 is a gated model so the access is restricted. Using different version of the model is possible. However, llama-cpp-python runtime is required.