search

shauray8 / continuity

contains all the evals not available at lm-eval-harness and layer wise inference for bigger models with GGUF support
MIT License
2 stars 1 forks source link

Benchmark for Modelfile #10

Open shauray8 opened 3 weeks ago

shauray8 commented 3 weeks ago

A little comparison b/w YAML and CNT for model initialization

results (for a mock config file) - 

CNT Parser Time: 0.0006 seconds
YAML Parser Time: 0.0052 seconds