ray-project / llmperf

LLMPerf is a library for validating and benchmarking LLMs
Apache License 2.0
659 stars 113 forks source link

Handling custom codes arguments like trust_remote_code #30

Open Akash08naik opened 10 months ago

Akash08naik commented 10 months ago

So how to pass the models with custom code . I have to also pass the argument trust_remote_code for them .I here tried it in many ways even in the metadata but it is not getting passed and the model is not getting loaded.

So how to use this?