search

Marker-Inc-Korea / AutoRAG

RAG AutoML Tool - Find optimal RAG pipeline for your own data.
Apache License 2.0
1.18k stars 102 forks source link

Add openai output token support at generator module #221

Closed vkehfdl1 closed 2 months ago

vkehfdl1 commented 4 months ago

part of the #63

LlamaIndex openai model does not support logprob and output tokens. We might need to support it for using various log-prob based modules.

vkehfdl1 commented 4 months ago

You can see g_eval method how to get logprob from openai API call.

vkehfdl1 commented 2 months ago

Don't have to get log prob from now.

vkehfdl1 commented 2 months ago

Third, no error because of the side-effect. Dependency only in opneai-python library.