Open Fotiligner opened 3 months ago
Gorilla-hf
zero-shot python inference.py -m gpt-3.5-turbo -d gorilla --api_name huggingface
python inference.py -m gpt-3.5-turbo -d gorilla --api_name huggingface
Our results: Accuracy: 0.11. Hallucination: 0.59.
Gorilla-th
zero-shot python inference.py -m gpt-3.5-turbo -d gorilla --api_name torchhub
python inference.py -m gpt-3.5-turbo -d gorilla --api_name torchhub
Our results: Accuracy: 0.45. Hallucination: 0.48.
Gorilla-tf
zero-shot python inference.py -m gpt-3.5-turbo -d gorilla --api_name tensorflowhub
python inference.py -m gpt-3.5-turbo -d gorilla --api_name tensorflowhub
Our results: Accuracy: 0.15. Hallucination: 0.80.
Gorilla-hf
zero-shot
python inference.py -m gpt-3.5-turbo -d gorilla --api_name huggingfaceOur results: Accuracy: 0.11. Hallucination: 0.59.
Gorilla-th
zero-shot
python inference.py -m gpt-3.5-turbo -d gorilla --api_name torchhubOur results: Accuracy: 0.45. Hallucination: 0.48.
Gorilla-tf
zero-shot
python inference.py -m gpt-3.5-turbo -d gorilla --api_name tensorflowhubOur results: Accuracy: 0.15. Hallucination: 0.80.