paul-gauthier / aider

aider is AI pair programming in your terminal
https://aider.chat/
Apache License 2.0
17.63k stars 1.65k forks source link

fireworks/models/deepseek-coder-v2-lite-instruct configuration #897

Closed tuanlv14 closed 1 month ago

tuanlv14 commented 1 month ago

Issue

I used: FIREWORKS_AI_API_KEY = "mykey" // in .env file And I config .aider.model.metadata.json as bellow:

"fireworks_ai/deepseek-coder-v2-instruct": {
        "max_tokens": 65536,
        "max_input_tokens": 65536,
        "max_output_tokens": 8192,
        "input_cost_per_token": 0.0000012, 
        "output_cost_per_token": 0.0000012,
        "litellm_provider": "fireworks_ai", 
        "mode": "chat",
        "supports_function_calling": true,
        "source": "https://fireworks.ai/pricing"
    }

Then I try to call aider with:

aider --model fireworks_ai/accounts/fireworks/models/deepseek-coder-v2-instruct
aider --model fireworks_ai/deepseek-coder-v2-instruct
aider --model fireworks_ai/fireworks_ai/deepseek-coder-v2-instruct
aider --model openai/fireworks_ai/deepseek-coder-v2-instruct

But no option had worked for me. It gave me the llm proxy error. Is there anyone can help me to fix?

Version and model info

No response

paul-gauthier commented 1 month ago

Thanks for trying aider and filing this issue.

Sorry, what is the error message or specific problem you are having?

When reporting problems, it is very helpful if you can provide:

Including the “announcement” lines that aider prints at startup is an easy way to share some of this helpful info.

Aider v0.37.1-dev
Models: gpt-4o with diff edit format, weak model gpt-3.5-turbo
Git repo: .git with 243 files
Repo-map: using 1024 tokens
paul-gauthier commented 1 month ago

I'm going to close this issue for now, but feel free to add a comment here and I will re-open or file a new issue any time.