GaiaNet-AI / gaianet-node

Install and run your own AI agent service
https://www.gaianet.ai/
GNU General Public License v3.0
4.83k stars 214 forks source link

Not able to run custom snapshot.tar.gz #76

Closed codemaster1104 closed 3 months ago

codemaster1104 commented 3 months ago

I was experimenting some things with gaianet custom nodes and wanted to just test how embedding works and work with custom data for same I created a snapshot following documentation for same Paris dataset and have added snapshot.tar.gz to my github and have updated the config file accordingly

"address": "0x8ed74092f0d0e0752a7fa5d7b9a2a81a6646a53e", "chat": "https://huggingface.co/gaianet/Llama-3-8B-Instruct-GGUF/resolve/main/Meta-Llama-3-8B-Instruct-Q5_K_M.gguf", "chat_ctx_size": "4096", "chat_name": "LLAMA-3-8B-Instruct-GGUF", "description": "The default GaiaNet node config with a Phi-3-mini-4k model and a Paris tour guide knowledge base.", "domain": "us.gaianet.network", "embedding": "nomic-embed-text-v1.5.f16.gguf", "embedding_collection_name": "default", "embedding_ctx_size": "512", "embedding_name": "Nomic-embed-text-v1.5", "llamaedge_port": "8080", "prompt_template": "llama-3-chat", "qdrant_limit": "1", "qdrant_score_threshold": "0.5", "rag_policy": "system-message", "rag_prompt": "You are a tour guide in London, UK. Use information in the following context to directly answer the question from a London visitor.\n----------------\n", "reverse_prompt": "", "snapshot": "https://huggingface.co/Ak1104/snapshot/blob/main/my.snapshot.tar.gz", "system_prompt": "You are a tour guide in London, UK. Please answer the question from a London visitor accurately." }

Note

I already had embedding model locally so in this code I have added its relative path instead of huggingface link

Now when I perform git init I am running into gzip: stdin: not in gzip format tar: Child returned status 1 tar: Error is not recoverable: exiting now and if I try to add my relative path of snapshot to "snapshot" tag i run into curl: (6) Could not resolve host: my.snapshot.tar.gz Warning: Transient problem: timeout Will retry in 1 seconds. 3 retries left. curl: (6) Could not resolve host: my.snapshot.tar.gz Warning: Transient problem: timeout Will retry in 2 seconds. 2 retries left. curl: (6) Could not resolve host: my.snapshot.tar.gz Warning: Transient problem: timeout Will retry in 4 seconds. 1 retries left. curl: (6) Could not resolve host: my.snapshot.tar.gz

I am successfully able to run Llama3_London tour guide example from documentation, not sure whats going wrong for my self created snapshot

alabulei1 commented 3 months ago

Hi @codemaster1104

From the config.json file you provided, I found that the snapshot link is wrong. You should use https://huggingface.co/Ak1104/snapshot/resolve/main/my.snapshot.tar.gz, which is the correct download link.

codemaster1104 commented 3 months ago

Thanks @alabulei1 got it working with that link

alabulei1 commented 3 months ago

Great! I will close this PR. Let us know if you have any other questions.