search

dusty-nv / NanoLLM

Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.
https://dusty-nv.github.io/NanoLLM/
MIT License
196 stars 31 forks source link

all the input arrays must have same number of dimensions, but the array at index 0 has 2 dimension(s) and the array at index 2 has 3 dimension(s) #28

Open Shehjad-Ishan opened 3 months ago

Shehjad-Ishan commented 3 months ago

Enbedding shape:(1, 32) Enbedding shape:(1, 7) Enbedding shape:(1, 196, 2560) Enbedding shape:(1, 13) Traceback (most recent call last): File "/home/sigmind/VideoDownloader/nano_llm_try/video.py", line 105, in <module> embedding, _ = chat_history.embed_chat() File "/home/sigmind/VideoDownloader/nano_llm_try/nano_llm/chat/history.py", line 385, in embed_chat embeddings = np.concatenate(embeddings, axis=1) #, position File "<__array_function__ internals>", line 180, in concatenate ValueError: all the input arrays must have same number of dimensions, but the array at index 0 has 2 dimension(s) and the array at index 2 has 3 dimension(s) I am trying to run NanoLLM on my ubuntu machine (not Jetson, x86 dGPU). This error has occured. I am loading the model as hugging face model. Complied the jeston_utlis locally without libsoup.

Shehjad-Ishan commented 3 months ago

@dusty-nv Kindly, let me know if there is a solution.

dusty-nv commented 3 months ago

Sorry have not ported this on x86, there you may just want to use the original Llava or VILA repos. Or have you tried text-only LLM first?

From: Kazi Shehjad Islam @.> Sent: Tuesday, July 30, 2024 3:46:02 AM To: dusty-nv/NanoLLM @.> Cc: Dustin Franklin @.>; Mention @.> Subject: Re: [dusty-nv/NanoLLM] all the input arrays must have same number of dimensions, but the array at index 0 has 2 dimension(s) and the array at index 2 has 3 dimension(s) (Issue #28)

@dusty-nvhttps://github.com/dusty-nv Kindly, let me know if there is a solution.

— Reply to this email directly, view it on GitHubhttps://github.com/dusty-nv/NanoLLM/issues/28#issuecomment-2257692313, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ADVEGK754AF32TVNXGBQZHLZO5ADPAVCNFSM6AAAAABLTR5YYWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDENJXGY4TEMZRGM. You are receiving this because you were mentioned.Message ID: @.***>