EOF occurred in violation of protocol uploading splits

quic / ai-hub-apps

The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

BSD 3-Clause "New" or "Revised" License

65 stars 14 forks source link

EOF occurred in violation of protocol uploading splits #8

Closed MikeYeager closed 3 weeks ago

MikeYeager commented 3 weeks ago

I've been trying to process the llama_v3_8b_chat model following the LLM on Genie tutorial on GitHub. Most of it goes OK, I've split the model locally in aimet format, but then it tries to upload the splits to QC AI Hub and the upload of the second split fails saying "EOF occurred in violation of protocol". https://github.com/quic/ai-hub-apps/tree/main/tutorials/llm_on_genie

mestrona-3 commented 3 weeks ago

Closing as we discussed this on slack with @MikeYeager

MikeYeager commented 3 weeks ago

FYI, the result was that there is a bug in Python 3.10 on Windows ARM64 that causes the uploads to fail. Newer versions of Python have a dependency on h5py that is not yet supported on Windows ARM64. It may work if you install x86 Python and run it through translation on ARM. Didn't test.