search

TinyLLaVA / TinyLLaVA_Factory

A Framework of Small-scale Large Multimodal Models
https://arxiv.org/abs/2402.14289
Apache License 2.0
631 stars 60 forks source link

Export To Common Formats #115

Open TalonBvV opened 1 month ago

TalonBvV commented 1 month ago

Good day, I hope you are well.

Please could I get some guidance exporting any of these models to a more common inference format, gguf would be ideal but onnx or tflite would be equally useful.

TalonBvV commented 1 month ago

Please even if you could give me some general points it would help, I have already tried all the standard methods, optimum and dynamo exporters.