convert_weights_to_hf supports ignoring unknown parameters

[linziyi96]

For testing the language-only capability of multi-modal models on benchmarks which only accept huggingface-format models.