[WIP]适配bge-m3和jina

[123456ADWAE2]

结果如下：

适配jina时出现警告，但是可以运行，警告如下 Some weights of BertModel were not initialized from the model checkpoint at D:\project\LangChain-ChatGLM-Webui\model\jina-embeddings-v2-base-zh and are newly initialized: ['encoder.layer.5.intermediate.dense.weight', 'encoder.layer.5.output.dense.bias', 'encoder.layer.0.output.LayerNorm.bias', 'encoder.layer.3.output.LayerNorm.weight', 'encoder.layer.10.output.LayerNorm.bias', 'encoder.layer.5.intermediate.dense.bias', 'encoder.layer.11.output.dense.weight', 'embeddings.position_embeddings.weight', 'encoder.layer.3.intermediate.dense.weight', 'encoder.layer.2.intermediate.dense.bias', 'encoder.layer.6.output.dense.bias', 'encoder.layer.10.output.dense.bias', 'encoder.layer.8.intermediate.dense.bias', 'encoder.layer.5.output.LayerNorm.weight', 'encoder.layer.9.output.dense.bias', 'encoder.layer.3.output.dense.bias', 'encoder.layer.8.output.dense.weight', 'encoder.layer.3.intermediate.dense.bias', 'encoder.layer.10.intermediate.dense.bias', 'encoder.layer.4.output.dense.bias', 'encoder.layer.11.output.LayerNorm.bias', 'encoder.layer.1.output.dense.weight', 'encoder.layer.11.output.LayerNorm.weight', 'encoder.layer.3.output.LayerNorm.bias', 'encoder.layer.11.output.dense.bias', 'encoder.layer.7.output.dense.weight', 'encoder.layer.9.intermediate.dense.weight', 'encoder.layer.10.output.LayerNorm.weight', 'encoder.layer.0.output.dense.bias', 'encoder.layer.4.output.LayerNorm.weight', 'encoder.layer.9.output.LayerNorm.weight', 'encoder.layer.7.intermediate.dense.weight', 'encoder.layer.1.output.dense.bias', 'encoder.layer.10.intermediate.dense.weight', 'encoder.layer.2.intermediate.dense.weight', 'encoder.layer.6.output.LayerNorm.weight', 'encoder.layer.6.intermediate.dense.weight', 'encoder.layer.1.intermediate.dense.weight', 'encoder.layer.1.output.LayerNorm.weight', 'encoder.layer.2.output.LayerNorm.bias', 'encoder.layer.0.output.dense.weight', 'encoder.layer.2.output.LayerNorm.weight', 'encoder.layer.4.output.LayerNorm.bias', 'encoder.layer.9.output.dense.weight', 'encoder.layer.7.output.LayerNorm.weight', 'encoder.layer.2.output.dense.weight', 'encoder.layer.3.output.dense.weight', 'encoder.layer.8.output.LayerNorm.weight', 'encoder.layer.0.intermediate.dense.bias', 'encoder.layer.5.output.LayerNorm.bias', 'encoder.layer.8.output.dense.bias', 'encoder.layer.11.intermediate.dense.bias', 'encoder.layer.8.output.LayerNorm.bias', 'encoder.layer.4.intermediate.dense.weight', 'encoder.layer.11.intermediate.dense.weight', 'encoder.layer.6.output.LayerNorm.bias', 'encoder.layer.6.output.dense.weight', 'encoder.layer.4.output.dense.weight', 'encoder.layer.0.output.LayerNorm.weight', 'encoder.layer.1.output.LayerNorm.bias', 'encoder.layer.4.intermediate.dense.bias', 'encoder.layer.10.output.dense.weight', 'encoder.layer.6.intermediate.dense.bias', 'encoder.layer.2.output.dense.bias', 'encoder.layer.0.intermediate.dense.weight', 'encoder.layer.7.output.LayerNorm.bias', 'encoder.layer.8.intermediate.dense.weight', 'encoder.layer.9.intermediate.dense.bias', 'encoder.layer.9.output.LayerNorm.bias', 'encoder.layer.7.intermediate.dense.bias', 'encoder.layer.7.output.dense.bias', 'encoder.layer.5.output.dense.weight', 'encoder.layer.1.intermediate.dense.bias'] You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.

[thomas-yanxin]

警告可以忽略，不影响

[thomas-yanxin]

Thanks! LGTM!