Add mllm_mapper - Githubissues

modelscope / data-juicer

A one-stop data processing system to make data higher-quality, juicier, and more digestible for (multimodal) LLMs! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大模型提供更高质量、更丰富、更易”消化“的数据！

Apache License 2.0

2.63k stars 166 forks source link

Add mllm_mapper #400

Closed Qirui-jiao closed 17 hours ago

Qirui-jiao commented 1 month ago

Use multimodal large language models (MLLMs) for image-text question answering tasks. Hyperparameters:

max_new_tokens: the maximum number of new tokens generated by the model.
sampling_params: sampling hyperparameters for text generation.

drcege commented 3 weeks ago

@Qirui-jiao Thanks for your contribution! Please carefully resolve conflicts and ensure correct OP counting.

github-actions[bot] commented 4 days ago

This PR is marked as stale because there has been no activity for 21 days. Remove stale label or add new comments or this PR will be closed in 3 day.

github-actions[bot] commented 17 hours ago

Close this stale PR.