Getting logits of the next token from batched cogvlm inference - Githubissues

lwaekfjlk / mmodel-soup

This repo is based on multimodal soup

2 stars 0 forks source link

Getting logits of the next token from batched cogvlm inference #165

Open Jasonqi146 opened 2 months ago

Jasonqi146 commented 2 months ago

Closes #

📑 Description

✅ Checks

[ ] My pull request adheres to the code style of this project
[ ] My code requires changes to the documentation
[ ] I have updated the documentation as required
[ ] All the tests have passed
[ ] Branch name follows type/descript (e.g. feature/add-llm-agents)
[ ] Ready for code review

ℹ Additional Information