Could you please provide an example of using multi-modal data like images, gene and language?

kyegomez / Med-PaLM

Towards Generalist Biomedical AI

https://discord.gg/qUtxnK2NMf

MIT License

280 stars 41 forks source link

Could you please provide an example of using multi-modal data like images, gene and language? #4

Open XGGNet opened 11 months ago

XGGNet commented 11 months ago

Upvote & Fund

We're using Polar.sh so you can upvote and help fund this issue.
We receive the funding once the issue is completed & confirmed by you.
Thank you in advance for helping prioritize & fund our backlog.

chengyu89527 commented 11 months ago

same ,also can you tell me how to download the model weight

kyegomez commented 10 months ago

@XGGNet and @chengyu89527 Yes I am making an example for this now.

chengyu89527 commented 10 months ago

Thanks just curious that will you project generate the text medical cases

zjhJOJO commented 10 months ago

same

vanessailana commented 8 months ago

bumping this. Same.

Lingrui commented 2 months ago

Hi, do you have any updates on how to play with the model? especially I would like to know some more details on how to tokenize the text promp input and how to convert the output tensor into human readable sentences? Thank you!