search

bowang-lab / scGPT

https://scgpt.readthedocs.io/en/latest/
MIT License
1.05k stars 207 forks source link

About the pertaining part #242

Open FUminlee opened 3 months ago

FUminlee commented 3 months ago

Dear scGPT Team,

I want to express my admiration for the remarkable work you have done with scGPT! I am particularly interested in the implementation details of the scGPT pretraining process.

I have a few questions regarding the architecture of the model. Specifically, I noticed that the cell embedding function is defined in both scGPT/scGPT/model/model.py and scGPT/scGPT/tasks/cell_emb.py. This overlap has left me uncertain about how these functions interact or differ.

Could you please provide a brief explanation of the pretraining code logic? Additionally, if possible, I would greatly appreciate it if you could share an example of the pretraining code.

Thank you very much for your time and help!

jkobject commented 3 weeks ago

Hello,

Seeing this stalled, I wanted to say that I have built a model that has the pre-training scripts available https://github.com/cantinilab/scPRINT

Best,