-
Awesome work :)
I am thinking about finetuning this model on specific protein domain with MLM task.
As in, starting from the SaProt model weights, further finetuning on un-labeled dataset.
1. W…
-
Using this schema: https://github.com/stac-extensions/mlm/blob/fix-mlm-artefact/json-schema/schema.json
Which employs `"$schema": "https://json-schema.org/draft/2019-09/schema#"`
Running `stac-n…
-
## :rocket: Feature Request
The MLM form (https://mlm-form.vercel.app/) is a user-friendly way to generate a STAC MLM definition.
It should be added as reference (README.md and CITATION.cff) to …
-
Hello, appreciate the works,
when running the pcqm4m_v2_pretrain.sh, I noticed there is a `task_type="pretrain-mlm" # pretrain pretrain-mlm pretrain-ltp pretrain-euler` it seems we are pertainin…
-
Hero9+10+11+12 all support oX1, but not the current hero13 labs firmware. Please bring back support in the latest labs firmware.
### Discussed in https://github.com/gopro/labs/discussions/1123
-
Hi,
Wondering if it it is possible to incorporate more complex prior information into the mlm or one of the other available models. I have gene data that is stored in a set of igraphs for each pat…
-
在实现过程中发现缺少了这部分文件和csv文件，这些文件能否提供学习呢？
-
Hi there!
I have been using ProtT5 (your other piece of amazing work!) for a while now and remember that ProtT5 was trained BERT style to predict full sequences instead of predicting labels only. F…
-
**[ @jonas-hurst](https://github.com/jonas-hurst)** cloned issue [crim-ca/mlm-extension#35](https://github.com/crim-ca/mlm-extension/issues/35) on 2024-09-10:
> ## :rocket: Feature Request
>
>
>
…
-
您好！感谢您的开源代码。
对于mlm代码，我有一点疑惑，如下图所示，最后返回的是原始的text_ids_masked，所以在进行MLM时，与图像交互的文本token是没有进行mask嘛？非常感谢您的回复！
