search

jhshen95 / LASS

Code repo for COLING 2022 paper "Joint Language Semantic and Structure Embedding for Knowledge Graph Completion"
https://arxiv.org/abs/2209.08721
51 stars 1 forks source link

Question about mask language modeling #3

Open ZhaozwTD opened 1 year ago

ZhaozwTD commented 1 year ago

Hello, I have a problem with the following lines about the mlm/span mask: https://github.com/pkusjh/LASS/blob/43f4c5e76525120ead3097fc3952f719db6dc695/model/data_collator.py#L24 https://github.com/pkusjh/LASS/blob/43f4c5e76525120ead3097fc3952f719db6dc695/model/roberta_model.py#L95

Are these lines not executed in the code? Operations related to mask language modeling are not mentioned in the original paper.

Many thanks for your nice codes!

jhshen95 commented 1 year ago

Thank you for pointing this out! We do not use span mask and mlm loss in the current version so the lines you marked are not executed yet.