HEP-KBFI / ml-tau-en-reg

Reconstructing tau leptons using various machine learning techniques
GNU General Public License v3.0
0 stars 1 forks source link

OmniJet for Embed in ParticleTransformer #68

Closed jpata closed 1 week ago

jpata commented 1 month ago

use OmniJet tokenizer + GPT backbone for the per-particle embedding in ParticleTransformer.

Laurits7 commented 4 weeks ago

One version is addressed in #69. The two other implementations not done so far are the

Laurits7 commented 3 weeks ago

v2.1 and v2.2 addressed in PR #70

Laurits7 commented 1 week ago

In PR #75 both the ParT embedding and self-attention layers were replaced by the OmniJet backbone embedding for a simpler model.