Learnable frequency absolute temporal position embeddings and small bug fixes

mmcdermott / EventStreamGPT

Dataset and modelling infrastructure for modelling "event streams": sequences of continuous time, multivariate events with complex internal dependencies.

https://eventstreamml.readthedocs.io/en/latest/

MIT License

98 stars 16 forks source link

Learnable frequency absolute temporal position embeddings and small bug fixes #48

Closed mmcdermott closed 1 year ago

mmcdermott commented 1 year ago

This also introduces a pretty ugly mechanism to do FT training from scratch, which should be refined.