-
I believe it is essential also to comprehend the limits of Mamba.
This paper shows that any state-space model fails to solve the copy task unless its latent state grows linearly with the sequence le…
-
Hello, I have been using unsloth for my fine-tuning purposes and am really enjoying the framework so far!
I just wanted to know if you could add support for loading and training state space models l…
-
Hi! Much appreciated for the excellent work!
When doing instruction finetuning, I encountered an error:
------------------------
WARNING:root:Pytorch pre-release version 1.14.0a0+410ce96 - assuming…
dszpr updated
1 month ago
-
Currently the state space models don't compute any kind of R^2 type value, but it might be handy / desirable in some cases. "Forecasting, structural time series models and the Kalman filter" (Harvey, …
-
### System Info
Python 3.10.13, CUDA 12.1
GPU = NVIDIA GeForce RTX 2080 Ti. Max memory = 10.747 GB.
torch==2.2.1
torchaudio==2.1.0
torchvision==0.16.0
tokenizers==0.15.2
transformers ==git+ht…
-
Has any work been done with state space models. I'd be curious how they would perform with this framework applied.
-
This issue collects a wishlist of de-novo implementations of torch based models.
Anyone can suggest models to implement, we will have to prioritize along a impact/cost analysis.
FYI @fnhirwa.
C…
-
### Describe the bug
In the SDK documentation for creating managed devices there is an example which does not work, I am not sure if this is a user error or a bug, maybe someone can help me here?
…
-
**Reviewers:**
Submitting Author: Jouni Helske (@helske)
Other Package Authors: (delete if none) Name (@mvihola)
Repository: https://github.com/helske/bssm
Version submitted: 2.0.0
Submission ty…
-
It would be nice to add support for getting filtered output for new observations in state space models (see e.g. https://github.com/statsmodels/statsmodels/issues/2788#issuecomment-354781682). Presuma…