-
Make tutorial for importance sampling
-
Add documentation and possibly a tutorial on importance sampling, since we have used this some of the published X-PSI papers.
-
-
Hi,
I read the [RLOO paper from Cohere ](https://cohere.com/research/papers/back-to-basics-revisiting-reinforce-style-optimization-for-learning-from-human-feedback-in-llms-2024-02-23), which claim…
-
Hi,
Thank you for the books, they were very helpful! I signalled an issue on the blog, but you might not visit it often, so I'll put it here, too.
I implemented a ray tracer with help from your …
-
## Describe the bug
The device of `info['_weight']` doesn't match the storage device.
## To Reproduce
```python
# From documentation
from torchrl.data.replay_buffers import ReplayBuffer, La…
-
-
First of all, thanks for this implementation.
One question however: I see that the weights for the importance sampling are calculated and returned when a batch is sampled.
However, the weights ar…
-
Dear Benjamin,
We are trying to use importance sampling by using the following command line
python montepython/MontePython.py --conf class.conf -p input.param -o chains/output -m IS --IS-starting-f…
-
We have (tw @bvdmitri ) spotted an issue with running an important sampling strategy around the GammaMixture node.
We proposed this strategy n [this paper](https://ieeexplore.ieee.org/document/95963…