-
**Is your feature request related to a problem? Please describe.**
Converting a HF reward model to .nemo doesn't seem to work right now. See discussion in #109 for details.
**Describe the soluti…
-
I'm now training reward models using your code and I discovered that reward models are not logged during their creation.
https://github.com/tlc4418/llm_optimization/blob/main/configs/config_rm.yaml…
-
### Item name
Crownfall Tresure Chest II and a few others
### Description
Hi, since yesterday I have not received any of the crownfall items meant to be given after each stage of map. That includes…
-
### Description
I played 2 games, 1 with viper and another with Zeus, in neither game did it give me player tokens to continue with the map missions
### Example Match ID (and possibly Timestamp)
_N…
-
### Description
When completing the levels of the crownfall event, no awards were given, but it was noted that they were allegedly received. Please consider my complaint and fix the error.
### Examp…
-
### Current Behaviour
Server crashes when its about to shutdown
https://gist.github.com/Nyeriah/b7e18c8795dda0ba25a8ec29c6f24ccf
### Expected Blizzlike Behaviour
Proccess exit gracefully
### So…
-
运行ppo_ray训练qwen2 72B的时候经常会报错
![image](https://github.com/user-attachments/assets/b55ab8cc-c8fa-40ba-8aa2-4bed3938e756)
运行脚本关键参数如下,已使用官方推荐decker:
ray job submit --address="http://127.0.0.1:8265" \
…
-
sakshamguruji
High
# Rewards Can Be Harvested Even When Distribution Is Marked As Finished
## Summary
In the contract StakedEXA.sol the finishDistribution() intends to finish the distribution of t…
-
They perform pretty poorly when there aren't partial resets, unclear exactly why this occurs. Could be a small bug in the PPO implementation. Initial experimentation suggests the reward scale has a lo…
-
I'm trying to run vanilla PPO against either a single reward model or an ensemble of 5 reward models.
Command: `accelerate launch --main_process_port=29503 --config_file configs/accelerate_config.…