issues
search
openpsi-project
/
ReaLHF
Super-Efficient RLHF Training of LLMs with Parameter Reallocation
Apache License 2.0
76
stars
3
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
v0.3.0 Release
#68
garrett4wade
closed
1 day ago
0
[Bug Fixes] Fix model worker stuck under some special circumstances.
#67
garrett4wade
closed
1 day ago
0
[BUG FIX] Fix minibatch splitting in PPO and GRPO.
#66
garrett4wade
closed
3 days ago
0
Format fix
#65
garrett4wade
closed
3 days ago
0
Update topology.py
#64
garrett4wade
closed
3 days ago
0
[Patch] Add a `clear_cache_freq` option in the commandline.
#63
garrett4wade
closed
3 days ago
0
Fix symmetric allocation parsing
#62
garrett4wade
closed
3 days ago
0
[Bug Fix] Fix megatron train_batch n_pp_mbs
#61
garrett4wade
closed
4 days ago
0
[Patch Fix] Support arbitrary symmetric allocations and fix MFC time log in workers
#60
garrett4wade
closed
3 days ago
0
Issues for the generation experiment.
#59
garrett4wade
closed
4 days ago
1
Automatic importing can be problematic if the parent directory contains "realhf".
#58
garrett4wade
opened
1 week ago
0
[Docs] v0.3.0 docs about implementation details and the code architecture
#57
garrett4wade
closed
2 days ago
0
[New Feature] Add utilities for profiling individual interfaces.
#56
garrett4wade
closed
3 days ago
0
[Patch Fixes] Fix several bugs and unintended behaviors.
#55
garrett4wade
closed
4 days ago
1
Fix bugs related to system-wise profiling.
#54
garrett4wade
closed
3 weeks ago
0
Fix mini-batch generate.
#53
garrett4wade
closed
3 weeks ago
0
Fix mixtral model conversion
#52
garrett4wade
closed
3 weeks ago
0
Fix mistral model conversion
#51
garrett4wade
closed
3 weeks ago
0
Bug fixes: offloading with a single MFC and parameter spec for ReaLModel.
#50
garrett4wade
closed
1 month ago
0
Fix CUDAGraph recapture
#49
nuzant
closed
1 month ago
0
[WIP] Custom CUDAGraph to accelerate PPO without memory waste
#48
nuzant
closed
1 month ago
3
Change the type of sequence lengths to lists.
#47
garrett4wade
closed
1 month ago
0
TransformerConfig() takes no arguments
#46
AIRobotZhang
closed
4 days ago
2
allocation_mode
#45
AIRobotZhang
closed
4 days ago
2
Error while deserializing header: MetadataIncompleteBuffer
#44
AIRobotZhang
closed
1 month ago
2
worker ERROR: Worker encountered error 'id'
#43
AIRobotZhang
closed
1 month ago
1
Update README and docs.
#42
garrett4wade
closed
1 month ago
0
No module named 'colorlog'
#41
AIRobotZhang
closed
1 month ago
1
如何推理
#40
AIRobotZhang
closed
1 month ago
2
Add MoE model (Mixtral) support.
#39
nuzant
closed
1 month ago
0
Add a Reference EMA example.
#38
garrett4wade
closed
1 month ago
0
Add num_micro_batches option in interface implementations.
#37
garrett4wade
closed
1 month ago
0
[PATCH] Fix the parallelism_eq function to make OmegaConf happy.
#36
garrett4wade
closed
1 month ago
0
Patch fix for v0.3.0.pre2
#35
garrett4wade
closed
1 month ago
0
Dump to v0.3.0.pre2
#34
garrett4wade
closed
1 month ago
0
Fix gradient accumulation type in the megatron backend.
#33
garrett4wade
closed
1 month ago
0
[BUGFIX] Fix dockerfile and some known bugs.
#32
garrett4wade
closed
1 month ago
0
Add the GRPO algorithm.
#31
garrett4wade
closed
1 month ago
0
v0.3.0.pre1
#30
garrett4wade
closed
1 month ago
0
Add the REINFORCE algorithm.
#29
garrett4wade
closed
1 month ago
0
Trying to fix and refactor the structure of test examples.
#28
garrett4wade
closed
1 month ago
0
[MAJOR] Refactor the data structure to support multiple sequences in a single piece of data.
#27
garrett4wade
closed
1 month ago
0
[WIP] [MAJOR] Refactor the data structure to support multiple sequences in a single piece of data.
#26
garrett4wade
closed
1 month ago
0
[MAJOR] Refactor configuration and dataflow graph to make it more user-friendly.
#25
garrett4wade
closed
1 month ago
1
有多机分布式任务的example吗？
#24
PKUFlyingPig
opened
2 months ago
5
Add Mistral model support.
#23
garrett4wade
closed
2 months ago
0
Bump to 0.2.0
#22
garrett4wade
closed
2 months ago
0
Update docs about distributed experiments with Ray.
#21
garrett4wade
closed
2 months ago
0
Add pytest workflow and the Ray mode.
#20
garrett4wade
closed
2 months ago
0
Fix repo path in constants.py
#19
garrett4wade
closed
2 months ago
0
Next