[question] long context for single model ppo training

[yananchen1989]

hello. is it ok to ppo train 7b level models on single gpu where each sample has around 6k length in prompt and round 2k length in completion ?

any advice for this scenario ? thanks

[hijkzzz]

A single GPU is not enough to run 7B + long text