KaihuaTang / Scene-Graph-Benchmark.pytorch

A new codebase for popular Scene Graph Generation methods (2020). Visualization & Scene Graph Extraction on custom images/datasets are provided. It's also a PyTorch implementation of paper “Unbiased Scene Graph Generation from Biased Training CVPR 2020”
MIT License
1.03k stars 228 forks source link

Multi-card GPUs can't train occupancy will be 100 card masters, single GPUs won't. #211

Open Lxy811 opened 2 months ago

Lxy811 commented 2 months ago

Reported an error during training, video card 100%, set batch-size high enough to run normally, error as follows: Snipaste_2024-04-29_12-04-48 First Precls training. At first set bachsize=16 will be stuck in the training before the start, and then set bachsize=32, two GPUs can be trained, but training 5000 and 7600 and so on halfway is stuck. But single card can train normally.