search

yanpanlau / DDPG-Keras-Torcs

Using Keras and Deep Deterministic Policy Gradient to play TORCS
717 stars 267 forks source link

Time required to train #63

Open Meet001 opened 5 years ago

Meet001 commented 5 years ago

Hey! Can you please inform me roughly how many hours/days does it take to train this network. I read your code and it has total steps = 2000(episodes)*100000(steps) and on running I found that 5 steps roughly take 1 sec. so it should take 462 days to train this, but this seems too much. am I missing something?

yanpanlau commented 5 years ago

Each step are like several milliseconds, for me, the agent can learn pretty decent skill like 6 to 7 hours of training.

Meet001 notifications@github.com 於 2019年11月12日週二 下午2:16寫道：

Hey! Can you please inform me roughly how many hours/days does it take to train this network. I read your code and it has total steps = 2000(episodes)*100000(steps) and on running I found that 5 steps roughly take 1 sec. so it should take 462 days to train this, but this seems too much. am I missing something?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/yanpanlau/DDPG-Keras-Torcs/issues/63?email_source=notifications&email_token=ADWWYY6HB75GW66ALBQHPBLQTJC3HA5CNFSM4JL6ZALKYY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4HYTF5GA, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADWWYY7PNVUV7XJ6BCRVLZLQTJC3HANCNFSM4JL6ZALA .

Meet001 commented 5 years ago

Screenshot from 2019-11-12 11-50-45

Have you encountered this problem while training, when the agent gets stuck in side. How do i solve this ?

yanpanlau commented 5 years ago

It happens at the beginning. But the agent should learn that keep hitting the side has bad reward and eventually it will drive straight. If the course is too difficult try to set the initial parameters (like steering wheel) go straight such that the agent can receive more positive reward.

Meet001 notifications@github.com 於 2019年11月12日週二 下午2:22寫道：

[image: Screenshot from 2019-11-12 11-50-45] https://user-images.githubusercontent.com/28361717/68646987-ac9a5f80-0542-11ea-881f-181f675b838d.png

Have you encountered this problem while training, when the agent gets stuck in side. How do i solve this ?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/yanpanlau/DDPG-Keras-Torcs/issues/63?email_source=notifications&email_token=ADWWYY2UBSX4WOFXCIQ4BFTQTJDR7A5CNFSM4JL6ZALKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEDZFN2I#issuecomment-552752873, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADWWYYZNIEFVSTQ7WJYGDXTQTJDR7ANCNFSM4JL6ZALA .