search

amacati / SoulsAI

Distributed RL framework for solving the SoulsGym environments
27 stars 2 forks source link

Other bosses #1

Open anxuthu opened 1 year ago

anxuthu commented 1 year ago

This work is so fun and impressive!

I'm curious if you have tried other bosses. Will it take much longer time to train compared to the first boss?

amacati commented 1 year ago

There are two parts to this problem. First the fight needs to be implemented in SoulsGym, and then there is the training itself.

The problem with most of the other bosses is that the fights include projectiles (spells and other effects) that are hard to track for the gym. There are ways to do this, but it requires some serious effort. The alternative is to move towards images, which comes with its own drawbacks, but overall is the more general solution. There is a v2.0dev branch on SoulsGym where I have developed parts of the image environments. If I find the time, I'm gonna experiment with that one.

On the learning side it heavily depends on which bosses you choose. The first phase of Iudex for example was much harder to learn than the second one. I'd expect Vordt to be about as difficult as Iudex with comparable taining times, but I haven't tried yet. If I manage to get v2 to a state where I'm comfortable with merging it to main, then there's also going to be support for EldenRing. So in terms of bosses, Margit the Fell Omen is probably next.