awslabs / sagemaker-battlesnake-ai

Starter pack to build an AI for Battlesnake with Amazon Sagemaker more content on wiki:
https://github.com/awslabs/sagemaker-battlesnake-ai/wiki
Apache License 2.0
89 stars 53 forks source link

Benchmarking method #15

Closed s3afroze closed 4 years ago

s3afroze commented 4 years ago

Hi, Where is the matrix saved so that I could benchmark the new model?

Thanks,

Shahzeb

jonomon commented 4 years ago

Hi Shahzeb,

Which matrix are you referring to?

s3afroze commented 4 years ago

Hi Jonathan! That was the wrong question on my end - I was interested in knowing if the training information is saved anywhere so that I could average it out for comparison with the newer models?

btw just wanted to say, thank you so much for sharing a cool project like this!

jonomon commented 4 years ago

Hi Shahzeb,

Thank you for your kind words.

If you are training on SageMaker, you can navigate to your training job. You should see plots of the metrics in the Monitor section. Similar to the screenshot below.

Screen Shot 2020-04-10 at 10 53 01 AM

s3afroze commented 4 years ago

Thank you : )!